00010000:00010000:1.0F:1788746663.314405:0:17047:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0F:1788746663.323740:0:17816:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788746663.635039:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788746663.635065:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a45bcb6b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875636324095744:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788746663.635148:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746663.635196:0:17063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324095744 00000100:00100000:1.0:1788746663.635206:0:17063:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324095744 00000100:00100000:1.0:1788746663.635270:0:17063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788746663.635280:0:17063:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a45bcb69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875636324095744:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788746663.635338:0:17063:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:1.0:1788746663.635394:0:17063:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a45bcb69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875636324095744:12345-0@lo:41:osp-pre-0-1.0 Request processed in 115us (247us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746663.635401:0:17063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788746663.635474:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a45bcb6b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875636324095744:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0F:1788746663.635886:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788746663.635917:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a4481b64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875636324095616:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788746663.635952:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746663.635993:0:18568:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324095616 00000100:00100000:3.0:1788746663.635998:0:18568:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324095616 00000100:00100000:3.0:1788746663.636047:0:18568:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788746663.636054:0:18568:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4481b65180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875636324095616:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788746663.636071:0:18568:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788746663.636104:0:18568:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4481b65180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875636324095616:12345-0@lo:13:osp-pre-0-0.0 Request processed in 51us (152us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746663.636110:0:18568:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:3.0:1788746663.636126:0:17054:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788746663.636146:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a4481b64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875636324095616:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788746663.636573:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788746663.636585:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a44837de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875636324095872:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788746663.636618:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746663.640320:0:18090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324095872 00000100:00100000:0.0:1788746663.640334:0:18090:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324095872 00000100:00100000:0.0:1788746663.640447:0:18090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788746663.640458:0:18090:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4481b64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1875636324095872:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788746663.640498:0:18090:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788746663.640596:0:18090:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4481b64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1875636324095872:12345-0@lo:41:osp-pre-1-0.0 Request processed in 140us (3976us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746663.640603:0:18090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788746663.641874:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a44837de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875636324095872:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788746664.339373:0:17046:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788746665.177578:0:17038:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934622 is committed 00000020:00080000:0.0:1788746665.177602:0:17038:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8a4587ee83c0 refcount 2 committed 0 result 0 batchid 4294967529 00000020:00080000:0.0:1788746665.177608:0:17038:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8a4584563e00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8a4587ee8600 00000020:00080000:0.0:1788746665.177612:0:17038:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8a4584563000 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8a45b49e8600 00000020:00080000:2.0F:1788746665.178577:0:17098:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4294967529 committed batchid 8 00000020:00080000:2.0:1788746665.178750:0:17098:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:1.0:1788746665.178866:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a45c216c600/0xfac36e891541446d lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17059 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746665.178882:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a45c216c600/0xfac36e891541446d lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17059 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746665.178893:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a45c216c600/0xfac36e891541446d lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17059 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746665.178901:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a45c216c600 already unused, calling callback (ffffffffc17914f0) 00010000:00010000:1.0:1788746665.178907:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a45c216c600/0xfac36e891541446d lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17059 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746665.178917:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a45c216c600/0xfac36e891541446d lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17059 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746665.178936:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8a4483583c00) 00010000:00010000:1.0:1788746665.178958:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788746665.178965:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a45c216c600/0xfac36e891541446d lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17059 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746665.178972:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a45c216c600/0xfac36e891541446d lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17059 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746665.363392:0:17047:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788746665.684257:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a4481b67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875636324096000:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788746665.684359:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746665.684431:0:18568:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324096000 00000100:00100000:3.0:1788746665.684440:0:18568:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324096000 00000100:00100000:3.0:1788746665.684493:0:18568:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788746665.684503:0:18568:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4481b66680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875636324096000:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788746665.684534:0:18568:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 26324672 pending 0 free 3915849728 avail 3684327424 00000100:00100000:3.0:1788746665.684581:0:18568:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4481b66680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875636324096000:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (222us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746665.684589:0:18568:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:3.0:1788746665.684619:0:17054:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788746665.684666:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a4481b67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875636324096000:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788746665.685775:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a4481b66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875636324096256:0@lo:400:kworker.0 00000100:00100000:3.0:1788746665.685833:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746665.685867:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a4481b65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875636324096768:0@lo:400:kworker.0 00000100:00100000:3.0:1788746665.685889:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746665.685907:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a4481b66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3645:1875636324097280:0@lo:400:kworker.0 00000100:00100000:3.0:1788746665.685926:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746665.685943:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1788746665.685948:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a4481b67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875636324096384:0@lo:400:kworker.0 00000100:00100000:3.0:1788746665.685965:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746665.685978:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a4481b64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875636324096896:0@lo:400:kworker.0 00000100:00100000:3.0:1788746665.685994:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746665.686006:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a4481b67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3645:1875636324097408:0@lo:400:kworker.0 00000100:00100000:3.0:1788746665.686021:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746665.686047:0:17058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324097280 00000100:00100000:3.0:1788746665.686055:0:17058:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324097280 00000100:00100000:3.0:1788746665.686094:0:17058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324097408 00000100:00100000:3.0:1788746665.686097:0:17058:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324097408 00000100:00100000:3.0:1788746665.686118:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788746665.686125:0:17058:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a45b7f81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875636324097280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788746665.686170:0:17058:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a45b7f81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875636324097280:12345-0@lo:400:kworker.0 Request processed in 45us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746665.686176:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788746665.686190:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788746665.686196:0:17058:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a45b7f83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1875636324097408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788746665.686232:0:17058:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a45b7f83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1875636324097408:12345-0@lo:400:kworker.0 Request processed in 36us (209us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746665.686239:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788746665.686261:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a4481b67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7bf60f24-4000-471c-bcb3-0ae64e0e499e:3644:1875636324096128:0@lo:400:kworker.0 00000100:00100000:3.0:1788746665.686599:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746665.686627:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a4481b64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875636324096640:0@lo:400:kworker.0 00000100:00100000:3.0:1788746665.686662:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746665.687202:0:18566:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324096768 00000100:00100000:0.0:1788746665.687210:0:18566:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324096768 00000100:00100000:0.0:1788746665.687244:0:18566:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324096384 00000100:00100000:0.0:1788746665.687247:0:18566:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324096384 00000100:00100000:0.0:1788746665.687260:0:18566:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324096896 00000100:00100000:0.0:1788746665.687262:0:18566:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324096896 00000100:00100000:0.0:1788746665.687278:0:18566:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788746665.687284:0:18566:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4590cb8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875636324096768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788746665.687357:0:18566:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4590cb8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875636324096768:12345-0@lo:400:kworker.0 Request processed in 73us (1466us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746665.687363:0:18566:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788746665.687378:0:18566:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788746665.687384:0:18566:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a45b7f83480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1875636324096384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788746665.687412:0:18566:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a45b7f83480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1875636324096384:12345-0@lo:400:kworker.0 Request processed in 29us (1446us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746665.687427:0:18566:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788746665.687438:0:18566:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788746665.687444:0:18566:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a45b7f80700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875636324096896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788746665.687475:0:18566:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a45b7f80700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875636324096896:12345-0@lo:400:kworker.0 Request processed in 31us (1480us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746665.687480:0:18566:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788746665.687499:0:17052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324096128 00000100:00100000:0.0:1788746665.687503:0:17052:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324096128 00000100:00100000:0.0:1788746665.687526:0:17052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1788746665.687532:0:17052:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a45bda52050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7bf60f24-4000-471c-bcb3-0ae64e0e499e+24:3644:x1875636324096128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788746665.687558:0:17052:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a45bda52050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7bf60f24-4000-471c-bcb3-0ae64e0e499e+24:3644:x1875636324096128:12345-0@lo:400:kworker.0 Request processed in 27us (960us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746665.687564:0:17052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1788746665.689554:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a4481b64e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3644:1875636324097152:0@lo:400:kworker.0 00000100:00100000:3.0:1788746665.689612:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746665.689679:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a4481b67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7bf60f24-4000-471c-bcb3-0ae64e0e499e:3644:1875636324096128:0@lo:400:kworker.0 00000100:00100000:3.0:1788746665.689696:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1788746665.689703:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a4481b67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875636324096512:0@lo:400:kworker.0 00000100:00100000:3.0:1788746665.689727:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746665.689746:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a4481b65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875636324097024:0@lo:400:kworker.0 00000100:00100000:3.0:1788746665.689765:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746665.689792:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a4481b64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3644:1875636324097536:0@lo:400:kworker.0 00000100:00100000:3.0:1788746665.689812:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746665.689847:0:19851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324097152 00000100:00100000:3.0:1788746665.689854:0:19851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324097152 00000100:00100000:3.0:1788746665.689899:0:19851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324096512 00000100:00100000:3.0:1788746665.689902:0:19851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324096512 00000100:00100000:3.0:1788746665.689913:0:19851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324097024 00000100:00100000:3.0:1788746665.689916:0:19851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324097024 00000100:00100000:3.0:1788746665.689925:0:19851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324097536 00000100:00100000:3.0:1788746665.689927:0:19851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324097536 00000100:00100000:3.0:1788746665.689942:0:19851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788746665.689963:0:19851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a45b7f80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875636324097152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788746665.690012:0:19851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a45b7f80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875636324097152:12345-0@lo:400:kworker.0 Request processed in 51us (399us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746665.690019:0:19851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788746665.690035:0:19851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788746665.690041:0:19851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a45b7f81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875636324096512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788746665.690066:0:19851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a45b7f81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875636324096512:12345-0@lo:400:kworker.0 Request processed in 26us (339us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746665.690072:0:19851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788746665.690084:0:19851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788746665.690091:0:19851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a45b7f81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875636324097024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788746665.690119:0:19851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a45b7f81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875636324097024:12345-0@lo:400:kworker.0 Request processed in 29us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746665.690124:0:19851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788746665.690135:0:19851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788746665.690141:0:19851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a45b7f80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875636324097536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788746665.690168:0:19851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a45b7f80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875636324097536:12345-0@lo:400:kworker.0 Request processed in 28us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746665.690174:0:19851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:3.0:1788746665.690192:0:17054:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788746665.690197:0:17054:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788746665.690201:0:17054:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788746665.690203:0:17054:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788746665.690228:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a4481b67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875636324096384:0@lo:400:kworker.0 00000100:00100000:3.0:1788746665.690243:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a4481b64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875636324096896:0@lo:400:kworker.0 00000100:00100000:3.0:1788746665.690268:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a4481b67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3645:1875636324097408:0@lo:400:kworker.0 00000100:00100000:3.0:1788746665.690280:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a4481b65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875636324096768:0@lo:400:kworker.0 00010000:00080000:3.0:1788746665.690388:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a4481b66a00 x1875636324097280/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788746681 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788746665.690400:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a4481b66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3645:1875636324097280:0@lo:400:kworker.0 00000100:00100000:3.0:1788746665.690441:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a4481b67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875636324096512:0@lo:400:kworker.0 00000100:00100000:3.0:1788746665.690450:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a4481b65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875636324097024:0@lo:400:kworker.0 00010000:00080000:3.0:1788746665.690458:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a4481b64700 x1875636324097536/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788746681 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788746665.690465:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a4481b64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3644:1875636324097536:0@lo:400:kworker.0 00000100:00100000:3.0:1788746665.690473:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a4481b64e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3644:1875636324097152:0@lo:400:kworker.0 00000100:00100000:2.0:1788746665.692240:0:17063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324096256 00000100:00100000:2.0:1788746665.692249:0:17063:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324096256 00000100:00100000:2.0:1788746665.692666:0:18090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324096640 00000100:00100000:2.0:1788746665.692672:0:18090:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324096640 00000100:00100000:2.0:1788746665.692693:0:18090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788746665.692702:0:18090:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4481b66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1875636324096256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788746665.692793:0:18090:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4481b66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1875636324096256:12345-0@lo:400:kworker.0 Request processed in 92us (6959us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746665.692801:0:18090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788746665.692817:0:18090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788746665.692823:0:18090:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a45b7f80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1875636324096640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788746665.692853:0:18090:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a45b7f80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1875636324096640:12345-0@lo:400:kworker.0 Request processed in 31us (6201us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746665.692859:0:18090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788746665.692898:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a4481b66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875636324096256:0@lo:400:kworker.0 00000100:00100000:1.0:1788746665.697569:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a45bcb6b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875636324097664:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788746665.697664:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746665.697727:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a4481b64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875636324096640:0@lo:400:kworker.0 00000100:00100000:1.0:1788746665.697880:0:18568:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324097664 00000100:00100000:1.0:1788746665.697889:0:18568:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324097664 00000100:00100000:1.0:1788746665.699594:0:18568:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788746665.699614:0:18568:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a45bcb68e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875636324097664:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788746665.699645:0:18568:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 26324672 pending 0 free 3915849728 avail 3684327424 00000100:00100000:1.0:1788746665.699750:0:18568:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a45bcb68e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875636324097664:12345-0@lo:13:osp-pre-1-1.0 Request processed in 143us (2097us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746665.699757:0:18568:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788746665.703050:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a45bcb6b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875636324097664:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1788746666.386482:0:17046:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788746666.460878:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788746666.461046:0:19851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636305144064 00000100:00100000:3.0:1788746666.461057:0:19851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636305144064 00000100:00100000:3.0:1788746666.461138:0:19851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 65 00000100:00100000:3.0:1788746666.461149:0:19851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a44837de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:583130b9-0019-4af8-9623-d64634ab82f4+13:15552:x1875636305144064:12345-192.168.204.39@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1788746666.461259:0:19851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a44837de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:583130b9-0019-4af8-9623-d64634ab82f4+13:15552:x1875636305144064:12345-192.168.204.39@tcp:60:lhsmtool_posix.0 Request processed in 112us (390us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746666.461266:0:19851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 65 00000100:00080000:0.0:1788746666.462681:0:17054:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788746666.463548:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788746666.464696:0:17059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636305144192 00000100:00100000:2.0:1788746666.464709:0:17059:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636305144192 00000100:00100000:2.0:1788746666.464812:0:17059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 66 00000100:00100000:2.0:1788746666.464828:0:17059:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a45b7f82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:583130b9-0019-4af8-9623-d64634ab82f4+5:15552:x1875636305144192:12345-192.168.204.39@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1788746666.464948:0:17059:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a45b7f82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:583130b9-0019-4af8-9623-d64634ab82f4+5:15552:x1875636305144192:12345-192.168.204.39@tcp:60:lhsmtool_posix.0 Request processed in 127us (1407us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746666.464956:0:17059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 66 00000100:00080000:0.0:1788746666.465138:0:17054:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788746666.469566:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788746666.469656:0:17062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636305144448 00000100:00100000:0.0:1788746666.469667:0:17062:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636305144448 00000100:00100000:0.0:1788746666.469732:0:17062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 12 00000100:00100000:0.0:1788746666.469742:0:17062:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a45b7ef2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:583130b9-0019-4af8-9623-d64634ab82f4+13:15552:x1875636305144448:12345-192.168.204.39@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788746666.470194:0:17062:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a45b7ef2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:583130b9-0019-4af8-9623-d64634ab82f4+14:15552:x1875636305144448:12345-192.168.204.39@tcp:35:lhsmtool_posix.0 Request processed in 451us (637us total) trans 8589934623 rc 0/0 00000100:00100000:0.0:1788746666.470203:0:17062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 12 00010000:00010000:1.0:1788746667.410962:0:17047:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788746667.730645:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a45b7ef1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875636324097792:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788746667.730725:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788746667.730926:0:18569:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324097792 00000100:00100000:2.0:1788746667.730936:0:18569:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324097792 00000100:00100000:2.0:1788746667.731028:0:18569:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788746667.731047:0:18569:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a45b7f83b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875636324097792:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788746667.731095:0:18569:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788746667.731147:0:18569:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a45b7f83b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875636324097792:12345-0@lo:13:osp-pre-0-1.0 Request processed in 110us (421us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746667.731154:0:18569:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:3.0:1788746667.731485:0:17054:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788746667.731524:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a45b7ef1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875636324097792:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788746667.895891:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788746667.895942:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788746667.895982:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788746667.896017:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788746667.896048:0:17058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636305144832 00000100:00100000:3.0:1788746667.896068:0:17058:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636305144832 00000100:00100000:3.0:1788746667.896178:0:17058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636305144704 00000100:00100000:3.0:1788746667.896182:0:17058:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636305144704 00000100:00100000:3.0:1788746667.896199:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 76 00000100:00100000:3.0:1788746667.896208:0:17058:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a45b7f82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:583130b9-0019-4af8-9623-d64634ab82f4+5:2402:x1875636305144832:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:0.0:1788746667.896687:0:18566:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636305144960 00000100:00100000:0.0:1788746667.896693:0:18566:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636305144960 00000100:00100000:0.0:1788746667.896737:0:18566:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 31 00000100:00100000:0.0:1788746667.896760:0:18566:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a45b7f82680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:583130b9-0019-4af8-9623-d64634ab82f4+5:2398:x1875636305144960:12345-192.168.204.39@tcp:9:kworker.0 00000020:00000080:0.0:1788746667.896782:0:18566:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xfac36e891541419c 00000100:00080000:0.0:1788746667.896798:0:18566:0:(import.c:65:import_set_state_nolock()) ffff8a45bcb86800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788746667.896839:0:18566:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:0.0:1788746667.896993:0:18566:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a45b7f82680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:583130b9-0019-4af8-9623-d64634ab82f4+2:2398:x1875636305144960:12345-192.168.204.39@tcp:9:kworker.0 Request processed in 235us (1113us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746667.897000:0:18566:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 31 00000100:00080000:0.0:1788746667.897017:0:17054:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788746667.897297:0:17058:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a45b7f82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:583130b9-0019-4af8-9623-d64634ab82f4+5:2402:x1875636305144832:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 1075us (1299us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746667.897306:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 76 00000100:00100000:3.0:1788746667.897323:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 77 00000100:00100000:3.0:1788746667.897332:0:17058:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a45b7f83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:583130b9-0019-4af8-9623-d64634ab82f4+14:2402:x1875636305144704:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:3.0:1788746667.898532:0:17058:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a45b7f83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:583130b9-0019-4af8-9623-d64634ab82f4+14:2402:x1875636305144704:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 1195us (2507us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746667.898544:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 77 00000100:00100000:1.0:1788746667.898649:0:17053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636305144576 00000100:00100000:1.0:1788746667.898658:0:17053:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636305144576 00000100:00100000:1.0:1788746667.898713:0:17053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 170 00000100:00100000:1.0:1788746667.898721:0:17053:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a45bda51050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c7148cc-333b-4c22-b696-741a2115d97c+13:2402:x1875636305144576:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:1.0:1788746667.898773:0:17053:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a45bda51050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c7148cc-333b-4c22-b696-741a2115d97c+13:2402:x1875636305144576:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 53us (2830us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746667.898792:0:17053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 170 00010000:00010000:1.0:1788746667.898829:0:17046:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788746667.901530:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788746667.901618:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788746667.901716:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788746667.901743:0:19851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636305145216 00000100:00100000:0.0:1788746667.901751:0:19851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636305145216 00000100:00100000:0.0:1788746667.901804:0:19851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636305145344 00000100:00100000:0.0:1788746667.901808:0:19851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636305145344 00000100:00100000:0.0:1788746667.901831:0:19851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 78 00000100:00100000:0.0:1788746667.901840:0:19851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4483752d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f8c6d223-c0ac-460e-8131-df4be0cff05f+6:2402:x1875636305145216:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:0.0:1788746667.901908:0:19851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4483752d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f8c6d223-c0ac-460e-8131-df4be0cff05f+6:2402:x1875636305145216:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 70us (300us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746667.901916:0:19851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 78 00000100:00100000:0.0:1788746667.901933:0:19851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 79 00000100:00100000:0.0:1788746667.901940:0:19851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4483752680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f8c6d223-c0ac-460e-8131-df4be0cff05f+5:2401:x1875636305145344:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:0.0:1788746667.901963:0:19851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4483752680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f8c6d223-c0ac-460e-8131-df4be0cff05f+5:2401:x1875636305145344:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 25us (249us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746667.901969:0:19851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 79 00000100:00080000:0.0:1788746667.901984:0:17054:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788746667.902046:0:17054:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788746667.902913:0:19014:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636305145088 00000100:00100000:1.0:1788746667.902921:0:19014:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636305145088 00000100:00100000:1.0:1788746667.902977:0:19014:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 37 00000100:00100000:1.0:1788746667.902988:0:19014:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a45b7ef5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:583130b9-0019-4af8-9623-d64634ab82f4+5:2401:x1875636305145088:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:1.0:1788746667.903038:0:19014:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a45b7ef5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:583130b9-0019-4af8-9623-d64634ab82f4+5:2401:x1875636305145088:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 51us (1516us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746667.903048:0:19014:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 37 00000100:00080000:0.0:1788746667.903654:0:17054:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788746667.904632:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788746667.904937:0:18566:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636305145472 00000100:00100000:0.0:1788746667.904946:0:18566:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636305145472 00000100:00100000:0.0:1788746667.905087:0:18566:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 32 00000100:00100000:0.0:1788746667.905098:0:18566:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a45b7f81f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f8c6d223-c0ac-460e-8131-df4be0cff05f+5:2398:x1875636305145472:12345-192.168.204.39@tcp:9:kworker.0 00000020:00000080:0.0:1788746667.905133:0:18566:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xfac36e89154141db 00000100:00080000:0.0:1788746667.905142:0:18566:0:(import.c:65:import_set_state_nolock()) ffff8a45bd633800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788746667.905191:0:18566:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934594 00010000:00010000:1.0:1788746667.905533:0:17047:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788746667.905771:0:18566:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a45b7f81f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f8c6d223-c0ac-460e-8131-df4be0cff05f+2:2398:x1875636305145472:12345-192.168.204.39@tcp:9:kworker.0 Request processed in 674us (1143us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746667.905779:0:18566:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 32 00000100:00080000:2.0:1788746667.908953:0:17054:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788746667.918550:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788746667.918977:0:19014:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636305145600 00000100:00100000:1.0:1788746667.918988:0:19014:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636305145600 00000100:00100000:1.0:1788746667.919255:0:19014:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 33 00000100:00100000:1.0:1788746667.919273:0:19014:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a45b7ef3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f8c6d223-c0ac-460e-8131-df4be0cff05f+5:2398:x1875636305145600:12345-192.168.204.39@tcp:9:kworker.0 00000020:00000080:1.0:1788746667.919368:0:19014:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xfac36e89154141e2 00000100:00080000:1.0:1788746667.919388:0:19014:0:(import.c:65:import_set_state_nolock()) ffff8a45b49b7800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788746667.919443:0:19014:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934600 00000100:00100000:1.0:1788746667.919638:0:19014:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a45b7ef3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f8c6d223-c0ac-460e-8131-df4be0cff05f+2:2398:x1875636305145600:12345-192.168.204.39@tcp:9:kworker.0 Request processed in 367us (1099us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746667.919646:0:19014:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 33 00000100:00080000:2.0:1788746667.919718:0:17054:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1788746667.920381:0:17046:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788746668.441179:0:17047:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788746668.755102:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788746668.755124:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a45bcb6b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875636324097920:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788746668.755194:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746668.755355:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a45bcb6aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875636324098048:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788746668.755384:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746668.755501:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788746668.755509:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a4483753b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875636324098176:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788746668.755537:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788746668.759392:0:18569:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324097920 00000100:00100000:2.0:1788746668.759407:0:18569:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324097920 00000100:00100000:2.0:1788746668.759482:0:18569:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788746668.759501:0:18569:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a45bcb6a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875636324097920:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788746668.759528:0:18569:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788746668.759628:0:18569:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a45bcb6a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875636324097920:12345-0@lo:13:osp-pre-0-0.0 Request processed in 136us (4433us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746668.759635:0:18569:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788746668.759660:0:18090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324098048 00000100:00100000:2.0:1788746668.759664:0:18090:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324098048 00000100:00100000:2.0:1788746668.759690:0:18090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324098176 00000100:00100000:2.0:1788746668.759693:0:18090:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324098176 00000100:00100000:2.0:1788746668.759706:0:18090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788746668.759713:0:18090:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a45bcb69180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875636324098048:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788746668.759738:0:18090:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:2.0:1788746668.759789:0:18090:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a45bcb69180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875636324098048:12345-0@lo:41:osp-pre-0-1.0 Request processed in 77us (4405us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746668.759796:0:18090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788746668.759808:0:18090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788746668.759824:0:18090:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4483750a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875636324098176:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788746668.759840:0:18090:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788746668.759868:0:18090:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4483750a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875636324098176:12345-0@lo:41:osp-pre-1-0.0 Request processed in 46us (4330us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746668.759873:0:18090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788746668.759922:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a45bcb6b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875636324097920:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788746668.760135:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a4483753b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875636324098176:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788746668.760152:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a45bcb6aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875636324098048:0@lo:41:osp-pre-0-1.0 00000100:00080000:0.0:1788746668.763404:0:17054:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:02000400:3.0:1788746668.780899:0:20435:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1d: Test Project ID with remote access ========================================================== 22:04:27 (1788746667) 00010000:00010000:0.0:1788746669.458526:0:17046:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788746670.354453:0:17094:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788746670.354465:0:17094:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788746670.354487:0:17094:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1788746670.354510:0:17094:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:2.0:1788746670.482522:0:17047:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788746670.806129:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788746670.806153:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a4483751180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875636324098304:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788746670.806228:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746670.806701:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a4483751c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875636324098432:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788746670.806733:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746670.806889:0:18568:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324098304 00000100:00100000:1.0:1788746670.806897:0:18568:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324098304 00000100:00100000:1.0:1788746670.806955:0:18568:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324098432 00000100:00100000:1.0:1788746670.806958:0:18568:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324098432 00000100:00100000:1.0:1788746670.806978:0:18568:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788746670.806986:0:18568:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4483751500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875636324098304:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788746670.807018:0:18568:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 17886912 pending 0 free 3915849728 avail 3684327424 00000100:00100000:1.0:1788746670.807069:0:18568:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4483751500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875636324098304:12345-0@lo:13:osp-pre-1-1.0 Request processed in 83us (840us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746670.807076:0:18568:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788746670.807098:0:18568:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788746670.807104:0:18568:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4483753b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875636324098432:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788746670.807113:0:18568:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 17886912 pending 0 free 3915849728 avail 3684327424 00000100:00100000:1.0:1788746670.807135:0:18568:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4483753b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875636324098432:12345-0@lo:13:osp-pre-1-0.0 Request processed in 32us (402us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746670.807141:0:18568:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788746670.807505:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a45bcb6bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875636324098688:0@lo:400:kworker.0 00000100:00100000:1.0:1788746670.807561:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788746670.807917:0:17054:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788746670.808142:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a45bcb6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875636324099200:0@lo:400:kworker.0 00000100:00100000:1.0:1788746670.808245:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746670.808268:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a4484469880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3644:1875636324099712:0@lo:400:kworker.0 00000100:00100000:1.0:1788746670.808319:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746670.808343:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1788746670.808350:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a45bcb6b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7bf60f24-4000-471c-bcb3-0ae64e0e499e:3644:1875636324098560:0@lo:400:kworker.0 00000100:00100000:1.0:1788746670.808381:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746670.808405:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a45bcb68a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875636324099072:0@lo:400:kworker.0 00000100:00100000:1.0:1788746670.808444:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746670.808463:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a45bcb6b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3644:1875636324099584:0@lo:400:kworker.0 00000100:00100000:1.0:1788746670.808483:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746670.808514:0:18566:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324099200 00000100:00100000:1.0:1788746670.808521:0:18566:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324099200 00000100:00100000:1.0:1788746670.809941:0:18566:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788746670.809952:0:18566:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a45b7f04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875636324099200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788746670.810029:0:18566:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a45b7f04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875636324099200:12345-0@lo:400:kworker.0 Request processed in 79us (1783us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746670.810035:0:18566:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788746670.810060:0:19851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324099712 00000100:00100000:1.0:1788746670.810067:0:19851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324099712 00000100:00100000:1.0:1788746670.810095:0:19851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324099584 00000100:00100000:1.0:1788746670.810098:0:19851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324099584 00000100:00100000:1.0:1788746670.810125:0:19851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788746670.810131:0:19851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a45b7f04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875636324099712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788746670.810447:0:19851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a45b7f04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875636324099712:12345-0@lo:400:kworker.0 Request processed in 315us (2125us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746670.810453:0:19851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788746670.810466:0:19851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788746670.810472:0:19851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a45b7f06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875636324099584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788746670.810503:0:19851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a45b7f06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875636324099584:12345-0@lo:400:kworker.0 Request processed in 31us (2019us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746670.810508:0:19851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788746670.810836:0:17063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324098688 00000100:00100000:1.0:1788746670.810841:0:17063:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324098688 00000100:00100000:1.0:1788746670.810911:0:17063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324099072 00000100:00100000:1.0:1788746670.810926:0:17063:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324099072 00000100:00100000:3.0:1788746670.812390:0:17051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324098560 00000100:00100000:3.0:1788746670.812404:0:17051:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324098560 00000100:00100000:3.0:1788746670.812459:0:17051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1788746670.812468:0:17051:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a45bda53050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7bf60f24-4000-471c-bcb3-0ae64e0e499e+24:3644:x1875636324098560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788746670.812566:0:17051:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a45bda53050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7bf60f24-4000-471c-bcb3-0ae64e0e499e+24:3644:x1875636324098560:12345-0@lo:400:kworker.0 Request processed in 86us (4171us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746670.812574:0:17051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1788746670.813056:0:17064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788746670.813068:0:17064:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a45b7f07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875636324098688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788746670.813114:0:17064:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a45b7f07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875636324098688:12345-0@lo:400:kworker.0 Request processed in 49us (5563us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746670.813129:0:17064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788746670.813149:0:17064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788746670.813156:0:17064:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a45b7f07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875636324099072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788746670.813301:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a45bcb68700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875636324098816:0@lo:400:kworker.0 00000100:00100000:1.0:1788746670.813341:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746670.813371:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a45bcb6ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875636324099328:0@lo:400:kworker.0 00000100:00100000:1.0:1788746670.813395:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746670.813413:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a45b7f04700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3645:1875636324099840:0@lo:400:kworker.0 00000100:00100000:1.0:1788746670.813433:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746670.813454:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788746670.813461:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a45bcb6a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875636324098944:0@lo:400:kworker.0 00000100:00100000:1.0:1788746670.813483:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746670.813499:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a45bcb6aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3645:1875636324099456:0@lo:400:kworker.0 00000100:00100000:1.0:1788746670.813519:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746670.813569:0:18567:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324098816 00000100:00100000:1.0:1788746670.813583:0:18567:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324098816 00000100:00100000:1.0:1788746670.813627:0:18567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788746670.813634:0:18567:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a45b7f06a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1875636324098816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788746670.813673:0:18567:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a45b7f06a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1875636324098816:12345-0@lo:400:kworker.0 Request processed in 39us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746670.813679:0:18567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788746670.813697:0:17059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324099328 00000100:00100000:1.0:1788746670.813700:0:17059:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324099328 00000100:00100000:1.0:1788746670.813718:0:17059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324099840 00000100:00100000:1.0:1788746670.813721:0:17059:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324099840 00000100:00100000:1.0:1788746670.813735:0:17059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324098944 00000100:00100000:1.0:1788746670.813738:0:17059:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324098944 00000100:00100000:1.0:1788746670.813748:0:17059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324099456 00000100:00100000:1.0:1788746670.813750:0:17059:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324099456 00000100:00100000:1.0:1788746670.813765:0:17059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788746670.813955:0:17059:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a45b7f05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875636324099328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788746670.813988:0:17059:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a45b7f05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875636324099328:12345-0@lo:400:kworker.0 Request processed in 36us (593us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746670.813994:0:17059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788746670.814009:0:17059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1788746670.814015:0:17059:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a45b7f05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875636324099840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788746670.814041:0:17059:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a45b7f05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875636324099840:12345-0@lo:400:kworker.0 Request processed in 27us (607us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746670.814046:0:17059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1788746670.814058:0:17059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1788746670.814063:0:17059:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a45b7f06680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875636324098944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788746670.814086:0:17059:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a45b7f06680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875636324098944:12345-0@lo:400:kworker.0 Request processed in 24us (603us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746670.814091:0:17059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1788746670.814102:0:17059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788746670.814107:0:17059:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a45b7f07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875636324099456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788746670.814128:0:17059:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a45b7f07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875636324099456:12345-0@lo:400:kworker.0 Request processed in 22us (608us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746670.814134:0:17059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788746670.814189:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a45bcb6a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875636324098944:0@lo:400:kworker.0 00000100:00100000:1.0:1788746670.814199:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a45bcb6aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3645:1875636324099456:0@lo:400:kworker.0 00000100:00100000:1.0:1788746670.814208:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a45bcb68700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875636324098816:0@lo:400:kworker.0 00000100:00100000:1.0:1788746670.814215:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a45bcb6ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875636324099328:0@lo:400:kworker.0 00010000:00080000:1.0:1788746670.814237:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a45b7f04700 x1875636324099840/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788746686 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788746670.814247:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a45b7f04700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3645:1875636324099840:0@lo:400:kworker.0 00000100:00080000:1.0:1788746670.814276:0:17054:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788746670.814281:0:17054:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788746670.814284:0:17054:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788746670.814414:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a4483751c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875636324098432:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788746670.814430:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a4483751180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875636324098304:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788746670.814463:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a45bcb6b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7bf60f24-4000-471c-bcb3-0ae64e0e499e:3644:1875636324098560:0@lo:400:kworker.0 00010000:00080000:1.0:1788746670.814476:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a45bcb6b800 x1875636324099584/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788746686 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788746670.814484:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a45bcb6b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3644:1875636324099584:0@lo:400:kworker.0 00000100:00100000:1.0:1788746670.814495:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a45bcb6bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875636324098688:0@lo:400:kworker.0 00000100:00100000:1.0:1788746670.814504:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a45bcb6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875636324099200:0@lo:400:kworker.0 00000100:00100000:1.0:1788746670.814514:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a4484469880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3644:1875636324099712:0@lo:400:kworker.0 00000100:00100000:0.0:1788746670.814883:0:17064:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a45b7f07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875636324099072:12345-0@lo:400:kworker.0 Request processed in 1727us (6437us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746670.814891:0:17064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788746670.815707:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a45bcb68a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875636324099072:0@lo:400:kworker.0 00000100:00100000:1.0:1788746670.945713:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788746670.946454:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788746670.946478:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788746670.951511:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788746670.951628:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788746670.953841:0:17059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636305145856 00000100:00100000:3.0:1788746670.953856:0:17059:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636305145856 00000100:00100000:3.0:1788746670.953938:0:17059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636305146368 00000100:00100000:3.0:1788746670.953941:0:17059:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636305146368 00000100:00100000:3.0:1788746670.953968:0:17059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 86 00000100:00100000:3.0:1788746670.953978:0:17059:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a45b7f04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:583130b9-0019-4af8-9623-d64634ab82f4+14:2401:x1875636305145856:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:3.0:1788746670.954059:0:17059:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a45b7f04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:583130b9-0019-4af8-9623-d64634ab82f4+14:2401:x1875636305145856:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 82us (8356us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746670.954067:0:17059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 86 00000100:00100000:3.0:1788746670.954083:0:17059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 87 00000100:00100000:3.0:1788746670.954089:0:17059:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a45b7f07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f8c6d223-c0ac-460e-8131-df4be0cff05f+5:2401:x1875636305146368:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:3.0:1788746670.954111:0:17059:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a45b7f07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f8c6d223-c0ac-460e-8131-df4be0cff05f+5:2401:x1875636305146368:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 23us (7632us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746670.954117:0:17059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 87 00000100:00100000:1.0:1788746670.955986:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788746670.956265:0:18566:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636305146112 00000100:00100000:1.0:1788746670.956275:0:18566:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636305146112 00000100:00100000:1.0:1788746670.956854:0:18566:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 40 00000100:00100000:1.0:1788746670.956865:0:18566:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a45b7f06300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:583130b9-0019-4af8-9623-d64634ab82f4+5:2401:x1875636305146112:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:1.0:1788746670.956936:0:18566:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a45b7f06300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:583130b9-0019-4af8-9623-d64634ab82f4+5:2401:x1875636305146112:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 73us (10485us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746670.956943:0:18566:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 40 00000100:00100000:1.0:1788746670.956970:0:17052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636305145728 00000100:00100000:1.0:1788746670.956975:0:17052:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636305145728 00000100:00100000:1.0:1788746670.957004:0:17052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 172 00000100:00100000:1.0:1788746670.957011:0:17052:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a45bda50050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c7148cc-333b-4c22-b696-741a2115d97c+13:2401:x1875636305145728:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:1.0:1788746670.957037:0:17052:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a45bda50050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c7148cc-333b-4c22-b696-741a2115d97c+13:2401:x1875636305145728:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 26us (5535us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746670.957043:0:17052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 172 00000100:00080000:1.0:1788746670.957071:0:17054:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788746670.957076:0:17054:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788746670.957079:0:17054:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788746670.957779:0:17058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636305145984 00000100:00100000:0.0:1788746670.957787:0:17058:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636305145984 00000100:00100000:0.0:1788746670.957839:0:17058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636305146240 00000100:00100000:0.0:1788746670.957843:0:17058:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636305146240 00000100:00100000:0.0:1788746670.957863:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 88 00000100:00100000:0.0:1788746670.957872:0:17058:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a45b7f05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:583130b9-0019-4af8-9623-d64634ab82f4+5:2401:x1875636305145984:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:0.0:1788746670.957929:0:17058:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a45b7f05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:583130b9-0019-4af8-9623-d64634ab82f4+5:2401:x1875636305145984:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 58us (6301us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746670.957936:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 88 00000100:00100000:0.0:1788746670.957953:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 89 00000100:00100000:0.0:1788746670.957961:0:17058:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a45b7f05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f8c6d223-c0ac-460e-8131-df4be0cff05f+6:2401:x1875636305146240:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:0.0:1788746670.957987:0:17058:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a45b7f05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f8c6d223-c0ac-460e-8131-df4be0cff05f+6:2401:x1875636305146240:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 28us (2009us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746670.957993:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 89 00000100:00080000:0.0:1788746670.958013:0:17054:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788746670.958016:0:17054:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000001:00080000:1.0:1788746671.323500:0:17038:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934623 is committed 00000020:00080000:1.0:1788746671.323518:0:17038:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4294967529 batchid updated 00000020:00080000:2.0:1788746671.323641:0:17098:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967529 00000020:00080000:2.0:1788746671.323654:0:17098:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967529 00010000:00010000:0.0:1788746671.507306:0:17046:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788746671.969503:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788746671.969568:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788746671.969641:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788746671.969701:0:17053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636305146496 00000100:00100000:2.0:1788746671.969711:0:17053:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636305146496 00000100:00100000:2.0:1788746671.969778:0:17053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 173 00000100:00100000:2.0:1788746671.969789:0:17053:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a45bda50850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c7148cc-333b-4c22-b696-741a2115d97c+13:2402:x1875636305146496:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:2.0:1788746671.969864:0:17053:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a45bda50850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c7148cc-333b-4c22-b696-741a2115d97c+13:2402:x1875636305146496:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 77us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746671.969872:0:17053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 173 00000100:00100000:1.0:1788746671.973135:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788746671.976817:0:17058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636305146752 00000100:00100000:0.0:1788746671.976833:0:17058:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636305146752 00000100:00100000:0.0:1788746671.976910:0:17058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636305147008 00000100:00100000:0.0:1788746671.976926:0:17058:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636305147008 00000100:00100000:0.0:1788746671.976962:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 90 00000100:00100000:0.0:1788746671.976973:0:17058:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a45b7f04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:583130b9-0019-4af8-9623-d64634ab82f4+5:2402:x1875636305146752:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:2.0:1788746671.977222:0:17060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 91 00000100:00100000:2.0:1788746671.977239:0:17060:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a45b7f04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f8c6d223-c0ac-460e-8131-df4be0cff05f+6:2402:x1875636305147008:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:2.0:1788746671.977318:0:17060:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a45b7f04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f8c6d223-c0ac-460e-8131-df4be0cff05f+6:2402:x1875636305147008:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 87us (7676us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746671.977325:0:17060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 91 00000100:00100000:0.0:1788746671.977807:0:17058:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a45b7f04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:583130b9-0019-4af8-9623-d64634ab82f4+5:2402:x1875636305146752:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 833us (8236us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746671.977816:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 90 00000100:00100000:1.0:1788746671.979961:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788746671.980005:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788746671.980318:0:18567:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636305146880 00000100:00100000:0.0:1788746671.980328:0:18567:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636305146880 00000100:00100000:0.0:1788746671.980382:0:18567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 41 00000100:00100000:0.0:1788746671.980393:0:18567:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4484469880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:583130b9-0019-4af8-9623-d64634ab82f4+5:2402:x1875636305146880:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:0.0:1788746671.980463:0:18567:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4484469880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:583130b9-0019-4af8-9623-d64634ab82f4+5:2402:x1875636305146880:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 73us (511us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746671.980471:0:18567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 41 00000100:00100000:1.0:1788746671.981254:0:17059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636305146624 00000100:00100000:1.0:1788746671.981264:0:17059:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636305146624 00000100:00100000:1.0:1788746671.981324:0:17059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636305147136 00000100:00100000:1.0:1788746671.981327:0:17059:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636305147136 00000100:00100000:1.0:1788746671.981345:0:17059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 92 00000100:00100000:1.0:1788746671.981353:0:17059:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a45b7f05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:583130b9-0019-4af8-9623-d64634ab82f4+13:2402:x1875636305146624:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:1.0:1788746671.981407:0:17059:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a45b7f05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:583130b9-0019-4af8-9623-d64634ab82f4+13:2402:x1875636305146624:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 54us (8282us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746671.981414:0:17059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 92 00000100:00100000:1.0:1788746671.981429:0:17059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 93 00000100:00100000:1.0:1788746671.981435:0:17059:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a45bcb68a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f8c6d223-c0ac-460e-8131-df4be0cff05f+5:2402:x1875636305147136:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:1.0:1788746671.981457:0:17059:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a45bcb68a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f8c6d223-c0ac-460e-8131-df4be0cff05f+5:2402:x1875636305147136:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 22us (1453us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746671.981462:0:17059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 93 00010000:00010000:2.0:1788746672.531018:0:17047:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788746672.850653:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a45b7ef0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875636324099968:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788746672.850738:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788746672.850850:0:18568:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324099968 00000100:00100000:2.0:1788746672.850860:0:18568:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324099968 00000100:00100000:2.0:1788746672.850935:0:18568:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788746672.850952:0:18568:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a45bcb6b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875636324099968:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788746672.850984:0:18568:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788746672.851039:0:18568:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a45bcb6b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875636324099968:12345-0@lo:13:osp-pre-0-1.0 Request processed in 95us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746672.851046:0:18568:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788746672.851217:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a45b7ef0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875636324099968:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1788746672.851950:0:17054:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788746672.920893:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788746672.921045:0:17062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636305147392 00000100:00100000:0.0:1788746672.921054:0:17062:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636305147392 00000100:00100000:0.0:1788746672.921253:0:17062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 13 00000100:00100000:0.0:1788746672.921274:0:17062:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a45b7ef0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:583130b9-0019-4af8-9623-d64634ab82f4+13:16306:x1875636305147392:12345-192.168.204.39@tcp:35:umount.0 00000001:00080000:0.0:1788746672.921560:0:17062:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934624 00000001:00080000:0.0:1788746672.921639:0:17062:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934625 00000100:00100000:0.0:1788746672.922145:0:17062:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a45b7ef0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:583130b9-0019-4af8-9623-d64634ab82f4+16:16306:x1875636305147392:12345-192.168.204.39@tcp:35:umount.0 Request processed in 872us (1260us total) trans 8589934626 rc 0/0 00000100:00100000:0.0:1788746672.922155:0:17062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 13 00000020:00080000:0.0:1788746672.922161:0:17062:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00080000:1.0:1788746672.923865:0:17054:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788746672.936088:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788746672.936180:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788746672.937157:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788746672.937249:0:17044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636305147520 00000100:00100000:3.0:1788746672.937268:0:17044:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636305147520 00000100:00100000:3.0:1788746672.937425:0:17044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636305147776 00000100:00100000:3.0:1788746672.937429:0:17044:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636305147776 00000100:00100000:3.0:1788746672.937460:0:17044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 3 00000100:00100000:3.0:1788746672.937480:0:17044:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a45bcb6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1c7148cc-333b-4c22-b696-741a2115d97c+14:2400:x1875636305147520:12345-192.168.204.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788746672.937497:0:17044:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788746672.937527:0:17044:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a4580030000/0xfac36e8915414179 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801000000000 nid: 192.168.204.39@tcp remote: 0x4d2179c47f078654 expref: 14 pid: 17053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746672.937546:0:17044:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788746672.937595:0:17044:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a45bcb6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1c7148cc-333b-4c22-b696-741a2115d97c+13:2400:x1875636305147520:12345-192.168.204.39@tcp:103:ldlm_bl.0 Request processed in 117us (1517us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746672.937602:0:17044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 3 00000100:00100000:3.0:1788746672.937618:0:17044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 4 00000100:00100000:3.0:1788746672.937625:0:17044:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a45bd83dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1c7148cc-333b-4c22-b696-741a2115d97c+12:2400:x1875636305147776:12345-192.168.204.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788746672.937634:0:17044:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788746672.937642:0:17044:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a4483ed7a00/0xfac36e8915414236 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.204.39@tcp remote: 0x4d2179c47f07873b expref: 12 pid: 17053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746672.937651:0:17044:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788746672.937667:0:17044:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a45bd83dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1c7148cc-333b-4c22-b696-741a2115d97c+11:2400:x1875636305147776:12345-192.168.204.39@tcp:103:ldlm_bl.0 Request processed in 43us (1487us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746672.937673:0:17044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 4 00000100:00100000:2.0:1788746672.938964:0:17045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636305147648 00000100:00100000:2.0:1788746672.938976:0:17045:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636305147648 00000100:00100000:2.0:1788746672.939268:0:17045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 5 00000100:00100000:2.0:1788746672.939279:0:17045:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a45bcb6b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1c7148cc-333b-4c22-b696-741a2115d97c+11:2400:x1875636305147648:12345-192.168.204.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788746672.939352:0:17045:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788746672.939370:0:17045:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a4483ed7400/0xfac36e8915414180 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.204.39@tcp remote: 0x4d2179c47f078685 expref: 11 pid: 17051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746672.939387:0:17045:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788746672.939485:0:17045:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a45bcb6b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1c7148cc-333b-4c22-b696-741a2115d97c+10:2400:x1875636305147648:12345-192.168.204.39@tcp:103:ldlm_bl.0 Request processed in 209us (2332us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746672.939492:0:17045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 5 00000100:00100000:3.0:1788746672.945803:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788746672.945958:0:18566:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636305147904 00000100:00100000:1.0:1788746672.945969:0:18566:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636305147904 00000100:00100000:1.0:1788746672.946047:0:18566:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 34 00000100:00100000:1.0:1788746672.946057:0:18566:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a45b7f80000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:583130b9-0019-4af8-9623-d64634ab82f4+5:2398:x1875636305147904:12345-192.168.204.39@tcp:9:umount.0 00000020:00000080:1.0:1788746672.946102:0:18566:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xfac36e89154141a3 00000100:00080000:1.0:1788746672.946111:0:18566:0:(import.c:65:import_set_state_nolock()) ffff8a45bd7b8800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788746672.946189:0:18566:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934600 00000100:00100000:1.0:1788746672.946379:0:18566:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a45b7f80000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:583130b9-0019-4af8-9623-d64634ab82f4+2:2398:x1875636305147904:12345-192.168.204.39@tcp:9:umount.0 Request processed in 322us (585us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746672.946388:0:18566:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 34 00010000:00010000:3.0:1788746672.946882:0:17046:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788746672.947240:0:17054:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00100000:1.0:1788746672.948892:0:19379:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 583130b9-0019-4af8-9623-d64634ab82f4 00000020:00000080:1.0:1788746672.948901:0:19379:0:(genops.c:885:class_export_put()) final put ffff8a45bcb85800/583130b9-0019-4af8-9623-d64634ab82f4 00000001:00100000:1.0:1788746672.948929:0:19379:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of f8c6d223-c0ac-460e-8131-df4be0cff05f 00000020:00000080:1.0:1788746672.948932:0:19379:0:(genops.c:885:class_export_put()) final put ffff8a45b49b6000/f8c6d223-c0ac-460e-8131-df4be0cff05f 00000020:00000080:2.0:1788746672.949058:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a45bcb85800/583130b9-0019-4af8-9623-d64634ab82f4 for lustre-OST0001 00000020:00000080:2.0:1788746672.949227:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a45b49b6000/f8c6d223-c0ac-460e-8131-df4be0cff05f for lustre-OST0001 00000020:00000080:2.0:1788746672.953319:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8a45bd7b8800 for lustre-OST0001 00000020:00000080:2.0:1788746672.953338:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8a45b49b7800 for lustre-OST0001 00000100:00100000:1.0:1788746672.965407:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788746672.965606:0:17059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636305148800 00000100:00100000:2.0:1788746672.965619:0:17059:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636305148800 00000100:00100000:2.0:1788746672.965705:0:17059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 67 00000100:00100000:2.0:1788746672.965738:0:17059:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a45bcb6b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:583130b9-0019-4af8-9623-d64634ab82f4+16:2398:x1875636305148800:12345-192.168.204.39@tcp:39:umount.0 00000020:00000080:2.0:1788746672.965778:0:17059:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xfac36e891541418e 00000020:00010000:2.0:1788746672.965798:0:17059:0:(genops.c:1920:obd_stale_export_put()) Put export ffff8a44831ee800: total 0 00000100:00080000:2.0:1788746672.965803:0:17059:0:(import.c:65:import_set_state_nolock()) ffff8a44831ed800 : changing import state from FULL to CLOSED 00000020:00010000:0.0:1788746672.965920:0:17047:0:(genops.c:1906:obd_stale_export_get()) Get export ffff8a44831ee800: total 0 00010000:00010000:0.0:1788746672.965925:0:17047:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788746672.966004:0:17047:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8a44831ee800, canceled 0 locks, left on hash table 8. 00010000:00010000:0.0:1788746672.966041:0:17047:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8a45b59ca800) 00010000:00010000:0.0:1788746672.966045:0:17047:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788746672.966056:0:17047:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a45ae45f600/0xfac36e8915414259 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.39@tcp remote: 0x4d2179c47f078742 expref: 15 pid: 17059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746672.966097:0:17047:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8a4582b5a200) 00010000:00010000:0.0:1788746672.966099:0:17047:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788746672.966104:0:17047:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a45c216d200/0xfac36e8915414339 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.39@tcp remote: 0x4d2179c47f078781 expref: 14 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746672.966123:0:17047:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8a4582b5af00) 00010000:00010000:0.0:1788746672.966125:0:17047:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788746672.966129:0:17047:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a4581526600/0xfac36e89154143e8 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.39@tcp remote: 0x4d2179c47f0787c0 expref: 13 pid: 17059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746672.966158:0:17047:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8a4582b5af00) 00010000:00010000:0.0:1788746672.966161:0:17047:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788746672.966165:0:17047:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a45c216c400/0xfac36e89154144a5 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.39@tcp remote: 0x4d2179c47f0787f8 expref: 12 pid: 17059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746672.966179:0:17047:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8a4483583000) 00010000:00010000:0.0:1788746672.966182:0:17047:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788746672.966186:0:17047:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a4581688200/0xfac36e8915414275 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.39@tcp remote: 0x4d2179c47f078749 expref: 11 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746672.966204:0:17047:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8a4582b5af00) 00010000:00010000:0.0:1788746672.966207:0:17047:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788746672.966217:0:17047:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a4581689600/0xfac36e89154143b7 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.39@tcp remote: 0x4d2179c47f0787ab expref: 10 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746672.966235:0:17047:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a4483586700) 00010000:00010000:0.0:1788746672.966237:0:17047:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788746672.966240:0:17047:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a4483ed7000/0xfac36e89154142b4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.39@tcp remote: 0x4d2179c47f078757 expref: 9 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746672.966252:0:17047:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8a4483583c00) 00010000:00010000:0.0:1788746672.966254:0:17047:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788746672.966257:0:17047:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a4581689200/0xfac36e8915414443 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.39@tcp remote: 0x4d2179c47f0787d5 expref: 8 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746672.966270:0:17047:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8a44831ee800, canceled 8 locks, left on hash table 0. 00010000:00010000:0.0:1788746672.966283:0:17047:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788746672.966331:0:17047:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788746672.966333:0:17047:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:2.0:1788746672.966616:0:17059:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934626 00000100:00100000:2.0:1788746672.966899:0:17059:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a45bcb6b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:583130b9-0019-4af8-9623-d64634ab82f4+6:2398:x1875636305148800:12345-192.168.204.39@tcp:39:umount.0 Request processed in 1170us (1503us total) trans 8589934627 rc 0/0 00000100:00100000:2.0:1788746672.966907:0:17059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 67 00000100:00100000:1.0:1788746672.981875:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788746672.985527:0:19851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636305148928 00000100:00100000:3.0:1788746672.985542:0:19851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636305148928 00000100:00100000:3.0:1788746672.985635:0:19851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 68 00000100:00100000:3.0:1788746672.985650:0:19851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a45bcb6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:583130b9-0019-4af8-9623-d64634ab82f4+5:2398:x1875636305148928:12345-192.168.204.39@tcp:39:umount.0 00000020:00000080:3.0:1788746672.985684:0:19851:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xfac36e8915414195 00000100:00080000:3.0:1788746672.985721:0:19851:0:(import.c:65:import_set_state_nolock()) ffff8a45b4a4a000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788746672.985804:0:19851:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:0.0:1788746672.985887:0:17054:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788746672.986054:0:19851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a45bcb6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:583130b9-0019-4af8-9623-d64634ab82f4+3:2398:x1875636305148928:12345-192.168.204.39@tcp:39:umount.0 Request processed in 408us (4186us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1788746672.986062:0:19851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 68 00010000:00010000:2.0:1788746672.986278:0:17046:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788746672.994978:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788746672.995023:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788746672.995318:0:17059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636305149056 00000100:00100000:1.0:1788746672.995328:0:17059:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636305149056 00000100:00100000:1.0:1788746672.995406:0:17059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636305149184 00000100:00100000:1.0:1788746672.995410:0:17059:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636305149184 00000100:00100000:1.0:1788746672.995437:0:17059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 94 00000100:00080000:0.0:1788746672.995520:0:17054:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788746672.995525:0:17054:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788746672.995579:0:17059:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a45b7f82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f8c6d223-c0ac-460e-8131-df4be0cff05f+6:2399:x1875636305149056:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:3.0:1788746672.995636:0:19851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 95 00000100:00100000:3.0:1788746672.995647:0:19851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a45b7f81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f8c6d223-c0ac-460e-8131-df4be0cff05f+5:2399:x1875636305149184:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:1.0:1788746672.995685:0:17059:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a45b7f82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f8c6d223-c0ac-460e-8131-df4be0cff05f+6:2399:x1875636305149056:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 111us (715us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746672.995692:0:17059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 94 00000100:00100000:3.0:1788746672.997831:0:19851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a45b7f81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f8c6d223-c0ac-460e-8131-df4be0cff05f+5:2399:x1875636305149184:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 2175us (2795us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746672.997845:0:19851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 95 00000001:00100000:2.0:1788746673.372052:0:18561:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of f8c6d223-c0ac-460e-8131-df4be0cff05f 00000020:00000080:2.0:1788746673.372064:0:18561:0:(genops.c:885:class_export_put()) final put ffff8a45bd635800/f8c6d223-c0ac-460e-8131-df4be0cff05f 00000001:00100000:2.0:1788746673.372093:0:18561:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 583130b9-0019-4af8-9623-d64634ab82f4 00000020:00000080:2.0:1788746673.372096:0:18561:0:(genops.c:885:class_export_put()) final put ffff8a45bcb81000/583130b9-0019-4af8-9623-d64634ab82f4 00000020:00000080:1.0:1788746673.372149:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a45bd635800/f8c6d223-c0ac-460e-8131-df4be0cff05f for lustre-OST0000 00000020:00000080:1.0:1788746673.372213:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a45bcb81000/583130b9-0019-4af8-9623-d64634ab82f4 for lustre-OST0000 00000020:00000080:1.0:1788746673.372230:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8a45bd633800 for lustre-OST0000 00000020:00000080:1.0:1788746673.372235:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8a45bcb86800 for lustre-OST0000 00000040:00080000:2.0:1788746673.554996:0:17816:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788746673.556642:0:17047:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788746673.874618:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a45b7ef3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875636324100096:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788746673.874708:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788746673.874793:0:18568:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324100096 00000100:00100000:2.0:1788746673.874801:0:18568:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324100096 00000100:00100000:2.0:1788746673.874865:0:18568:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788746673.874879:0:18568:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a45b7ef1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875636324100096:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788746673.874901:0:18568:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788746673.874944:0:18568:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a45b7ef1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875636324100096:12345-0@lo:13:osp-pre-0-0.0 Request processed in 71us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746673.874952:0:18568:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788746673.874996:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a45b7ef3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875636324100096:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788746673.876600:0:17054:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788746673.876611:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788746673.876628:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a4483751180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875636324100224:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788746673.876684:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746673.876772:0:17063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324100224 00000100:00100000:0.0:1788746673.876781:0:17063:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324100224 00000100:00100000:0.0:1788746673.876824:0:17063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788746673.876832:0:17063:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4483751c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1875636324100224:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788746673.876867:0:17063:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788746673.876924:0:17063:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4483751c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1875636324100224:12345-0@lo:41:osp-pre-1-0.0 Request processed in 92us (239us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746673.876931:0:17063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788746673.876983:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a4483751180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875636324100224:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788746673.878980:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a45bcb68700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875636324100352:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788746673.879059:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788746673.879253:0:18090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324100352 00000100:00100000:2.0:1788746673.879273:0:18090:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324100352 00000100:00100000:2.0:1788746673.879346:0:18090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788746673.879356:0:18090:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4482711f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1875636324100352:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788746673.879390:0:18090:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446293504 avail 1300054016 00000100:00100000:2.0:1788746673.882305:0:18090:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4482711f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1875636324100352:12345-0@lo:41:osp-pre-0-1.0 Request processed in 2931us (3225us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746673.882320:0:18090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788746673.882601:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a45bcb68700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875636324100352:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788746674.580904:0:17046:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788746674.914184:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788746674.914225:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788746674.914260:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788746674.914372:0:17043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636305149440 00000100:00100000:2.0:1788746674.914372:0:17045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636305149312 00000100:00100000:3.0:1788746674.914382:0:17043:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636305149440 00000100:00100000:2.0:1788746674.914382:0:17045:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636305149312 00000100:00100000:0.0:1788746674.914443:0:18212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636305149568 00000100:00100000:0.0:1788746674.914448:0:18212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636305149568 00000100:00100000:2.0:1788746674.914518:0:17045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 6 00000100:00100000:2.0:1788746674.914530:0:17045:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a45bcb6a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1c7148cc-333b-4c22-b696-741a2115d97c+12:2401:x1875636305149312:12345-192.168.204.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788746674.914547:0:17045:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788746674.914567:0:17045:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a45ae45ee00/0xfac36e89154141b8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.204.39@tcp remote: 0x4d2179c47f0786c4 expref: 12 pid: 17052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746674.914594:0:17045:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788746674.914648:0:17045:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a45bcb6a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1c7148cc-333b-4c22-b696-741a2115d97c+11:2401:x1875636305149312:12345-192.168.204.39@tcp:103:ldlm_bl.0 Request processed in 121us (423us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746674.914656:0:17045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 6 00000100:00100000:1.0:1788746674.918075:0:17044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 7 00000100:00100000:1.0:1788746674.918103:0:17044:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a45bcb6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1c7148cc-333b-4c22-b696-741a2115d97c+11:2401:x1875636305149440:12345-192.168.204.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788746674.918119:0:17044:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788746674.918139:0:17044:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a45ae45fe00/0xfac36e89154141bf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.204.39@tcp remote: 0x4d2179c47f0786f5 expref: 11 pid: 17052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746674.918155:0:17044:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788746674.918219:0:17044:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a45bcb6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1c7148cc-333b-4c22-b696-741a2115d97c+10:2401:x1875636305149440:12345-192.168.204.39@tcp:103:ldlm_bl.0 Request processed in 123us (4044us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746674.920458:0:17043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 8 00000100:00100000:3.0:1788746674.920491:0:17043:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a45bcb68700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1c7148cc-333b-4c22-b696-741a2115d97c+9:2401:x1875636305149568:12345-192.168.204.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788746674.920509:0:17043:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788746674.920530:0:17043:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a4483ed6800/0xfac36e891541421a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.204.39@tcp remote: 0x4d2179c47f078734 expref: 9 pid: 17051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746674.920546:0:17043:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788746674.920612:0:17043:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a45bcb68700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1c7148cc-333b-4c22-b696-741a2115d97c+8:2401:x1875636305149568:12345-192.168.204.39@tcp:103:ldlm_bl.0 Request processed in 143us (6351us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746674.920636:0:17043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 8 00000100:00100000:1.0:1788746674.925246:0:17044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 7 00000100:00100000:1.0:1788746674.925901:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788746674.927462:0:17059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636305149824 00000100:00100000:2.0:1788746674.927484:0:17059:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636305149824 00000100:00100000:2.0:1788746674.928904:0:17059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 69 00000100:00100000:2.0:1788746674.928932:0:17059:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a45bcb6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f8c6d223-c0ac-460e-8131-df4be0cff05f+6:2398:x1875636305149824:12345-192.168.204.39@tcp:39:umount.0 00000020:00000080:2.0:1788746674.928976:0:17059:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xfac36e89154141cd 00000020:00010000:2.0:1788746674.928986:0:17059:0:(genops.c:1920:obd_stale_export_put()) Put export ffff8a459fb0c000: total 0 00000100:00080000:2.0:1788746674.928991:0:17059:0:(import.c:65:import_set_state_nolock()) ffff8a4482502800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788746674.929020:0:17059:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934627 00000100:00100000:2.0:1788746674.929437:0:17059:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a45bcb6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f8c6d223-c0ac-460e-8131-df4be0cff05f+5:2398:x1875636305149824:12345-192.168.204.39@tcp:39:umount.0 Request processed in 519us (3537us total) trans 8589934628 rc 0/0 00000100:00100000:2.0:1788746674.929446:0:17059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 69 00000020:00010000:1.0:1788746674.930707:0:17047:0:(genops.c:1906:obd_stale_export_get()) Get export ffff8a459fb0c000: total 0 00010000:00010000:1.0:1788746674.930798:0:17047:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8a459fb0c000, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1788746674.930838:0:17047:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a4483586700) 00010000:00010000:1.0:1788746674.930842:0:17047:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788746674.930853:0:17047:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a45c216c000/0xfac36e89154142c2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.39@tcp remote: 0x4d2179c47f07875e expref: 4 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746674.930879:0:17047:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8a459fb0c000, canceled 1 locks, left on hash table 0. 00010000:00010000:1.0:1788746674.930890:0:17047:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788746674.930892:0:17047:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788746674.930894:0:17047:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788746674.933139:0:17054:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788746674.944925:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788746674.945133:0:17058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636305149952 00000100:00100000:1.0:1788746674.945143:0:17058:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636305149952 00000100:00100000:1.0:1788746674.945215:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 70 00000100:00100000:1.0:1788746674.945225:0:17058:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4483751180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f8c6d223-c0ac-460e-8131-df4be0cff05f+5:2398:x1875636305149952:12345-192.168.204.39@tcp:39:umount.0 00000020:00000080:1.0:1788746674.945268:0:17058:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xfac36e89154141d4 00000100:00080000:1.0:1788746674.945278:0:17058:0:(import.c:65:import_set_state_nolock()) ffff8a45b49b6800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788746674.945332:0:17058:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934593 00000100:00100000:1.0:1788746674.945502:0:17058:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4483751180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f8c6d223-c0ac-460e-8131-df4be0cff05f+3:2398:x1875636305149952:12345-192.168.204.39@tcp:39:umount.0 Request processed in 277us (587us total) trans 8589934594 rc 0/0 00000100:00100000:1.0:1788746674.945510:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 70 00010000:00010000:3.0:1788746674.945813:0:17046:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788746674.946033:0:17054:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788746674.989349:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788746674.989429:0:17051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636305150208 00000100:00100000:0.0:1788746674.989440:0:17051:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636305150208 00000100:00100000:0.0:1788746674.989508:0:17051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 174 00000100:00100000:0.0:1788746674.989519:0:17051:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a45bda50450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c7148cc-333b-4c22-b696-741a2115d97c+7:2398:x1875636305150208:12345-192.168.204.39@tcp:251:umount.0 00000020:00000080:0.0:1788746674.989568:0:17051:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xfac36e891541416b 00000020:00010000:0.0:1788746674.989576:0:17051:0:(genops.c:1920:obd_stale_export_put()) Put export ffff8a45b4a4a800: total 0 00000100:00080000:0.0:1788746674.989580:0:17051:0:(import.c:65:import_set_state_nolock()) ffff8a45b4a48000 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1788746674.989659:0:17051:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a45bda50450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c7148cc-333b-4c22-b696-741a2115d97c+3:2398:x1875636305150208:12345-192.168.204.39@tcp:251:umount.0 Request processed in 142us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746674.989667:0:17051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 174 00000020:00010000:1.0:1788746674.992464:0:17047:0:(genops.c:1906:obd_stale_export_get()) Get export ffff8a45b4a4a800: total 0 00010000:00010000:1.0:1788746674.992484:0:17047:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788746674.992551:0:17047:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8a45b4a4a800, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1788746674.992592:0:17047:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a4581688800/0xfac36e8915414172 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.204.39@tcp remote: 0x4d2179c47f07864d expref: 2 pid: 17051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746674.992613:0:17047:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8a45b4a4a800, canceled 1 locks, left on hash table 0. 00000020:00000080:1.0:1788746674.992624:0:17047:0:(genops.c:885:class_export_put()) final put ffff8a45b4a4a800/1c7148cc-333b-4c22-b696-741a2115d97c 00010000:00010000:1.0:1788746674.992643:0:17047:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788746674.992645:0:17047:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788746674.992647:0:17047:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788746674.992822:0:14946:0:(genops.c:844:class_export_destroy()) destroying export ffff8a45b4a4a800/1c7148cc-333b-4c22-b696-741a2115d97c for MGS 00000020:00000080:2.0:1788746674.992864:0:14946:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8a45b4a48000 for MGS 00010000:00010000:2.0:1788746675.605896:0:17046:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788746675.923181:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788746675.923216:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a4483591f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875636324100480:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788746675.923356:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746675.923616:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a448448b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875636324100736:0@lo:400:kworker.0 00000100:00100000:3.0:1788746675.923655:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746675.923682:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a4481b64e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875636324101248:0@lo:400:kworker.0 00000100:00100000:3.0:1788746675.923710:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746675.923728:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a4481b66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3644:1875636324101760:0@lo:400:kworker.0 00000100:00100000:3.0:1788746675.923756:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746675.923779:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1788746675.923785:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a4482713100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7bf60f24-4000-471c-bcb3-0ae64e0e499e:3644:1875636324100608:0@lo:400:kworker.0 00000100:00100000:3.0:1788746675.923819:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746675.923842:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a4481b66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875636324101120:0@lo:400:kworker.0 00000100:00100000:3.0:1788746675.923867:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746675.923883:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a4481b67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3644:1875636324101632:0@lo:400:kworker.0 00000100:00100000:3.0:1788746675.923903:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746675.923939:0:17060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324101760 00000100:00100000:3.0:1788746675.923951:0:17060:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324101760 00000100:00100000:3.0:1788746675.924030:0:17060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324101632 00000100:00100000:3.0:1788746675.924034:0:17060:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324101632 00000100:00100000:3.0:1788746675.924062:0:17060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1788746675.924075:0:17060:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4481b67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875636324101760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788746675.924223:0:18568:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324100480 00000100:00100000:2.0:1788746675.924229:0:18568:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324100480 00000100:00100000:2.0:1788746675.924265:0:18568:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788746675.924282:0:18568:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4482710700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875636324100480:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788746675.924353:0:18568:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915849728 avail 3684327424 00000100:00100000:2.0:1788746675.924412:0:18568:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4482710700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875636324100480:12345-0@lo:13:osp-pre-1-0.0 Request processed in 140us (1056us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746675.924420:0:18568:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788746675.924487:0:17059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1788746675.924496:0:17059:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a45bca90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875636324101632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788746675.924536:0:17059:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a45bca90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875636324101632:12345-0@lo:400:kworker.0 Request processed in 42us (632us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746675.924542:0:17059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1788746675.924565:0:17052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324100608 00000100:00100000:2.0:1788746675.924569:0:17052:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324100608 00000100:00100000:2.0:1788746675.924594:0:17052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1788746675.924600:0:17052:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a45bda52450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7bf60f24-4000-471c-bcb3-0ae64e0e499e+24:3644:x1875636324100608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788746675.924656:0:17052:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a45bda52450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7bf60f24-4000-471c-bcb3-0ae64e0e499e+24:3644:x1875636324100608:12345-0@lo:400:kworker.0 Request processed in 55us (835us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746675.924663:0:17052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1788746675.924709:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a448446bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875636324100864:0@lo:400:kworker.0 00000100:00100000:2.0:1788746675.924748:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788746675.924769:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a4481b64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875636324101376:0@lo:400:kworker.0 00000100:00100000:2.0:1788746675.924791:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788746675.924811:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a4481b65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3645:1875636324101888:0@lo:400:kworker.0 00000100:00100000:2.0:1788746675.924834:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788746675.924887:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a4483591f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875636324100480:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788746675.924912:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1788746675.924919:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a4481b64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875636324100992:0@lo:400:kworker.0 00000100:00100000:2.0:1788746675.924944:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788746675.924955:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a4481b65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875636324101504:0@lo:400:kworker.0 00000100:00100000:2.0:1788746675.924978:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788746675.924988:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a4481b67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3645:1875636324102016:0@lo:400:kworker.0 00000100:00100000:2.0:1788746675.925007:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788746675.925030:0:18566:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324101248 00000100:00100000:2.0:1788746675.925034:0:18566:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324101248 00000100:00100000:2.0:1788746675.925069:0:18566:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324100864 00000100:00100000:2.0:1788746675.925073:0:18566:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324100864 00000100:00100000:2.0:1788746675.925086:0:18566:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324101376 00000100:00100000:2.0:1788746675.925089:0:18566:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324101376 00000100:00100000:2.0:1788746675.925121:0:18566:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788746675.925132:0:18566:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4481b67480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875636324101248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788746675.925170:0:18566:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4481b67480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875636324101248:12345-0@lo:400:kworker.0 Request processed in 43us (1460us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746675.925177:0:18566:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788746675.925191:0:18566:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788746675.925198:0:18566:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a45b7ef3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1875636324100864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788746675.925240:0:18566:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a45b7ef3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1875636324100864:12345-0@lo:400:kworker.0 Request processed in 43us (492us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746675.925247:0:18566:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788746675.925258:0:18566:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788746675.925266:0:18566:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a45b7ef3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875636324101376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788746675.925322:0:18566:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a45b7ef3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875636324101376:12345-0@lo:400:kworker.0 Request processed in 57us (530us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746675.925328:0:18566:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788746675.925346:0:17059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324101888 00000100:00100000:2.0:1788746675.925349:0:17059:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324101888 00000100:00100000:2.0:1788746675.925365:0:17059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324100992 00000100:00100000:2.0:1788746675.925366:0:17059:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324100992 00000100:00100000:2.0:1788746675.925375:0:17059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324101504 00000100:00100000:2.0:1788746675.925376:0:17059:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324101504 00000100:00100000:2.0:1788746675.925385:0:17059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324102016 00000100:00100000:2.0:1788746675.925387:0:17059:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324102016 00000100:00100000:2.0:1788746675.925400:0:17059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1788746675.925406:0:17059:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a45b7ef2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1875636324101888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788746675.925432:0:17059:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a45b7ef2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1875636324101888:12345-0@lo:400:kworker.0 Request processed in 26us (597us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746675.925438:0:17059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1788746675.925448:0:17059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788746675.925467:0:17059:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a45b7ef1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875636324100992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788746675.925493:0:17059:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a45b7ef1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875636324100992:12345-0@lo:400:kworker.0 Request processed in 40us (548us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746675.925498:0:17059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788746675.925509:0:17059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788746675.925521:0:17059:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a45b7ef2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875636324101504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788746675.925545:0:17059:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a45b7ef2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875636324101504:12345-0@lo:400:kworker.0 Request processed in 26us (567us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746675.925551:0:17059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788746675.925560:0:17059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788746675.925566:0:17059:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a45b7ef3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875636324102016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788746675.925584:0:17059:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a45b7ef3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875636324102016:12345-0@lo:400:kworker.0 Request processed in 19us (577us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746675.925590:0:17059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788746675.925613:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a4481b64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875636324100992:0@lo:400:kworker.0 00000100:00100000:2.0:1788746675.925622:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a4481b65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875636324101504:0@lo:400:kworker.0 00010000:00080000:2.0:1788746675.925632:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a4481b67800 x1875636324102016/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788746691 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788746675.925642:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a4481b67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3645:1875636324102016:0@lo:400:kworker.0 00000100:00100000:2.0:1788746675.925651:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a448446bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875636324100864:0@lo:400:kworker.0 00000100:00100000:2.0:1788746675.925659:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a4481b64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875636324101376:0@lo:400:kworker.0 00000100:00100000:2.0:1788746675.925667:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a4481b65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3645:1875636324101888:0@lo:400:kworker.0 00000100:00100000:2.0:1788746675.925740:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a4482713100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7bf60f24-4000-471c-bcb3-0ae64e0e499e:3644:1875636324100608:0@lo:400:kworker.0 00000100:00100000:2.0:1788746675.925751:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a4481b67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3644:1875636324101632:0@lo:400:kworker.0 00000100:00100000:2.0:1788746675.925761:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a4481b64e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875636324101248:0@lo:400:kworker.0 00000100:00100000:0.0:1788746675.926735:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a45c0ea4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875636324102144:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788746675.926805:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746675.927175:0:17063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324100736 00000100:00100000:3.0:1788746675.927186:0:17063:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324100736 00000100:00100000:3.0:1788746675.927241:0:17063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324101120 00000100:00100000:3.0:1788746675.927245:0:17063:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324101120 00000100:00100000:3.0:1788746675.927263:0:17063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788746675.927271:0:17063:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4481b64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875636324100736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788746675.927371:0:17063:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4481b64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875636324100736:12345-0@lo:400:kworker.0 Request processed in 101us (3714us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746675.927379:0:17063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788746675.927395:0:17063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788746675.927402:0:17063:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a45bca90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875636324101120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788746675.927495:0:17063:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a45bca90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875636324101120:12345-0@lo:400:kworker.0 Request processed in 93us (3626us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746675.927502:0:17063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788746675.927551:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a4481b66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875636324101120:0@lo:400:kworker.0 00000100:00100000:3.0:1788746675.927564:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a448448b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875636324100736:0@lo:400:kworker.0 00000100:00080000:3.0:1788746675.927605:0:17054:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788746675.927611:0:17054:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788746675.927615:0:17054:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788746675.927618:0:17054:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788746675.927893:0:18568:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324102144 00000100:00100000:1.0:1788746675.927899:0:18568:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324102144 00000100:00100000:1.0:1788746675.927941:0:18568:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788746675.927949:0:18568:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a45c0ea6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875636324102144:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788746675.927969:0:18568:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915849728 avail 3684327424 00000100:00100000:1.0:1788746675.928011:0:18568:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a45c0ea6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875636324102144:12345-0@lo:13:osp-pre-1-1.0 Request processed in 64us (1207us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746675.928017:0:18568:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788746675.928150:0:17060:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4481b67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875636324101760:12345-0@lo:400:kworker.0 Request processed in 4078us (4391us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746675.928177:0:17060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00010000:00080000:3.0:1788746675.928556:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a4481b66a00 x1875636324101760/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788746691 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788746675.928571:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a4481b66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3644:1875636324101760:0@lo:400:kworker.0 00000100:00100000:0.0:1788746675.928666:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a45c0ea4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875636324102144:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1788746676.626417:0:17047:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788746676.945195:0:20630:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:2.0:1788746676.961040:0:20630:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:2.0:1788746676.961472:0:20630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.139@tcp lock: ffff8a45b7f94c00/0xfac36e8915413d2e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xfac36e8915413d35 expref: -99 pid: 17037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746676.961488:0:20630:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff8a45b7f94c00/0xfac36e8915413d2e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xfac36e8915413d35 expref: -99 pid: 17037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746676.961495:0:20630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff8a45b7f94c00/0xfac36e8915413d2e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xfac36e8915413d35 expref: -99 pid: 17037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746676.961502:0:20630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.139@tcp lock: ffff8a45b7f94c00/0xfac36e8915413d2e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xfac36e8915413d35 expref: -99 pid: 17037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746676.961529:0:20630:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788746676.961534:0:20630:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1788746676.961566:0:20630:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788746676.961571:0:20630:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1788746676.961578:0:20630:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788746676.961606:0:20630:0:(import.c:65:import_set_state_nolock()) ffff8a4482568800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:1.0:1788746676.961669:0:17046:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788746676.961677:0:17046:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.139@tcp lock: ffff8a45b7f94c00/0xfac36e8915413d2e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xfac36e8915413d35 expref: -99 pid: 17037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746676.961685:0:17046:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a45b7f94c00 already unused, calling callback (ffffffffc1180c20) 10000000:00010000:1.0:1788746676.961689:0:17046:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.139@tcp lock: ffff8a45b7f94c00/0xfac36e8915413d2e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xfac36e8915413d35 expref: -99 pid: 17037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746676.961711:0:17046:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.139@tcp lock: ffff8a45b7f94c00/0xfac36e8915413d2e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0xfac36e8915413d35 expref: -99 pid: 17037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788746676.961719:0:17046:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.139@tcp lock: ffff8a45b7f94c00/0xfac36e8915413d2e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0xfac36e8915413d35 expref: -99 pid: 17037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788746676.961724:0:17046:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788746676.961727:0:17046:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1788746676.961729:0:17046:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1788746676.961756:0:17046:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.139@tcp lock: ffff8a45b7f94c00/0xfac36e8915413d2e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xfac36e8915413d35 expref: -99 pid: 17037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746676.961762:0:17046:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1788746676.961768:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a45b7ef2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875636324102272:0@lo:39:umount.0 00010000:00010000:1.0:1788746676.961796:0:17046:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.139@tcp lock: ffff8a45b7f94c00/0xfac36e8915413d2e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xfac36e8915413d35 expref: -99 pid: 17037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746676.961804:0:17046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.139@tcp lock: ffff8a45b7f94c00/0xfac36e8915413d2e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xfac36e8915413d35 expref: -99 pid: 17037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746676.961816:0:17046:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788746676.961825:0:17046:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788746676.961826:0:17046:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788746676.961845:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746676.961917:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788746676.961927:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a4483590000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7bf60f24-4000-471c-bcb3-0ae64e0e499e:3643:1875636324102400:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788746676.961954:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746676.961997:0:18212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324102400 00000100:00100000:3.0:1788746676.962005:0:18212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324102400 00000100:00100000:3.0:1788746676.962066:0:18212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788746676.962078:0:17059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324102272 00000100:00100000:1.0:1788746676.962082:0:17059:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324102272 00000100:00100000:1.0:1788746676.962176:0:17059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788746676.962184:0:17059:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a45bca92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875636324102272:12345-0@lo:39:umount.0 00000020:00000080:1.0:1788746676.962211:0:17059:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xfac36e8915413d5f 00000100:00080000:1.0:1788746676.962230:0:17059:0:(import.c:65:import_set_state_nolock()) ffff8a459fa90000 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1788746676.962262:0:18212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a45bca90e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7bf60f24-4000-471c-bcb3-0ae64e0e499e+24:3643:x1875636324102400:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788746676.962275:0:18212:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788746676.962313:0:18212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a45b7f95800/0xfac36e8915413d35 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xfac36e8915413d2e expref: 24 pid: 17051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746676.962326:0:18212:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788746676.962364:0:18212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a45bca90e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7bf60f24-4000-471c-bcb3-0ae64e0e499e+23:3643:x1875636324102400:12345-0@lo:103:ldlm_bl.0 Request processed in 104us (409us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746676.962371:0:18212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788746676.962378:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a4483590000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7bf60f24-4000-471c-bcb3-0ae64e0e499e:3643:1875636324102400:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788746676.962401:0:17047:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788746676.964320:0:17059:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a45bca92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+1:3642:x1875636324102272:12345-0@lo:39:umount.0 Request processed in 2127us (2466us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746676.964333:0:17059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000020:00000080:3.0:1788746676.964348:0:17059:0:(genops.c:885:class_export_put()) final put ffff8a448256f800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:1.0:1788746676.964509:0:14946:0:(genops.c:844:class_export_destroy()) destroying export ffff8a448256f800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1788746676.964584:0:14946:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8a459fa90000 for lustre-MDT0000 00000100:00080000:0.0:1788746676.964984:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8a4482568800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1788746676.965038:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a45b7ef2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875636324102272:0@lo:39:umount.0 00000100:00080000:2.0:1788746676.965082:0:20630:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788746676.965149:0:20630:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788746676.965155:0:20630:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1788746676.968152:0:20630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.139@tcp lock: ffff8a44825c2600/0xfac36e8915413c7f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xfac36e8915413c86 expref: -99 pid: 17037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746676.968175:0:20630:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff8a44825c2600/0xfac36e8915413c7f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xfac36e8915413c86 expref: -99 pid: 17037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746676.968196:0:20630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff8a44825c2600/0xfac36e8915413c7f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xfac36e8915413c86 expref: -99 pid: 17037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746676.968202:0:20630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.139@tcp lock: ffff8a44825c2600/0xfac36e8915413c7f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xfac36e8915413c86 expref: -99 pid: 17037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746676.968552:0:20630:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788746676.968561:0:20630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.139@tcp lock: ffff8a4483ed6a00/0xfac36e8915414092 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfac36e8915414099 expref: -99 pid: 17055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746676.968569:0:20630:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff8a4483ed6a00/0xfac36e8915414092 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xfac36e8915414099 expref: -99 pid: 17055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746676.968575:0:20630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff8a4483ed6a00/0xfac36e8915414092 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xfac36e8915414099 expref: -99 pid: 17055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746676.968582:0:20630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.139@tcp lock: ffff8a4483ed6a00/0xfac36e8915414092 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xfac36e8915414099 expref: -99 pid: 17055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746676.968723:0:17046:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788746676.968731:0:17046:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.139@tcp lock: ffff8a44825c2600/0xfac36e8915413c7f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xfac36e8915413c86 expref: -99 pid: 17037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746676.968738:0:17046:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a44825c2600 already unused, calling callback (ffffffffc1180c20) 10000000:00010000:1.0:1788746676.968742:0:17046:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.139@tcp lock: ffff8a44825c2600/0xfac36e8915413c7f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xfac36e8915413c86 expref: -99 pid: 17037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746676.968751:0:17046:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.139@tcp lock: ffff8a44825c2600/0xfac36e8915413c7f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0xfac36e8915413c86 expref: -99 pid: 17037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788746676.968759:0:17046:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.139@tcp lock: ffff8a44825c2600/0xfac36e8915413c7f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0xfac36e8915413c86 expref: -99 pid: 17037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788746676.968764:0:17046:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788746676.968766:0:17046:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:1.0:1788746676.968813:0:17046:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.139@tcp lock: ffff8a44825c2600/0xfac36e8915413c7f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xfac36e8915413c86 expref: -99 pid: 17037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746676.968828:0:17046:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788746676.968863:0:17046:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.139@tcp lock: ffff8a44825c2600/0xfac36e8915413c7f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xfac36e8915413c86 expref: -99 pid: 17037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746676.968870:0:17046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.139@tcp lock: ffff8a44825c2600/0xfac36e8915413c7f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xfac36e8915413c86 expref: -99 pid: 17037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746676.968888:0:17046:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788746676.968891:0:17046:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.139@tcp lock: ffff8a4483ed6a00/0xfac36e8915414092 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xfac36e8915414099 expref: -99 pid: 17055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746676.968910:0:17046:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a4483ed6a00 already unused, calling callback (ffffffffc1180c20) 10000000:00010000:1.0:1788746676.968913:0:17046:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.139@tcp lock: ffff8a4483ed6a00/0xfac36e8915414092 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xfac36e8915414099 expref: -99 pid: 17055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746676.968920:0:17046:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.139@tcp lock: ffff8a4483ed6a00/0xfac36e8915414092 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xfac36e8915414099 expref: -99 pid: 17055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788746676.968925:0:17046:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.139@tcp lock: ffff8a4483ed6a00/0xfac36e8915414092 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xfac36e8915414099 expref: -99 pid: 17055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788746676.968929:0:17046:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:1.0:1788746676.968931:0:17046:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 00010000:00010000:1.0:1788746676.968944:0:17046:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.139@tcp lock: ffff8a4483ed6a00/0xfac36e8915414092 lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xfac36e8915414099 expref: -99 pid: 17055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746676.968949:0:17046:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788746676.968956:0:17046:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.139@tcp lock: ffff8a4483ed6a00/0xfac36e8915414092 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xfac36e8915414099 expref: -99 pid: 17055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746676.968963:0:17046:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788746676.968964:0:17046:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788746676.968966:0:17046:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788746676.969025:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a4483591500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7bf60f24-4000-471c-bcb3-0ae64e0e499e:3646:1875636324102656:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788746676.969112:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746676.969165:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788746676.969171:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a4483593100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7bf60f24-4000-471c-bcb3-0ae64e0e499e:3646:1875636324102528:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788746676.969196:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746676.969243:0:17044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324102656 00000100:00100000:0.0:1788746676.969257:0:17044:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324102656 00000100:00100000:0.0:1788746676.969324:0:17044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324102528 00000100:00100000:0.0:1788746676.969327:0:17044:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324102528 00000100:00100000:0.0:1788746676.969349:0:17044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788746676.969358:0:17044:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a45c0ea4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7bf60f24-4000-471c-bcb3-0ae64e0e499e+24:3646:x1875636324102656:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788746676.969370:0:17044:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788746676.969386:0:17044:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a4483ed7c00/0xfac36e8915414099 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xfac36e8915414092 expref: 24 pid: 17052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746676.969398:0:17044:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788746676.969447:0:17044:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a45c0ea4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7bf60f24-4000-471c-bcb3-0ae64e0e499e+23:3646:x1875636324102656:12345-0@lo:103:ldlm_bl.0 Request processed in 78us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746676.969453:0:17044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788746676.969469:0:17044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788746676.969475:0:17044:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a45bd83e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7bf60f24-4000-471c-bcb3-0ae64e0e499e+22:3646:x1875636324102528:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788746676.969482:0:17044:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788746676.969489:0:17044:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a45b7f94000/0xfac36e8915413c86 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xfac36e8915413c7f expref: 22 pid: 17053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746676.969497:0:17044:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788746676.969516:0:17044:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a45bd83e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7bf60f24-4000-471c-bcb3-0ae64e0e499e+21:3646:x1875636324102528:12345-0@lo:103:ldlm_bl.0 Request processed in 42us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746676.969522:0:17044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788746676.969589:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a4483593100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7bf60f24-4000-471c-bcb3-0ae64e0e499e:3646:1875636324102528:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788746676.969597:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a4483591500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7bf60f24-4000-471c-bcb3-0ae64e0e499e:3646:1875636324102656:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788746676.970538:0:20630:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788746676.970547:0:20630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.139@tcp lock: ffff8a4483ed6a00/0xfac36e8915414092 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xfac36e8915414099 expref: -99 pid: 17055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788746676.970562:0:20630:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:2.0:1788746676.970572:0:20630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.139@tcp lock: ffff8a4580030e00/0xfac36e891541422f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xfac36e891541423d expref: -99 pid: 17055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746676.970580:0:20630:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff8a4580030e00/0xfac36e891541422f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xfac36e891541423d expref: -99 pid: 17055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746676.970597:0:20630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff8a4580030e00/0xfac36e891541422f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xfac36e891541423d expref: -99 pid: 17055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746676.970604:0:20630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.139@tcp lock: ffff8a4580030e00/0xfac36e891541422f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xfac36e891541423d expref: -99 pid: 17055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746676.970638:0:17047:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788746676.970644:0:17047:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.139@tcp lock: ffff8a4580030e00/0xfac36e891541422f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xfac36e891541423d expref: -99 pid: 17055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746676.970660:0:17047:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a4580030e00 already unused, calling callback (ffffffffc1180c20) 10000000:00010000:3.0:1788746676.970663:0:17047:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.139@tcp lock: ffff8a4580030e00/0xfac36e891541422f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xfac36e891541423d expref: -99 pid: 17055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746676.970671:0:17047:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.139@tcp lock: ffff8a4580030e00/0xfac36e891541422f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xfac36e891541423d expref: -99 pid: 17055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788746676.970685:0:17047:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.139@tcp lock: ffff8a4580030e00/0xfac36e891541422f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xfac36e891541423d expref: -99 pid: 17055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788746676.970690:0:17047:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1788746676.970692:0:17047:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:3.0:1788746676.970715:0:17047:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.139@tcp lock: ffff8a4580030e00/0xfac36e891541422f lrc: 3/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xfac36e891541423d expref: -99 pid: 17055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746676.970721:0:17047:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1788746676.970773:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:3.0:1788746676.970796:0:17047:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.139@tcp lock: ffff8a4580030e00/0xfac36e891541422f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xfac36e891541423d expref: -99 pid: 17055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746676.970805:0:17047:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788746676.970807:0:17047:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788746676.970809:0:17047:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788746676.971050:0:20630:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788746676.971055:0:20630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.139@tcp lock: ffff8a4580030e00/0xfac36e891541422f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xfac36e891541423d expref: -99 pid: 17055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788746676.971066:0:20630:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1788746676.971073:0:20630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.139@tcp lock: ffff8a44825c3800/0xfac36e8915413c71 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfac36e8915413c78 expref: -99 pid: 17037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746676.971080:0:20630:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff8a44825c3800/0xfac36e8915413c71 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xfac36e8915413c78 expref: -99 pid: 17037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746676.971095:0:20630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff8a44825c3800/0xfac36e8915413c71 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xfac36e8915413c78 expref: -99 pid: 17037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746676.971101:0:20630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.139@tcp lock: ffff8a44825c3800/0xfac36e8915413c71 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xfac36e8915413c78 expref: -99 pid: 17037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788746676.971140:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a45bca92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7bf60f24-4000-471c-bcb3-0ae64e0e499e:3644:1875636324102784:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788746676.971193:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746676.971456:0:17044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324102784 00000100:00100000:3.0:1788746676.971464:0:17044:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324102784 00000100:00100000:3.0:1788746676.971510:0:17044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788746676.971519:0:17044:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4483591180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7bf60f24-4000-471c-bcb3-0ae64e0e499e+21:3644:x1875636324102784:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788746676.971530:0:17044:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788746676.971544:0:17044:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a4580030a00/0xfac36e891541423d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xfac36e891541422f expref: 21 pid: 17051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746676.971555:0:17044:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788746676.971591:0:17044:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4483591180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7bf60f24-4000-471c-bcb3-0ae64e0e499e+20:3644:x1875636324102784:12345-0@lo:103:ldlm_bl.0 Request processed in 73us (397us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746676.971599:0:17044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788746676.971631:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a45bca92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7bf60f24-4000-471c-bcb3-0ae64e0e499e:3644:1875636324102784:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788746676.971811:0:17046:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788746676.971933:0:17046:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.139@tcp lock: ffff8a44825c3800/0xfac36e8915413c71 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xfac36e8915413c78 expref: -99 pid: 17037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746676.971942:0:17046:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a44825c3800 already unused, calling callback (ffffffffc1180c20) 10000000:00010000:0.0:1788746676.971945:0:17046:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.139@tcp lock: ffff8a44825c3800/0xfac36e8915413c71 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xfac36e8915413c78 expref: -99 pid: 17037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746676.971953:0:17046:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.139@tcp lock: ffff8a44825c3800/0xfac36e8915413c71 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xfac36e8915413c78 expref: -99 pid: 17037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788746676.971959:0:17046:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.139@tcp lock: ffff8a44825c3800/0xfac36e8915413c71 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xfac36e8915413c78 expref: -99 pid: 17037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788746676.971965:0:17046:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:0.0:1788746676.971967:0:17046:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 00010000:00010000:0.0:1788746676.971992:0:17046:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.139@tcp lock: ffff8a44825c3800/0xfac36e8915413c71 lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xfac36e8915413c78 expref: -99 pid: 17037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746676.971998:0:17046:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788746676.972024:0:17046:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.139@tcp lock: ffff8a44825c3800/0xfac36e8915413c71 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xfac36e8915413c78 expref: -99 pid: 17037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746676.972033:0:17046:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788746676.972035:0:17046:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788746676.972037:0:17046:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788746676.972075:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788746676.972097:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a45c0ea4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7bf60f24-4000-471c-bcb3-0ae64e0e499e:3643:1875636324102912:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788746676.972130:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746676.972424:0:18212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324102912 00000100:00100000:0.0:1788746676.972430:0:18212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324102912 00000100:00100000:0.0:1788746676.972484:0:18212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788746676.972491:0:18212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4483593800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7bf60f24-4000-471c-bcb3-0ae64e0e499e+20:3643:x1875636324102912:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788746676.972500:0:18212:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788746676.972510:0:18212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a45b7f94a00/0xfac36e8915413c78 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xfac36e8915413c71 expref: 20 pid: 17053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746676.972521:0:18212:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788746676.972555:0:18212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4483593800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7bf60f24-4000-471c-bcb3-0ae64e0e499e+19:3643:x1875636324102912:12345-0@lo:103:ldlm_bl.0 Request processed in 65us (425us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746676.972561:0:18212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788746676.972592:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a45c0ea4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7bf60f24-4000-471c-bcb3-0ae64e0e499e:3643:1875636324102912:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788746676.972836:0:20630:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788746676.972843:0:20630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.139@tcp lock: ffff8a44825c3800/0xfac36e8915413c71 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xfac36e8915413c78 expref: -99 pid: 17037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788746676.972855:0:20630:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 10000000:01000000:2.0:1788746676.972860:0:20630:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:2.0:1788746676.972869:0:20630:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:2.0:1788746676.972904:0:20630:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-MDT0000 00000020:01000000:2.0:1788746676.972908:0:20630:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:2.0:1788746676.972913:0:20630:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788746676.972918:0:20630:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 4/13 00000020:00080000:2.0:1788746676.972923:0:20630:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff8a4482501000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788746676.972928:0:20630:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff8a45bcb80800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788746676.972932:0:20630:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff8a4483120000 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788746676.972935:0:20630:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff8a4481b6c000 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788746676.972942:0:20630:0:(genops.c:1818:print_export_data()) lustre-MDT0000: UNLINKED ffff8a459fb0c000 f8c6d223-c0ac-460e-8131-df4be0cff05f 192.168.204.39@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 8589934599 stale:0 00000020:00080000:2.0:1788746676.972946:0:20630:0:(genops.c:1818:print_export_data()) lustre-MDT0000: UNLINKED ffff8a44831ee800 583130b9-0019-4af8-9623-d64634ab82f4 192.168.204.39@tcp 5 (0 5 0) 1 0 0 0: 0000000000000000 8589934623 stale:0 00000020:00080000:2.0:1788746676.972951:0:20630:0:(genops.c:1552:class_disconnect_exports()) OBD device 5 (ffff8a45b7ea8000) has exports, disconnecting them 00000020:00080000:2.0:1788746676.972956:0:20630:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8a4482501000), last request at 1788746675 00000020:00000080:2.0:1788746676.972962:0:20630:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xfac36e8915414061 00000100:00080000:2.0:1788746676.972980:0:20630:0:(import.c:65:import_set_state_nolock()) ffff8a4482505800 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1788746676.973478:0:17047:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1788746676.973602:0:20630:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8a4482501000): rc 0 00000020:00000080:2.0:1788746676.973606:0:20630:0:(genops.c:885:class_export_put()) final put ffff8a4482501000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:2.0:1788746676.973624:0:20630:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8a45bcb80800), last request at 1788746675 00000020:00000080:2.0:1788746676.973629:0:20630:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xfac36e8915413efc 00000100:00080000:2.0:1788746676.973639:0:20630:0:(import.c:65:import_set_state_nolock()) ffff8a45bcb81800 : changing import state from FULL to CLOSED 00000020:00000080:3.0:1788746676.973673:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a4482501000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:3.0:1788746676.973732:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8a4482505800 for lustre-MDT0000 00010000:00010000:0.0:1788746676.973942:0:17046:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1788746676.974000:0:20630:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8a45bcb80800): rc 0 00000020:00000080:2.0:1788746676.974003:0:20630:0:(genops.c:885:class_export_put()) final put ffff8a45bcb80800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:2.0:1788746676.974016:0:20630:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8a4483120000), last request at 1788746601 00000020:00000080:2.0:1788746676.974021:0:20630:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xfac36e8915413e4d 00000100:00080000:2.0:1788746676.974025:0:20630:0:(import.c:65:import_set_state_nolock()) ffff8a4483125000 : changing import state from FULL to CLOSED 00000020:00000080:1.0:1788746676.974048:0:14946:0:(genops.c:844:class_export_destroy()) destroying export ffff8a45bcb80800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1788746676.974096:0:14946:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8a45bcb81800 for lustre-MDT0000 00010000:00010000:3.0:1788746676.974195:0:17047:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1788746676.974531:0:20630:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8a4483120000): rc 0 00000020:00000080:2.0:1788746676.974534:0:20630:0:(genops.c:885:class_export_put()) final put ffff8a4483120000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:2.0:1788746676.974563:0:20630:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8a4481b6c000), last request at 1788746601 00000020:00000080:2.0:1788746676.974569:0:20630:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xfac36e8915413df2 00000100:00080000:2.0:1788746676.974574:0:20630:0:(import.c:65:import_set_state_nolock()) ffff8a4483125800 : changing import state from FULL to CLOSED 00000020:00000080:3.0:1788746676.974597:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a4483120000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:3.0:1788746676.974627:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8a4483125000 for lustre-MDT0000 00010000:00010000:0.0:1788746676.974736:0:17046:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:2.0:1788746676.974905:0:20630:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934628 00000020:00080000:2.0:1788746676.974978:0:20630:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8a4481b6c000): rc 0 00000004:00000080:2.0:1788746676.974986:0:20630:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffff9fe2419bfae0 00000100:00080000:2.0:1788746676.975005:0:20630:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1788746676.975009:0:20630:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 3 00010000:00010000:3.0:1788746676.975145:0:17047:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788746676.976945:0:20630:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:2.0:1788746676.976980:0:20630:0:(import.c:65:import_set_state_nolock()) ffff8a45bc951800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1788746676.977046:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a45b7ef2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1875636324103040:0@lo:39:umount.0 00000100:00100000:0.0:1788746676.977187:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746676.977276:0:17063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324103040 00000100:00100000:3.0:1788746676.977309:0:17063:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324103040 00000100:00100000:3.0:1788746676.977367:0:17063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788746676.977380:0:17063:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a45c0ea4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1875636324103040:12345-0@lo:39:umount.0 00000020:00000080:3.0:1788746676.977409:0:17063:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xfac36e8915413e77 00000100:00080000:3.0:1788746676.977417:0:17063:0:(import.c:65:import_set_state_nolock()) ffff8a4583191800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788746676.977479:0:17063:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934594 00000100:00080000:2.0:1788746676.978671:0:20630:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788746676.978676:0:20630:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934594 gen 3 00000004:00080000:2.0:1788746676.978696:0:20630:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1788746676.978762:0:20630:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:2.0:1788746676.978781:0:20630:0:(import.c:65:import_set_state_nolock()) ffff8a4585c70000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1788746676.979230:0:17063:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a45c0ea4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+3:3642:x1875636324103040:12345-0@lo:39:umount.0 Request processed in 1841us (2040us total) trans 8589934595 rc 0/0 00000100:00100000:3.0:1788746676.979241:0:17063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00080000:2.0:1788746676.984966:0:20630:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788746676.984975:0:20630:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934598 gen 3 00000004:00080000:2.0:1788746676.985004:0:20630:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1788746676.985063:0:20630:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:2.0:1788746676.985114:0:20630:0:(import.c:65:import_set_state_nolock()) ffff8a45a8d03800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:2.0:1788746676.985169:0:20630:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffff8a45b7ea8000) has no exports 00000100:00100000:0.0:1788746676.986262:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a45b7ef0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1875636324103168:0@lo:9:umount.0 00000100:00100000:0.0:1788746676.986413:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746676.986474:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a45b7ef1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1875636324103296:0@lo:9:umount.0 00000100:00100000:0.0:1788746676.986497:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788746676.986540:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8a45bc951800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1788746676.986547:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a45b7ef2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1875636324103040:0@lo:39:umount.0 00010000:00010000:0.0:1788746676.986617:0:17046:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788746676.986705:0:18565:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324103168 00000100:00100000:3.0:1788746676.986712:0:18565:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324103168 00000100:00100000:3.0:1788746676.986760:0:18565:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324103296 00000100:00100000:3.0:1788746676.986764:0:18565:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324103296 00000100:00100000:0.0:1788746676.987009:0:18567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788746676.987022:0:18567:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a45c0ea6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1875636324103168:12345-0@lo:9:umount.0 00000020:00000080:0.0:1788746676.987049:0:18567:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xfac36e8915413f42 00000100:00080000:0.0:1788746676.987068:0:18567:0:(import.c:65:import_set_state_nolock()) ffff8a45b7edf000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788746676.987162:0:18567:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:0.0:1788746676.987469:0:18567:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a45c0ea6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3642:x1875636324103168:12345-0@lo:9:umount.0 Request processed in 451us (1055us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746676.987478:0:18567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00010000:0.0:1788746676.987510:0:17047:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788746676.987531:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8a4585c70000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1788746676.987543:0:3642:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1788746676.987546:0:3642:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788746676.987549:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a45b7ef0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1875636324103168:0@lo:9:umount.0 00000100:00100000:3.0:1788746676.988016:0:18565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788746676.988029:0:18565:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a45bcb6b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1875636324103296:12345-0@lo:9:umount.0 00000020:00000080:3.0:1788746676.988050:0:18565:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xfac36e89154140a0 00000100:00080000:3.0:1788746676.988058:0:18565:0:(import.c:65:import_set_state_nolock()) ffff8a4483744800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788746676.988153:0:18565:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934600 00000100:00100000:3.0:1788746676.988392:0:18565:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a45bcb6b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2:3642:x1875636324103296:12345-0@lo:9:umount.0 Request processed in 367us (1893us total) trans 0 rc 0/0 00010000:00010000:0.0:1788746676.991335:0:17046:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788746676.991385:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8a45a8d03800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1788746676.991405:0:3642:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1788746676.991408:0:3642:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788746676.991414:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a45b7ef1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1875636324103296:0@lo:9:umount.0 00000100:00100000:3.0:1788746676.991941:0:18565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000020:00080000:2.0:1788746676.997618:0:20630:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffff8a45b7ea8000) has no exports 00000020:00000080:2.0:1788746677.063045:0:20630:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xfac36e8915413ccc 00000020:00000080:2.0:1788746677.063061:0:20630:0:(genops.c:885:class_export_put()) final put ffff8a45bfe81800/lustre-QMT0000_UUID 00000020:01000000:2.0:1788746677.063254:0:20630:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:3.0:1788746677.063942:0:14946:0:(genops.c:844:class_export_destroy()) destroying export ffff8a45bfe81800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:3.0:1788746677.063969:0:20630:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788746677.063980:0:20630:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788746677.063985:0:20630:0:(genops.c:1557:class_disconnect_exports()) OBD device 7 (ffff8a45c0d9cd40) has no exports 00000020:00000080:2.0:1788746677.065210:0:20630:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xfac36e8915413cc5 00000020:00000080:2.0:1788746677.065223:0:20630:0:(genops.c:885:class_export_put()) final put ffff8a448335e000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788746677.065357:0:20630:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788746677.065366:0:20630:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1788746677.065369:0:20630:0:(genops.c:885:class_export_put()) final put ffff8a4483359000/lustre-QMT0000_UUID 00000020:00000080:2.0:1788746677.065386:0:20630:0:(genops.c:844:class_export_destroy()) destroying export ffff8a4483359000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:2.0:1788746677.065392:0:20630:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:3.0:1788746677.065585:0:14946:0:(genops.c:844:class_export_destroy()) destroying export ffff8a448335e000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:00010000:0.0:1788746677.650489:0:17047:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788746677.971535:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788746677.971559:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a45b7ef1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875636324103424:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788746677.971633:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746677.971740:0:18568:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324103424 00000100:00100000:1.0:1788746677.971749:0:18568:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324103424 00000100:00080000:3.0:1788746677.971820:0:17054:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788746677.971831:0:18568:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788746677.971843:0:18568:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a45bcb6a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875636324103424:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788746677.971879:0:18568:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788746677.971940:0:18568:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a45bcb6a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875636324103424:12345-0@lo:13:osp-pre-0-1.0 Request processed in 100us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746677.971946:0:18568:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788746677.972044:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a45b7ef1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875636324103424:0@lo:13:osp-pre-0-1.0 00000001:00100000:0.0:1788746677.975250:0:17038:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1788746677.975264:0:17038:0:(genops.c:885:class_export_put()) final put ffff8a4481b6c000/lustre-MDT0001-mdtlov_UUID 00000001:00100000:0.0:1788746677.975476:0:17038:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of f8c6d223-c0ac-460e-8131-df4be0cff05f 00000001:00080000:0.0:1788746677.975486:0:17038:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934628 is committed 00000020:00000080:0.0:1788746677.975491:0:17038:0:(genops.c:885:class_export_put()) final put ffff8a459fb0c000/f8c6d223-c0ac-460e-8131-df4be0cff05f 00000020:00000080:3.0:1788746677.982185:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a4481b6c000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:3.0:1788746677.982428:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8a4483125800 for lustre-MDT0000 00000001:00100000:0.0:1788746677.988584:0:17038:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 583130b9-0019-4af8-9623-d64634ab82f4 00000001:00080000:0.0:1788746677.988603:0:17038:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934627 is committed 00000020:00000080:0.0:1788746677.988619:0:17038:0:(genops.c:885:class_export_put()) final put ffff8a44831ee800/583130b9-0019-4af8-9623-d64634ab82f4 00000020:00000080:1.0:1788746677.989747:0:14946:0:(genops.c:844:class_export_destroy()) destroying export ffff8a459fb0c000/f8c6d223-c0ac-460e-8131-df4be0cff05f for lustre-MDT0000 00000020:00000080:1.0:1788746677.989850:0:14946:0:(genops.c:844:class_export_destroy()) destroying export ffff8a44831ee800/583130b9-0019-4af8-9623-d64634ab82f4 for lustre-MDT0000 00000020:00000080:1.0:1788746677.989905:0:14946:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8a4482502800 for lustre-MDT0000 00000020:00000080:1.0:1788746677.989911:0:14946:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8a44831ed800 for lustre-MDT0000 00010000:00010000:0.0:1788746678.676485:0:17046:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788746678.995350:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a4483590a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875636324103552:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788746678.995468:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746678.995941:0:18090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324103552 00000100:00100000:1.0:1788746678.995953:0:18090:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324103552 00000100:00100000:1.0:1788746678.996005:0:18090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788746678.996116:0:18090:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a45bca92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3646:x1875636324103552:12345-0@lo:41:osp-pre-0-1.0 00000020:00080000:1.0:1788746678.996127:0:18090:0:(tgt_handler.c:807:tgt_request_handle()) operation 41 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1788746678.996196:0:18090:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a45bca92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3646:x1875636324103552:12345-0@lo:41:osp-pre-0-1.0 Request processed in 181us (728us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788746678.996203:0:18090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:02020000:3.0:1788746678.996278:0:3646:0:(client.c:1505:ptlrpc_check_status()) lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 00000001:00100000:1.0:1788746679.011705:0:17791:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:1.0:1788746679.011729:0:17791:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934595 is committed 00000020:00000080:1.0:1788746679.011737:0:17791:0:(genops.c:885:class_export_put()) final put ffff8a45a0b63800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:1.0:1788746679.011765:0:17791:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of f8c6d223-c0ac-460e-8131-df4be0cff05f 00000001:00080000:1.0:1788746679.011774:0:17791:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934594 is committed 00000020:00000080:1.0:1788746679.011776:0:17791:0:(genops.c:885:class_export_put()) final put ffff8a45b4a4d000/f8c6d223-c0ac-460e-8131-df4be0cff05f 00000001:00100000:1.0:1788746679.011815:0:17791:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 583130b9-0019-4af8-9623-d64634ab82f4 00000001:00080000:1.0:1788746679.011819:0:17791:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934593 is committed 00000020:00000080:1.0:1788746679.011821:0:17791:0:(genops.c:885:class_export_put()) final put ffff8a45b4a48800/583130b9-0019-4af8-9623-d64634ab82f4 00000020:00000080:2.0:1788746679.012760:0:14946:0:(genops.c:844:class_export_destroy()) destroying export ffff8a45a0b63800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000100:00080000:3.0:1788746679.014379:0:3646:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1788746679.014388:0:3646:0:(import.c:65:import_set_state_nolock()) ffff8a4483741000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1788746679.014404:0:3646:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000020:00000080:2.0:1788746679.021424:0:14946:0:(genops.c:844:class_export_destroy()) destroying export ffff8a45b4a4d000/f8c6d223-c0ac-460e-8131-df4be0cff05f for lustre-MDT0001 00000020:00000080:2.0:1788746679.021809:0:14946:0:(genops.c:844:class_export_destroy()) destroying export ffff8a45b4a48800/583130b9-0019-4af8-9623-d64634ab82f4 for lustre-MDT0001 00000020:00000080:2.0:1788746679.021980:0:14946:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8a4583191800 for lustre-MDT0001 00000020:00000080:2.0:1788746679.021988:0:14946:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8a45b49b6800 for lustre-MDT0001 00000020:00000080:2.0:1788746679.021992:0:14946:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8a45b4a4a000 for lustre-MDT0001 00000100:00080000:3.0:1788746679.035903:0:3646:0:(import.c:65:import_set_state_nolock()) ffff8a4483741000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788746679.035921:0:3646:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 531 00000100:00080000:3.0:1788746679.035944:0:3646:0:(import.c:666:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8a4483741000 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:3.0:1788746679.036004:0:3646:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a45bca93b80 x1875636324103680/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788746679.040846:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a45bca93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1875636324103680:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:1.0:1788746679.040966:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746679.041391:0:17063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324103680 00000100:00100000:3.0:1788746679.041414:0:17063:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324103680 00000100:00100000:3.0:1788746679.041478:0:17063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788746679.041489:0:17063:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4483590e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3642:x1875636324103680:12345-0@lo:38:ptlrpcd_00_03.0 00010000:02000000:3.0:1788746679.041536:0:17063:0:(ldlm_lib.c:1215:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1788746679.055220:0:17063:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4483590e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3642:x1875636324103680:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 13715us (14239us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788746679.055240:0:17063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:1.0:1788746679.055462:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8a4483741000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788746679.055469:0:3642:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788746679.055474:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a45bca93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1875636324103680:0@lo:38:ptlrpcd_00_03.0 00000020:01000000:2.0:1788746679.122819:0:20630:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8a45bd7c41e0 - data ffff8a4481c06ca8/ffff8a44831de800 00000020:01000000:2.0:1788746679.123047:0:20630:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8a448316dba0 - data ffff8a45c125cbd0/ffff8a45bdccac00 00000001:00000004:3.0:1788746679.139244:0:20630:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934628 00000100:00080000:0.0:1788746679.185257:0:20630:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1788746679.185269:0:20630:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1788746679.185304:0:20630:0:(client.c:3164:ptlrpc_free_committed()) @@@ free request with old gen req@ffff8a45b7ef2680 x1875636324103040/t8589934595(8589934595) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788746686 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788746679.185339:0:20630:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:0.0:1788746679.186711:0:20630:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1788746679.186718:0:20630:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934594 gen 4 00000004:00080000:0.0:1788746679.186740:0:20630:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788746679.186742:0:20630:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1788746679.186966:0:17082:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1788746679.186972:0:17082:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 1 count 1 00000040:00080000:3.0:1788746679.186984:0:17082:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 2 count 2 00000100:00080000:0.0:1788746679.187795:0:20630:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1788746679.187799:0:20630:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934598 gen 4 00000004:00080000:0.0:1788746679.187818:0:20630:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788746679.187820:0:20630:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1788746679.190206:0:17084:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1788746679.190217:0:17084:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xc:0x0] index 2 count 1 00000040:00080000:3.0:1788746679.190238:0:17084:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 2 count 2 00000020:00000080:0.0:1788746679.192107:0:20630:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xfac36e8915413c94 00000020:00000080:0.0:1788746679.192122:0:20630:0:(genops.c:885:class_export_put()) final put ffff8a459fb09000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788746679.192870:0:14946:0:(genops.c:844:class_export_destroy()) destroying export ffff8a459fb09000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788746679.193881:0:20630:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xfac36e8915413ca9 00000020:00000080:0.0:1788746679.193895:0:20630:0:(genops.c:885:class_export_put()) final put ffff8a459fb08800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1788746679.193912:0:20630:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:0.0:1788746679.193919:0:20630:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788746679.193929:0:20630:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788746679.193934:0:20630:0:(genops.c:1557:class_disconnect_exports()) OBD device 4 (ffff8a45b7eacd40) has no exports 00000020:00000080:2.0:1788746679.194141:0:14946:0:(genops.c:844:class_export_destroy()) destroying export ffff8a459fb08800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000004:01000000:0.0:1788746679.194360:0:20630:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:0.0:1788746679.194372:0:20630:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xfac36e8915413d0b 00000020:00000080:0.0:1788746679.194379:0:20630:0:(genops.c:885:class_export_put()) final put ffff8a4483df3000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1788746679.194656:0:20630:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:0.0:1788746679.194662:0:20630:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788746679.194670:0:20630:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1788746679.194674:0:20630:0:(genops.c:1557:class_disconnect_exports()) OBD device 10 (ffff8a45b4db99c0) has no exports 00000020:00000080:0.0:1788746679.194684:0:20630:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xfac36e8915413d04 00000020:00000080:0.0:1788746679.194690:0:20630:0:(genops.c:885:class_export_put()) final put ffff8a45a8d06800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788746679.195315:0:14946:0:(genops.c:844:class_export_destroy()) destroying export ffff8a4483df3000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00010000:01000000:0.0:1788746679.195871:0:20630:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:0.0:1788746679.195877:0:20630:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1788746679.195897:0:20630:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934598 gen 5 00000004:00080000:0.0:1788746679.195905:0:20630:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788746679.195908:0:20630:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788746679.195952:0:20630:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788746679.195962:0:20630:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788746679.195971:0:20630:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xfac36e8915413cf6 00000020:00000080:0.0:1788746679.195980:0:20630:0:(genops.c:885:class_export_put()) final put ffff8a45a8d02800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1788746679.195986:0:20630:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:0.0:1788746679.195990:0:20630:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788746679.195994:0:20630:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1788746679.195998:0:20630:0:(genops.c:1557:class_disconnect_exports()) OBD device 9 (ffff8a4482403380) has no exports 00000020:00000080:0.0:1788746679.196003:0:20630:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xfac36e8915413cef 00000020:00000080:0.0:1788746679.196007:0:20630:0:(genops.c:885:class_export_put()) final put ffff8a4585c75000/lustre-MDT0000-osd_UUID 00010000:01000000:0.0:1788746679.196455:0:20630:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:0.0:1788746679.196458:0:20630:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1788746679.196461:0:20630:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934594 gen 5 00000004:00080000:0.0:1788746679.196465:0:20630:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788746679.196467:0:20630:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788746679.196494:0:20630:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788746679.196500:0:20630:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:0.0:1788746679.196515:0:20630:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:0.0:1788746679.196521:0:20630:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xfac36e8915413ce1 00000020:00000080:0.0:1788746679.196527:0:20630:0:(genops.c:885:class_export_put()) final put ffff8a45bc954000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1788746679.196532:0:20630:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:0.0:1788746679.196535:0:20630:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788746679.196539:0:20630:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1788746679.196542:0:20630:0:(genops.c:1557:class_disconnect_exports()) OBD device 8 (ffff8a4482404d40) has no exports 00000020:00000080:0.0:1788746679.196546:0:20630:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xfac36e8915413cda 00000020:00000080:0.0:1788746679.196549:0:20630:0:(genops.c:885:class_export_put()) final put ffff8a45bc954800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788746679.197613:0:14946:0:(genops.c:844:class_export_destroy()) destroying export ffff8a45a8d06800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788746679.197631:0:14946:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8a45a8d03800 for lustre-OST0001-osc-MDT0000 00000020:00000080:2.0:1788746679.197642:0:14946:0:(genops.c:885:class_export_put()) final put ffff8a45a8d00000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788746679.197644:0:14946:0:(genops.c:844:class_export_destroy()) destroying export ffff8a45a8d00000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:2.0:1788746679.197649:0:14946:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788746679.197786:0:14946:0:(genops.c:844:class_export_destroy()) destroying export ffff8a45a8d02800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:2.0:1788746679.197792:0:14946:0:(genops.c:844:class_export_destroy()) destroying export ffff8a4585c75000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788746679.197799:0:14946:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8a4585c70000 for lustre-OST0000-osc-MDT0000 00000020:00000080:2.0:1788746679.197802:0:14946:0:(genops.c:885:class_export_put()) final put ffff8a45bc950000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788746679.197805:0:14946:0:(genops.c:844:class_export_destroy()) destroying export ffff8a45bc950000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:2.0:1788746679.197810:0:14946:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788746679.197844:0:14946:0:(genops.c:844:class_export_destroy()) destroying export ffff8a45bc954000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:2.0:1788746679.197849:0:14946:0:(genops.c:844:class_export_destroy()) destroying export ffff8a45bc954800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:2.0:1788746679.199450:0:20630:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:2.0:1788746679.199460:0:20630:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1788746679.199465:0:20630:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788746679.199476:0:20630:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788746679.199547:0:20630:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788746679.199563:0:20630:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788746679.199607:0:20630:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788746679.199611:0:20630:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788746679.199617:0:20630:0:(genops.c:885:class_export_put()) final put ffff8a459fb0b800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788746679.199621:0:20630:0:(genops.c:844:class_export_destroy()) destroying export ffff8a459fb0b800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:2.0:1788746679.199629:0:20630:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788746679.199754:0:20630:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xfac36e8915413cb0 00000020:00000080:2.0:1788746679.199763:0:20630:0:(genops.c:885:class_export_put()) final put ffff8a459fb0c800/lustre-MDD0000_UUID 00000020:01000000:2.0:1788746679.199769:0:20630:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:2.0:1788746679.199773:0:20630:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788746679.199779:0:20630:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788746679.199783:0:20630:0:(genops.c:1557:class_disconnect_exports()) OBD device 6 (ffff8a45b4db8000) has no exports 00000020:00000080:2.0:1788746679.199806:0:20630:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788746679.199809:0:20630:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:2.0:1788746679.199815:0:20630:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xfac36e8915413cb7 00000020:00000080:2.0:1788746679.199819:0:20630:0:(genops.c:885:class_export_put()) final put ffff8a459fb09800/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1788746679.199830:0:20630:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8a45bfe8e000 from lustre-MDT0000, refs=3 00000020:01000004:2.0:1788746679.199834:0:20630:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8a45bfe8e000 3 00000020:01000004:2.0:1788746679.199838:0:20630:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8a45bfe8e000 from lustre-MDT0000 00000020:00000080:2.0:1788746679.199859:0:20630:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788746679.199863:0:20630:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:2.0:1788746679.199867:0:20630:0:(genops.c:885:class_export_put()) final put ffff8a459fb0f800/lustre-MDT0000_UUID 00000020:00000080:2.0:1788746679.199869:0:20630:0:(genops.c:844:class_export_destroy()) destroying export ffff8a459fb0f800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:2.0:1788746679.199878:0:20630:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:2.0:1788746679.199909:0:20630:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:2.0:1788746679.199914:0:20630:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:2.0:1788746679.199928:0:20630:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:2.0:1788746679.199931:0:20630:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788746679.199934:0:20630:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788746679.199942:0:20630:0:(genops.c:1818:print_export_data()) MGS: ACTIVE ffff8a45a0cf7800 7bf60f24-4000-471c-bcb3-0ae64e0e499e 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788746679.199947:0:20630:0:(genops.c:1552:class_disconnect_exports()) OBD device 1 (ffff8a4482400000) has exports, disconnecting them 00000020:00080000:2.0:1788746679.199952:0:20630:0:(genops.c:1527:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff8a45a0cf7800), last request at 1788746587 00000020:00000080:2.0:1788746679.199971:0:20630:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xfac36e8915413c5c 00000020:00010000:2.0:1788746679.199976:0:20630:0:(genops.c:1920:obd_stale_export_put()) Put export ffff8a45a0cf7800: total 2 00000100:00080000:2.0:1788746679.199980:0:20630:0:(import.c:65:import_set_state_nolock()) ffff8a45a0cf4800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1788746679.199998:0:20630:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8a45a0cf7800): rc 0 00000020:00080000:2.0:1788746679.200002:0:20630:0:(genops.c:1557:class_disconnect_exports()) OBD device 1 (ffff8a4482400000) has no exports 00000100:00100000:2.0:1788746679.200087:0:17053:0:(service.c:3188:ptlrpc_main()) ll_mgs_0002: service thread [ffff8a45b9103c00:17053] 2 exiting: rc = 0 00000100:00100000:2.0:1788746679.200216:0:17052:0:(service.c:3188:ptlrpc_main()) ll_mgs_0001: service thread [ffff8a459f856a00:17052] 1 exiting: rc = 0 00000100:00100000:3.0:1788746679.200364:0:17051:0:(service.c:3188:ptlrpc_main()) ll_mgs_0000: service thread [ffff8a459f857600:17051] 0 exiting: rc = 1 00000020:00000080:3.0:1788746679.200438:0:14946:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8a45bc951800 for lustre-MDT0001-osp-MDT0000 00000020:00000080:3.0:1788746679.200445:0:14946:0:(genops.c:885:class_export_put()) final put ffff8a45bc951000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788746679.200448:0:14946:0:(genops.c:844:class_export_destroy()) destroying export ffff8a45bc951000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:3.0:1788746679.200453:0:14946:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788746679.200522:0:14946:0:(genops.c:844:class_export_destroy()) destroying export ffff8a459fb0c800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:3.0:1788746679.200526:0:14946:0:(genops.c:885:class_export_put()) final put ffff8a459fb0f000/lustre-MDD0000_UUID 00000020:00000080:3.0:1788746679.200529:0:14946:0:(genops.c:844:class_export_destroy()) destroying export ffff8a459fb0f000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:3.0:1788746679.200532:0:14946:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:3.0:1788746679.200557:0:14946:0:(genops.c:844:class_export_destroy()) destroying export ffff8a459fb09800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00010000:3.0:1788746679.200588:0:17047:0:(genops.c:1906:obd_stale_export_get()) Get export ffff8a45a0cf7800: total 0 00010000:00010000:3.0:1788746679.200609:0:17047:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8a45a0cf7800, canceled 0 locks, left on hash table 13. 00010000:00010000:3.0:1788746679.200646:0:17047:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a4581689000/0xfac36e8915414205 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xfac36e89154141fe expref: 14 pid: 17053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746679.200665:0:17047:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a45b7f94400/0xfac36e8915413d7b lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xfac36e8915413d74 expref: 13 pid: 17053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746679.200702:0:17047:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a4581688a00/0xfac36e8915414213 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xfac36e891541420c expref: 12 pid: 17053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746679.200715:0:17047:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a4483ed6000/0xfac36e8915413e38 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xfac36e8915413e31 expref: 11 pid: 17052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746679.200726:0:17047:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a45b7f95200/0xfac36e8915413d89 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xfac36e8915413d82 expref: 10 pid: 17053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746679.200739:0:17047:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a45b7f95e00/0xfac36e8915413d97 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xfac36e8915413d90 expref: 9 pid: 17053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746679.200748:0:17047:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a45b7f95400/0xfac36e8915413c6a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xfac36e8915413c63 expref: 8 pid: 17051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746679.200760:0:17047:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a4483ed6200/0xfac36e8915413ee7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xfac36e8915413ee0 expref: 7 pid: 17052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746679.200770:0:17047:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a45b7f94800/0xfac36e8915414022 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xfac36e891541401b expref: 6 pid: 17053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746679.200781:0:17047:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a4580031400/0xfac36e8915414228 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xfac36e8915414221 expref: 5 pid: 17052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746679.200797:0:17047:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a45ae45e400/0xfac36e891541404c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xfac36e8915414045 expref: 4 pid: 17052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746679.200809:0:17047:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a45b7f95000/0xfac36e891541408b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xfac36e8915414084 expref: 3 pid: 17053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746679.200834:0:17047:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a44825c3200/0xfac36e8915413ebd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xfac36e8915413eb6 expref: 2 pid: 17052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746679.200845:0:17047:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8a45a0cf7800, canceled 13 locks, left on hash table 0. 00000020:00000080:3.0:1788746679.200858:0:17047:0:(genops.c:885:class_export_put()) final put ffff8a45a0cf7800/7bf60f24-4000-471c-bcb3-0ae64e0e499e 00010000:00010000:3.0:1788746679.200871:0:17047:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788746679.200873:0:17047:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788746679.200875:0:17047:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788746679.200881:0:14946:0:(genops.c:844:class_export_destroy()) destroying export ffff8a45a0cf7800/7bf60f24-4000-471c-bcb3-0ae64e0e499e for MGS 00000020:00000080:3.0:1788746679.200907:0:14946:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8a45a0cf4800 for MGS 00000100:00100000:2.0:1788746679.201095:0:20630:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746679.201105:0:20630:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746679.201113:0:20630:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746679.201119:0:20630:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746679.201126:0:20630:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746679.201131:0:20630:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746679.201137:0:20630:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746679.201143:0:20630:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746679.201150:0:20630:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746679.201155:0:20630:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746679.201163:0:20630:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746679.201169:0:20630:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746679.201176:0:20630:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746679.201182:0:20630:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746679.201189:0:20630:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746679.201197:0:20630:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746679.201203:0:20630:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746679.201209:0:20630:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746679.201214:0:20630:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746679.201220:0:20630:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746679.201235:0:20630:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746679.201241:0:20630:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746679.201247:0:20630:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746679.201253:0:20630:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746679.201258:0:20630:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746679.201264:0:20630:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746679.201270:0:20630:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746679.201277:0:20630:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746679.201314:0:20630:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746679.201322:0:20630:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746679.201329:0:20630:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746679.201336:0:20630:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746679.201345:0:20630:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746679.201353:0:20630:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746679.201359:0:20630:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746679.201365:0:20630:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746679.201371:0:20630:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746679.201378:0:20630:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746679.201383:0:20630:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746679.201401:0:20630:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746679.201409:0:20630:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746679.201415:0:20630:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746679.201422:0:20630:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746679.201429:0:20630:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746679.201436:0:20630:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746679.201441:0:20630:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746679.201447:0:20630:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746679.201454:0:20630:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746679.201460:0:20630:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746679.201466:0:20630:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746679.201471:0:20630:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746679.201477:0:20630:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746679.201482:0:20630:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746679.201488:0:20630:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746679.201494:0:20630:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746679.201507:0:20630:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746679.201513:0:20630:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746679.201520:0:20630:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746679.201526:0:20630:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746679.201536:0:20630:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746679.201541:0:20630:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746679.201548:0:20630:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746679.201555:0:20630:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746679.201561:0:20630:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:2.0:1788746679.202668:0:20630:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8a45b592a420 - data ffff8a45c120b5e8/ffff8a4483260c00 00000020:01000000:2.0:1788746679.202807:0:20630:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8a4481090180 - data ffff8a45c1022000/ffff8a4483e32c00 00000020:00000080:2.0:1788746679.203492:0:20630:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xfac36e8915413c40 00000020:00000080:2.0:1788746679.203504:0:20630:0:(genops.c:885:class_export_put()) final put ffff8a4484514800/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1788746679.203847:0:20630:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8a45bfe8e000 from MGS, refs=2 00000020:01000004:2.0:1788746679.203852:0:20630:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8a45bfe8e000 2 00000020:01000004:2.0:1788746679.203855:0:20630:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8a45bfe8e000 from MGS 00000020:00000080:2.0:1788746679.203887:0:20630:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788746679.203896:0:20630:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:2.0:1788746679.203900:0:20630:0:(genops.c:885:class_export_put()) final put ffff8a4484512000/MGS 00000020:00000080:2.0:1788746679.203903:0:20630:0:(genops.c:844:class_export_destroy()) destroying export ffff8a4484512000/MGS for MGS 00000020:01000000:2.0:1788746679.203913:0:20630:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:2.0:1788746679.204001:0:20630:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:2.0:1788746679.204005:0:20630:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788746679.204012:0:20630:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788746679.204019:0:20630:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff8a448256c800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788746679.204026:0:20630:0:(genops.c:1552:class_disconnect_exports()) OBD device 11 (ffff8a448313cd40) has exports, disconnecting them 00000020:00080000:2.0:1788746679.204109:0:20630:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff8a448256c800), last request at 1788746588 00000020:00000080:2.0:1788746679.204114:0:20630:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xfac36e8915413d43 00000020:00080000:2.0:1788746679.204128:0:20630:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8a448256c800): rc 0 00000020:00000080:2.0:1788746679.204133:0:20630:0:(genops.c:885:class_export_put()) final put ffff8a448256c800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1788746679.204171:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a4484514800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1788746679.204570:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a448256c800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:3.0:1788746679.214225:0:20630:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:3.0:1788746679.214237:0:20630:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788746679.214243:0:20630:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1788746679.214254:0:20630:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788746679.214325:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8a4482568800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1788746679.216592:0:20630:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788746679.216613:0:20630:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:3.0:1788746679.216622:0:20630:0:(genops.c:885:class_export_put()) final put ffff8a448335b800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:3.0:1788746679.216627:0:20630:0:(genops.c:844:class_export_destroy()) destroying export ffff8a448335b800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:3.0:1788746679.216642:0:20630:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:3.0:1788746679.216750:0:20630:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8a45bfe8e000 1 00000020:00000080:3.0:1788746679.216759:0:20630:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xfac36e8915413c32 00000020:00000080:3.0:1788746679.216768:0:20630:0:(genops.c:885:class_export_put()) final put ffff8a4484513800/lustre-MDT0000-osd_UUID 00000020:01000000:3.0:1788746679.216785:0:20630:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:3.0:1788746679.216799:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a4484513800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1788746679.216815:0:20630:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788746679.216833:0:20630:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788746679.216838:0:20630:0:(genops.c:1557:class_disconnect_exports()) OBD device 0 (ffff8a45c0d999c0) has no exports 00000020:00000080:3.0:1788746679.273867:0:20630:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788746679.273890:0:20630:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:3.0:1788746679.273899:0:20630:0:(genops.c:885:class_export_put()) final put ffff8a45bfe8a800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788746679.273992:0:20630:0:(genops.c:844:class_export_destroy()) destroying export ffff8a45bfe8a800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:3.0:1788746679.274010:0:20630:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:3.0:1788746679.274195:0:20630:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8a45bfe89800 00000020:02000400:3.0:1788746679.274319:0:20630:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:0.0:1788746679.698834:0:17046:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788746680.726509:0:17047:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788746681.043429:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788746681.043452:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a45bcb68700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875636324103808:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788746681.043533:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746681.043593:0:18568:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324103808 00000100:00100000:0.0:1788746681.043602:0:18568:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324103808 00000100:00100000:0.0:1788746681.043663:0:18568:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788746681.043672:0:18568:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a45bcb6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875636324103808:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788746681.043701:0:18568:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915849728 avail 3684327424 00000100:00100000:0.0:1788746681.043759:0:18568:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a45bcb6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875636324103808:12345-0@lo:13:osp-pre-1-1.0 Request processed in 89us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746681.043766:0:18568:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:0.0:1788746681.043788:0:17054:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788746681.043836:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788746681.043840:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788746681.043844:0:8:0:(import.c:65:import_set_state_nolock()) ffff8a4483741000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788746681.043849:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 608 00000100:00080000:0.0:1788746681.043853:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788746681.043862:0:8:0:(import.c:666:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8a4483741000 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:0.0:1788746681.043881:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a448379ea00 x1875636324104064/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788746681.043952:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a448379ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1875636324104064:0@lo:38:kworker.0 00000100:00100000:0.0:1788746681.043983:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746681.044014:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a448379d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875636324104192:0@lo:400:kworker.0 00000100:00100000:0.0:1788746681.044040:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746681.044058:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a4483cbc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3645:1875636324104704:0@lo:400:kworker.0 00000100:00100000:2.0:1788746681.044793:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a448379e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3643:1875636324104448:0@lo:400:kworker.0 00000100:00100000:2.0:1788746681.044842:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788746681.044869:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788746681.044876:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a448379f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7bf60f24-4000-471c-bcb3-0ae64e0e499e:3643:1875636324103936:0@lo:400:kworker.0 00000400:00000100:2.0:1788746681.044895:0:3643:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875636324103936 offset 0 length 224: 4 00000100:00100000:2.0:1788746681.044915:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a4483cbca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3643:1875636324104576:0@lo:400:kworker.0 00000100:00100000:2.0:1788746681.044935:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788746681.044964:0:17058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324104448 00000100:00100000:2.0:1788746681.044969:0:17058:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324104448 00000100:00100000:2.0:1788746681.044997:0:17058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324104576 00000100:00100000:2.0:1788746681.045000:0:17058:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324104576 00000100:00100000:2.0:1788746681.045038:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788746681.045049:0:17058:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a45b7ef2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875636324104576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788746681.045090:0:17059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788746681.045097:0:17059:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a45b7ef0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3643:x1875636324104448:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1788746681.045104:0:17059:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1788746681.045107:0:17058:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a45b7ef2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875636324104576:12345-0@lo:400:kworker.0 Request processed in 63us (172us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746681.045113:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1788746681.045133:0:17059:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a45b7ef0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3643:x1875636324104448:12345-0@lo:400:kworker.0 Request processed in 35us (291us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788746681.045138:0:17059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00010000:00080000:2.0:1788746681.045169:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff8a4483cbca80 x1875636324104576/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788746697 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788746681.045184:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a4483cbca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3643:1875636324104576:0@lo:400:kworker.0 00000100:00080000:2.0:1788746681.045195:0:3643:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1788746681.045201:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8a45a22f2800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1788746681.045205:0:3643:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:0.0:1788746681.046263:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746681.046315:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788746681.046333:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a448379fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875636324104320:0@lo:400:kworker.0 00000100:00100000:0.0:1788746681.046383:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746681.046403:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a4483cbe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3645:1875636324104832:0@lo:400:kworker.0 00000100:00100000:0.0:1788746681.046424:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746681.046462:0:18090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324104064 00000100:00100000:0.0:1788746681.046469:0:18090:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324104064 00000100:00100000:0.0:1788746681.046499:0:18090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788746681.046504:0:18090:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4483cbd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3642:x1875636324104064:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788746681.046523:0:18090:0:(ldlm_lib.c:1202:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788746681.046580:0:17058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324104704 00000100:00100000:3.0:1788746681.046584:0:17058:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324104704 00000100:00100000:3.0:1788746681.046606:0:17058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324104320 00000100:00100000:3.0:1788746681.046608:0:17058:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324104320 00000100:00100000:3.0:1788746681.046957:0:17058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324104832 00000100:00100000:3.0:1788746681.046962:0:17058:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324104832 00000100:00100000:3.0:1788746681.046989:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1788746681.047072:0:17058:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4483cbea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875636324104832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788746681.047128:0:17058:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4483cbea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875636324104832:12345-0@lo:400:kworker.0 Request processed in 59us (702us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746681.047148:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1788746681.047164:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788746681.047168:0:17058:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4483cbdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3645:x1875636324104704:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1788746681.047173:0:17058:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1788746681.047208:0:17058:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4483cbdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3645:x1875636324104704:12345-0@lo:400:kworker.0 Request processed in 38us (949us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788746681.047214:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788746681.047228:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788746681.047233:0:17058:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4483cbf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3645:x1875636324104320:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1788746681.047239:0:17058:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1788746681.047260:0:17058:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4483cbf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3645:x1875636324104320:12345-0@lo:400:kworker.0 Request processed in 26us (877us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788746681.047266:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788746681.062505:0:18567:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324104192 00000100:00100000:1.0:1788746681.062521:0:18567:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324104192 00000100:00100000:1.0:1788746681.062597:0:18567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788746681.062608:0:18567:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4483cbf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1875636324104192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788746681.066102:0:18567:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4483cbf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1875636324104192:12345-0@lo:400:kworker.0 Request processed in 3485us (22048us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746681.066119:0:18567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00080000:1.0:1788746681.066170:0:17054:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788746681.066177:0:17054:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788746681.066229:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a45bcb68700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875636324103808:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1788746681.066340:0:3645:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788746681.066346:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8a4583eed800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1788746681.066350:0:3645:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1788746681.066367:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8a4583eed800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788746681.066372:0:3645:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 531 00000100:00080000:1.0:1788746681.066383:0:3645:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8a4583eed800 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:1.0:1788746681.066414:0:3645:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a4483591c00 x1875636324104960/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788746681.066456:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a448379fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875636324104320:0@lo:400:kworker.0 00010000:00080000:1.0:1788746681.066475:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff8a4483cbe300 x1875636324104832/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788746697 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788746681.066485:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a4483cbe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3645:1875636324104832:0@lo:400:kworker.0 00000100:00100000:1.0:1788746681.066497:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a448379d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875636324104192:0@lo:400:kworker.0 00000100:00080000:1.0:1788746681.066506:0:3645:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788746681.066509:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8a4482506000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1788746681.066512:0:3645:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1788746681.066515:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8a4482506000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788746681.066517:0:3645:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 564 00000100:00080000:1.0:1788746681.066523:0:3645:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8a4482506000 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:1.0:1788746681.066537:0:3645:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a4483590380 x1875636324105088/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788746681.066546:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a4483cbc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3645:1875636324104704:0@lo:400:kworker.0 00000100:00100000:1.0:1788746681.066596:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a4483591c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875636324104960:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:1.0:1788746681.066634:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746681.066668:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a4483590380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3642:1875636324105088:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:1.0:1788746681.066688:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746681.067073:0:17058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324104960 00000100:00100000:3.0:1788746681.067092:0:17058:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324104960 00000100:00100000:3.0:1788746681.067123:0:17058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324105088 00000100:00100000:3.0:1788746681.067126:0:17058:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324105088 00000100:00100000:3.0:1788746681.067139:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788746681.067145:0:17058:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4483593b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3642:x1875636324104960:12345-0@lo:38:ptlrpcd_00_02.0 00010000:00020000:3.0:1788746681.067164:0:17058:0:(ldlm_lib.c:1202:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788746681.067204:0:17058:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4483593b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3642:x1875636324104960:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 58us (569us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788746681.067210:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788746681.067222:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788746681.067226:0:17058:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4483591880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3642:x1875636324105088:12345-0@lo:38:ptlrpcd_00_02.0 00010000:00020000:3.0:1788746681.067234:0:17058:0:(ldlm_lib.c:1202:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788746681.067253:0:17058:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4483591880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3642:x1875636324105088:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 26us (564us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788746681.067258:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:3.0:1788746681.067303:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8a4583eed800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788746681.067307:0:3642:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788746681.067321:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a4483591c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875636324104960:0@lo:38:ptlrpcd_00_02.0 00000100:00080000:3.0:1788746681.067332:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8a4482506000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788746681.067335:0:3642:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788746681.067338:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a4483590380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3642:1875636324105088:0@lo:38:ptlrpcd_00_02.0 00000100:00080000:2.0:1788746681.068428:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8a45a22f2800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788746681.068436:0:3643:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 547 00000100:00080000:2.0:1788746681.068448:0:3643:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8a45a22f2800 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:3.0:1788746681.069749:0:3643:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a45bca93100 x1875636324105216/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788746681.069785:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a448379e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3643:1875636324104448:0@lo:400:kworker.0 00000100:00100000:3.0:1788746681.069819:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a45bca93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3642:1875636324105216:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:3.0:1788746681.070578:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746681.070750:0:17058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324105216 00000100:00100000:3.0:1788746681.070758:0:17058:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324105216 00000100:00100000:3.0:1788746681.070802:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788746681.070809:0:17058:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a45bca93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3642:x1875636324105216:12345-0@lo:38:ptlrpcd_00_00.0 00010000:00020000:3.0:1788746681.070831:0:17058:0:(ldlm_lib.c:1202:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788746681.072084:0:17058:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a45bca93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3642:x1875636324105216:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 1269us (1503us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788746681.072096:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00080000:3.0:1788746681.072154:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8a45a22f2800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788746681.072158:0:3642:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788746681.072162:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a45bca93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3642:1875636324105216:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:0.0:1788746681.111261:0:18090:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4483cbd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3642:x1875636324104064:12345-0@lo:38:kworker.0 Request processed in 64743us (67264us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788746681.111277:0:18090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:2.0:1788746681.111643:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8a4483741000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788746681.111663:0:3642:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788746681.111668:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a448379ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1875636324104064:0@lo:38:kworker.0 00010000:00010000:0.0:1788746681.747523:0:17046:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788746682.761900:0:20831:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00010000:00010000:0.0:1788746682.778816:0:17047:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788746682.781188:0:20831:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-MDT0001 00010000:00010000:2.0:1788746682.781241:0:20831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.139@tcp lock: ffff8a45ae45fa00/0xfac36e8915413e31 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xfac36e8915413e38 expref: -99 pid: 17790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746682.781257:0:20831:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff8a45ae45fa00/0xfac36e8915413e31 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xfac36e8915413e38 expref: -99 pid: 17790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746682.781264:0:20831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff8a45ae45fa00/0xfac36e8915413e31 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xfac36e8915413e38 expref: -99 pid: 17790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746682.781271:0:20831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.139@tcp lock: ffff8a45ae45fa00/0xfac36e8915413e31 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xfac36e8915413e38 expref: -99 pid: 17790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746682.781310:0:20831:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788746682.781317:0:20831:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1788746682.781357:0:20831:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788746682.781362:0:20831:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:2.0:1788746682.781368:0:20831:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788746682.781374:0:20831:0:(import.c:65:import_set_state_nolock()) ffff8a4583eed800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:2.0:1788746682.781380:0:20831:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788746682.781381:0:20831:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788746682.781384:0:20831:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1788746682.781721:0:17046:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788746682.781730:0:17046:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.139@tcp lock: ffff8a45ae45fa00/0xfac36e8915413e31 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xfac36e8915413e38 expref: -99 pid: 17790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746682.781760:0:17046:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a45ae45fa00 already unused, calling callback (ffffffffc1180c20) 10000000:00010000:1.0:1788746682.781764:0:17046:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.139@tcp lock: ffff8a45ae45fa00/0xfac36e8915413e31 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xfac36e8915413e38 expref: -99 pid: 17790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746682.781774:0:17046:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.139@tcp lock: ffff8a45ae45fa00/0xfac36e8915413e31 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0xfac36e8915413e38 expref: -99 pid: 17790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788746682.781781:0:17046:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.139@tcp lock: ffff8a45ae45fa00/0xfac36e8915413e31 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0xfac36e8915413e38 expref: -99 pid: 17790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788746682.781787:0:17046:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788746682.781789:0:17046:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1788746682.781792:0:17046:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1788746682.781829:0:17046:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.139@tcp lock: ffff8a45ae45fa00/0xfac36e8915413e31 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xfac36e8915413e38 expref: -99 pid: 17790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746682.781836:0:17046:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788746682.781872:0:17046:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.139@tcp lock: ffff8a45ae45fa00/0xfac36e8915413e31 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xfac36e8915413e38 expref: -99 pid: 17790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746682.781879:0:17046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.139@tcp lock: ffff8a45ae45fa00/0xfac36e8915413e31 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xfac36e8915413e38 expref: -99 pid: 17790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746682.781892:0:17046:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788746682.781893:0:17046:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788746682.781896:0:17046:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788746682.781903:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788746682.781921:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a4483592300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7bf60f24-4000-471c-bcb3-0ae64e0e499e:3644:1875636324105344:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788746682.781980:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746682.782043:0:17044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324105344 00000100:00100000:1.0:1788746682.782051:0:17044:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324105344 00000100:00100000:1.0:1788746682.782099:0:17044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788746682.782106:0:17044:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4483590700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3644:x1875636324105344:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1788746682.782112:0:17044:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788746682 with bad export cookie 18069407664986733660 00010000:00010000:2.0:1788746682.782445:0:20831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.139@tcp lock: ffff8a4483ed7e00/0xfac36e8915413d90 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xfac36e8915413d97 expref: -99 pid: 17790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746682.782456:0:20831:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff8a4483ed7e00/0xfac36e8915413d90 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xfac36e8915413d97 expref: -99 pid: 17790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746682.782477:0:20831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff8a4483ed7e00/0xfac36e8915413d90 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xfac36e8915413d97 expref: -99 pid: 17790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746682.782484:0:20831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.139@tcp lock: ffff8a4483ed7e00/0xfac36e8915413d90 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xfac36e8915413d97 expref: -99 pid: 17790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746682.782498:0:20831:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788746682.782504:0:20831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.139@tcp lock: ffff8a4483ed6c00/0xfac36e8915414084 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfac36e891541408b expref: -99 pid: 17055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746682.782512:0:20831:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff8a4483ed6c00/0xfac36e8915414084 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xfac36e891541408b expref: -99 pid: 17055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746682.782519:0:20831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff8a4483ed6c00/0xfac36e8915414084 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xfac36e891541408b expref: -99 pid: 17055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746682.782526:0:20831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.139@tcp lock: ffff8a4483ed6c00/0xfac36e8915414084 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xfac36e891541408b expref: -99 pid: 17055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746682.782538:0:20831:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788746682.782543:0:20831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.139@tcp lock: ffff8a45ae45fc00/0xfac36e8915414221 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xfac36e8915414228 expref: -99 pid: 17055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746682.782551:0:20831:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff8a45ae45fc00/0xfac36e8915414221 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xfac36e8915414228 expref: -99 pid: 17055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746682.782557:0:20831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff8a45ae45fc00/0xfac36e8915414221 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xfac36e8915414228 expref: -99 pid: 17055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746682.782574:0:20831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.139@tcp lock: ffff8a45ae45fc00/0xfac36e8915414221 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xfac36e8915414228 expref: -99 pid: 17055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746682.783746:0:17047:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788746682.783755:0:17047:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.139@tcp lock: ffff8a4483ed7e00/0xfac36e8915413d90 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xfac36e8915413d97 expref: -99 pid: 17790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746682.783765:0:17047:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a4483ed7e00 already unused, calling callback (ffffffffc1180c20) 10000000:00010000:0.0:1788746682.783769:0:17047:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.139@tcp lock: ffff8a4483ed7e00/0xfac36e8915413d90 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xfac36e8915413d97 expref: -99 pid: 17790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746682.783777:0:17047:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.139@tcp lock: ffff8a4483ed7e00/0xfac36e8915413d90 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0xfac36e8915413d97 expref: -99 pid: 17790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788746682.783784:0:17047:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.139@tcp lock: ffff8a4483ed7e00/0xfac36e8915413d90 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0xfac36e8915413d97 expref: -99 pid: 17790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788746682.783790:0:17047:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788746682.783803:0:17047:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0001: stopping, won't requeue 00010000:00010000:0.0:1788746682.783832:0:17047:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.139@tcp lock: ffff8a4483ed7e00/0xfac36e8915413d90 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xfac36e8915413d97 expref: -99 pid: 17790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746682.783838:0:17047:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788746682.783867:0:17047:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.139@tcp lock: ffff8a4483ed7e00/0xfac36e8915413d90 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xfac36e8915413d97 expref: -99 pid: 17790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746682.783874:0:17047:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.139@tcp lock: ffff8a4483ed7e00/0xfac36e8915413d90 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xfac36e8915413d97 expref: -99 pid: 17790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746682.783887:0:17047:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788746682.783890:0:17047:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.139@tcp lock: ffff8a4483ed6c00/0xfac36e8915414084 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xfac36e891541408b expref: -99 pid: 17055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746682.783896:0:17047:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a4483ed6c00 already unused, calling callback (ffffffffc1180c20) 10000000:00010000:0.0:1788746682.783898:0:17047:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.139@tcp lock: ffff8a4483ed6c00/0xfac36e8915414084 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xfac36e891541408b expref: -99 pid: 17055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746682.783905:0:17047:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.139@tcp lock: ffff8a4483ed6c00/0xfac36e8915414084 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xfac36e891541408b expref: -99 pid: 17055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788746682.783911:0:17047:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.139@tcp lock: ffff8a4483ed6c00/0xfac36e8915414084 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xfac36e891541408b expref: -99 pid: 17055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788746682.783916:0:17047:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:0.0:1788746682.783918:0:17047:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:0.0:1788746682.783920:0:17047:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:0.0:1788746682.783932:0:17047:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.139@tcp lock: ffff8a4483ed6c00/0xfac36e8915414084 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xfac36e891541408b expref: -99 pid: 17055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746682.783938:0:17047:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788746682.783963:0:17047:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.139@tcp lock: ffff8a4483ed6c00/0xfac36e8915414084 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xfac36e891541408b expref: -99 pid: 17055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746682.783971:0:17047:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.139@tcp lock: ffff8a4483ed6c00/0xfac36e8915414084 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xfac36e891541408b expref: -99 pid: 17055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746682.783985:0:17047:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788746682.783987:0:17047:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788746682.783989:0:17047:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788746682.784000:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788746682.784014:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a4483cbd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7bf60f24-4000-471c-bcb3-0ae64e0e499e:3646:1875636324105600:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788746682.784079:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746682.784122:0:18212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324105600 00000100:00100000:0.0:1788746682.784129:0:18212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324105600 00000100:00100000:0.0:1788746682.784157:0:18212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788746682.784163:0:18212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4483cbc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3646:x1875636324105600:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1788746682.784168:0:18212:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788746682 with bad export cookie 18069407664986733660 00000100:00100000:0.0:1788746682.784208:0:18212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4483cbc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3646:x1875636324105600:12345-0@lo:103:ldlm_bl.0 Request processed in 43us (128us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788746682.784214:0:18212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788746682.784236:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788746682.784244:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a4483cbc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7bf60f24-4000-471c-bcb3-0ae64e0e499e:3643:1875636324105472:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788746682.784268:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746682.784307:0:18212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324105472 00000100:00100000:0.0:1788746682.784311:0:18212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324105472 00000100:00100000:0.0:1788746682.784337:0:18212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788746682.784341:0:18212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4483cbce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3643:x1875636324105472:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1788746682.784345:0:18212:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788746682 with bad export cookie 18069407664986733660 00000100:00100000:0.0:1788746682.784370:0:18212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4483cbce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3643:x1875636324105472:12345-0@lo:103:ldlm_bl.0 Request processed in 28us (102us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788746682.784381:0:18212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:0.0:1788746682.784407:0:3643:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.204.139@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1788746682.784411:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8a45b59a7000 MGS: changing import state from FULL to DISCONN 00000100:02020000:0.0:1788746682.784415:0:3643:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.204.139@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00010000:00010000:3.0:1788746682.785361:0:17046:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788746682.786752:0:20831:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788746682.786773:0:20831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.139@tcp lock: ffff8a4483ed6400/0xfac36e8915413d82 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfac36e8915413d89 expref: -99 pid: 17790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746682.786786:0:20831:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff8a4483ed6400/0xfac36e8915413d82 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xfac36e8915413d89 expref: -99 pid: 17790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746682.786794:0:20831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff8a4483ed6400/0xfac36e8915413d82 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xfac36e8915413d89 expref: -99 pid: 17790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746682.786801:0:20831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.139@tcp lock: ffff8a4483ed6400/0xfac36e8915413d82 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xfac36e8915413d89 expref: -99 pid: 17790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746682.786821:0:20831:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:2.0:1788746682.786826:0:20831:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0001 10000000:01000000:2.0:1788746682.786832:0:20831:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0001 (0) 00010000:00010000:3.0:1788746682.786839:0:17046:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788746682.786848:0:17046:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.139@tcp lock: ffff8a45ae45fc00/0xfac36e8915414221 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xfac36e8915414228 expref: -99 pid: 17055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746682.786871:0:17046:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a45ae45fc00 already unused, calling callback (ffffffffc1180c20) 00000020:01000004:2.0:1788746682.786875:0:20831:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-MDT0001 10000000:00010000:3.0:1788746682.786876:0:17046:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.139@tcp lock: ffff8a45ae45fc00/0xfac36e8915414221 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xfac36e8915414228 expref: -99 pid: 17055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000000:2.0:1788746682.786881:0:20831:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001 (flags='F') 00010000:00010000:3.0:1788746682.786886:0:17046:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.139@tcp lock: ffff8a45ae45fc00/0xfac36e8915414221 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xfac36e8915414228 expref: -99 pid: 17055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:2.0:1788746682.786888:0:20831:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788746682.786896:0:20831:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001: forcing exports to disconnect: 2/5 10000000:00010000:3.0:1788746682.786897:0:17046:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.139@tcp lock: ffff8a45ae45fc00/0xfac36e8915414221 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xfac36e8915414228 expref: -99 pid: 17055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788746682.786904:0:17046:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000020:00080000:2.0:1788746682.786906:0:20831:0:(genops.c:1818:print_export_data()) lustre-MDT0001: ACTIVE ffff8a45a8d35000 lustre-MDT0001-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 10000000:01000000:3.0:1788746682.786908:0:17046:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1788746682.786912:0:17046:0:(mgc_request.c:130:config_log_put()) dropping config log params 00000020:00080000:2.0:1788746682.786918:0:20831:0:(genops.c:1818:print_export_data()) lustre-MDT0001: ACTIVE ffff8a45bcb87000 lustre-MDT0001-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788746682.786924:0:20831:0:(genops.c:1552:class_disconnect_exports()) OBD device 14 (ffff8a45c0d98000) has exports, disconnecting them 00000020:00080000:2.0:1788746682.786930:0:20831:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff8a45a8d35000), last request at 1788746681 00000020:00000080:2.0:1788746682.786936:0:20831:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xfac36e8915414076 00000100:00080000:2.0:1788746682.786962:0:20831:0:(import.c:65:import_set_state_nolock()) ffff8a45a8d30800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1788746682.787464:0:20831:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8a45a8d35000): rc 0 00000020:00000080:2.0:1788746682.787468:0:20831:0:(genops.c:885:class_export_put()) final put ffff8a45a8d35000/lustre-MDT0001-lwp-OST0001_UUID 00000020:00080000:2.0:1788746682.787479:0:20831:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff8a45bcb87000), last request at 1788746681 00000020:00000080:2.0:1788746682.787484:0:20831:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xfac36e8915413f11 00000100:00080000:2.0:1788746682.787497:0:20831:0:(import.c:65:import_set_state_nolock()) ffff8a45bcb87800 : changing import state from FULL to CLOSED 00000020:00000080:2.0:1788746682.787510:0:14946:0:(genops.c:844:class_export_destroy()) destroying export ffff8a45a8d35000/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001 00000020:00000080:2.0:1788746682.787556:0:14946:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8a45a8d30800 for lustre-MDT0001 00000020:00080000:2.0:1788746682.787574:0:20831:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8a45bcb87000): rc 0 00000020:00000080:2.0:1788746682.787576:0:20831:0:(genops.c:885:class_export_put()) final put ffff8a45bcb87000/lustre-MDT0001-lwp-OST0000_UUID 00000004:00000080:2.0:1788746682.787587:0:20831:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=400866e7 len=0 karg=ffff9fe240d87ae0 00000020:00000080:2.0:1788746682.787597:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a45bcb87000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000020:00000080:2.0:1788746682.787618:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8a45bcb87800 for lustre-MDT0001 00000100:00080000:2.0:1788746682.787638:0:20831:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788746682.787648:0:20831:0:(client.c:3603:ptlrpc_abort_inflight()) @@@ aborting waiting req req@ffff8a4483590a80 x1875636324103552/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788746694 ref 1 fl Rpc:RSQU/200/0 rc -107/-107 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788746682.787659:0:20831:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:2.0:1788746682.788462:0:20831:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788746682.788468:0:20831:0:(import.c:65:import_set_state_nolock()) ffff8a4483741000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00010000:00010000:2.0:1788746682.788514:0:17047:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:1.0:1788746682.796944:0:17044:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4483590700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3644:x1875636324105344:12345-0@lo:103:ldlm_bl.0 Request processed in 14833us (14959us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788746682.796956:0:17044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:1.0:1788746682.798456:0:3644:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.204.139@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1788746682.806232:0:3643:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.204.139@tcp not replayable, auto-deactivating 00000100:00080000:0.0:1788746682.806238:0:3643:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1788746682.806247:0:3643:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8a448379f800 x1875636324103936/t0(0) o400->MGC192.168.204.139@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788746697 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788746682.806262:0:3643:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8a4483592300 x1875636324105344/t0(0) o103->MGC192.168.204.139@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788746698 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788746682.806273:0:3643:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8a4483cbd180 x1875636324105600/t0(0) o103->MGC192.168.204.139@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788746698 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788746682.806281:0:3643:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8a4483cbc000 x1875636324105472/t0(0) o103->MGC192.168.204.139@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788746698 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1788746682.806331:0:3643:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1788746682.806335:0:3643:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1788746682.806337:0:3643:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00010000:00010000:2.0:1788746682.806536:0:17046:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.139@tcp lock: ffff8a45ae45fc00/0xfac36e8915414221 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xfac36e8915414228 expref: -99 pid: 17055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746682.806547:0:17046:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788746682.806564:0:17046:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.139@tcp lock: ffff8a45ae45fc00/0xfac36e8915414221 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xfac36e8915414228 expref: -99 pid: 17055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746682.806571:0:17046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.139@tcp lock: ffff8a45ae45fc00/0xfac36e8915414221 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xfac36e8915414228 expref: -99 pid: 17055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746682.806604:0:17046:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788746682.806607:0:17046:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788746682.806609:0:17046:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788746682.806932:0:3644:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff8a45b59a7000 already not connected (conn 1, was 1): DISCONN 00000100:00080000:0.0:1788746682.806941:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8a45b59a7000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788746682.806948:0:3643:0:(import.c:545:import_select_connection()) MGC192.168.204.139@tcp: connect to NID 0@lo last attempt 517 00000100:00100000:1.0:1788746682.806955:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a4483592300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7bf60f24-4000-471c-bcb3-0ae64e0e499e:3644:1875636324105344:0@lo:103:ldlm_bl.0 00000100:00080000:0.0:1788746682.807128:0:3643:0:(import.c:666:import_select_connection()) MGC192.168.204.139@tcp: import ffff8a45b59a7000 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:1.0:1788746682.807205:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788746682.807217:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a45bca93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7bf60f24-4000-471c-bcb3-0ae64e0e499e:0:1875636324105728:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788746682.807394:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a4483cbd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7bf60f24-4000-471c-bcb3-0ae64e0e499e:3646:1875636324105600:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788746682.807402:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a4483590a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875636324103552:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788746682.807609:0:3643:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a4483cbd180 x1875636324105856/t0(0) o250->MGC192.168.204.139@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788746682.807644:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a448379f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7bf60f24-4000-471c-bcb3-0ae64e0e499e:3643:1875636324103936:0@lo:400:kworker.0 00000100:00100000:0.0:1788746682.807676:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a4483cbc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7bf60f24-4000-471c-bcb3-0ae64e0e499e:3643:1875636324105472:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788746682.807738:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a4483cbd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:7bf60f24-4000-471c-bcb3-0ae64e0e499e:3642:1875636324105856:0@lo:250:ptlrpcd_00_00.0 00000400:00000100:1.0:1788746682.807787:0:3642:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875636324105856 offset 0 length 520: 4 00010000:00010000:3.0:1788746682.807883:0:20832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788746682.807886:0:20832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788746682.807888:0:20832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788746682.807924:0:17047:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.139@tcp lock: ffff8a4483ed6400/0xfac36e8915413d82 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xfac36e8915413d89 expref: -99 pid: 17790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746682.807934:0:17047:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a4483ed6400 already unused, calling callback (ffffffffc1180c20) 10000000:00010000:0.0:1788746682.807938:0:17047:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.139@tcp lock: ffff8a4483ed6400/0xfac36e8915413d82 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xfac36e8915413d89 expref: -99 pid: 17790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746682.807947:0:17047:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.139@tcp lock: ffff8a4483ed6400/0xfac36e8915413d82 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xfac36e8915413d89 expref: -99 pid: 17790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788746682.807953:0:17047:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.139@tcp lock: ffff8a4483ed6400/0xfac36e8915413d82 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xfac36e8915413d89 expref: -99 pid: 17790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788746682.807970:0:17047:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:0.0:1788746682.807972:0:17047:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:0.0:1788746682.807975:0:17047:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:0.0:1788746682.807988:0:17047:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8a45b59a7000 00010000:00010000:0.0:1788746682.807991:0:17047:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.139@tcp lock: ffff8a4483ed6400/0xfac36e8915413d82 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xfac36e8915413d89 expref: -99 pid: 17790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746682.807999:0:17047:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.139@tcp lock: ffff8a4483ed6400/0xfac36e8915413d82 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xfac36e8915413d89 expref: -99 pid: 17790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746682.808014:0:17047:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788746682.808016:0:17047:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788746682.808018:0:17047:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788746682.808498:0:20831:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788746682.808503:0:20831:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 3 00000004:00080000:2.0:1788746682.808524:0:20831:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1788746682.808591:0:20831:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:2.0:1788746682.808609:0:20831:0:(import.c:65:import_set_state_nolock()) ffff8a45bd7bb800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:2.0:1788746682.808628:0:20831:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788746682.808630:0:20831:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 3 00000100:00100000:1.0:1788746682.808662:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a45b7ef1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1875636324105984:0@lo:9:umount.0 00000004:00080000:2.0:1788746682.808674:0:20831:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788746682.808716:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788746682.808737:0:20831:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:2.0:1788746682.808749:0:20831:0:(import.c:65:import_set_state_nolock()) ffff8a4483126000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1788746682.808770:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a4482713100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1875636324106112:0@lo:9:umount.0 00000020:00080000:2.0:1788746682.808793:0:20831:0:(genops.c:1557:class_disconnect_exports()) OBD device 14 (ffff8a45c0d98000) has no exports 00000100:00100000:1.0:1788746682.808801:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746682.808840:0:18565:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324105984 00000100:00100000:1.0:1788746682.808848:0:18565:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324105984 00000100:00100000:3.0:1788746682.808860:0:18566:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324106112 00000100:00100000:3.0:1788746682.808866:0:18566:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324106112 00000100:00100000:1.0:1788746682.808904:0:18565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788746682.808915:0:18565:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4483592300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1875636324105984:12345-0@lo:9:umount.0 00000020:00000080:1.0:1788746682.808941:0:18565:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xfac36e8915413f3b 00000100:00080000:1.0:1788746682.808951:0:18565:0:(import.c:65:import_set_state_nolock()) ffff8a4482023800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788746682.809010:0:18565:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:3.0:1788746682.809161:0:18566:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788746682.809170:0:18566:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4483593480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1875636324106112:12345-0@lo:9:umount.0 00000020:00000080:3.0:1788746682.809183:0:18566:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xfac36e89154140a7 00000100:00080000:3.0:1788746682.809189:0:18566:0:(import.c:65:import_set_state_nolock()) ffff8a45b7f9b000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788746682.809221:0:18566:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934600 00000100:00100000:3.0:1788746682.809465:0:18566:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4483593480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+2:3642:x1875636324106112:12345-0@lo:9:umount.0 Request processed in 296us (663us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746682.809473:0:18566:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00010000:3.0:1788746682.809492:0:20832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788746682.811483:0:18565:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4483592300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+2:3642:x1875636324105984:12345-0@lo:9:umount.0 Request processed in 2563us (2760us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746682.811574:0:18565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:1.0:1788746682.811891:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8a4483126000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1788746682.812413:0:3642:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1788746682.812422:0:3642:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788746682.812429:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a4482713100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1875636324106112:0@lo:9:umount.0 00000100:00080000:1.0:1788746682.812449:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8a45bd7bb800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1788746682.812509:0:3642:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1788746682.812651:0:3642:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788746682.812657:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a45b7ef1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1875636324105984:0@lo:9:umount.0 00010000:00010000:1.0:1788746682.812693:0:17046:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788746682.813512:0:19379:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1788746682.813519:0:19379:0:(genops.c:885:class_export_put()) final put ffff8a45b7f9f000/lustre-MDT0001-mdtlov_UUID 00000001:00100000:2.0:1788746682.813542:0:19379:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788746682.813545:0:19379:0:(genops.c:885:class_export_put()) final put ffff8a459fb0e800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788746682.813589:0:14946:0:(genops.c:844:class_export_destroy()) destroying export ffff8a45b7f9f000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001 00000020:00000080:3.0:1788746682.813649:0:14946:0:(genops.c:844:class_export_destroy()) destroying export ffff8a459fb0e800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:3.0:1788746682.813672:0:14946:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8a45b7f9b000 for lustre-OST0001 00000020:00000080:3.0:1788746682.813677:0:14946:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8a4483744800 for lustre-OST0001 00000001:00100000:1.0:1788746682.813735:0:18561:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1788746682.813739:0:18561:0:(genops.c:885:class_export_put()) final put ffff8a4482023000/lustre-MDT0001-mdtlov_UUID 00000001:00100000:1.0:1788746682.813762:0:18561:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788746682.813764:0:18561:0:(genops.c:885:class_export_put()) final put ffff8a45b7ed9000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788746682.813814:0:14946:0:(genops.c:844:class_export_destroy()) destroying export ffff8a4482023000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:3.0:1788746682.813845:0:14946:0:(genops.c:844:class_export_destroy()) destroying export ffff8a45b7ed9000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:3.0:1788746682.813861:0:14946:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8a4482023800 for lustre-OST0000 00000020:00000080:3.0:1788746682.813865:0:14946:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8a45b7edf000 for lustre-OST0000 00000020:00080000:0.0:1788746682.814450:0:20831:0:(genops.c:1557:class_disconnect_exports()) OBD device 14 (ffff8a45c0d98000) has no exports 00000020:01000000:1.0:1788746682.857268:0:20831:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8a45b592aae0 - data ffff8a45c120b510/ffff8a4483263400 00000020:01000000:0.0:1788746682.857518:0:20831:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8a45bd699000 - data ffff8a45c1086ca8/ffff8a4584780000 00000001:00000004:1.0:1788746682.872567:0:20831:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934595 00000100:00080000:2.0:1788746682.913994:0:20831:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788746682.914004:0:20831:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788746682.914012:0:20831:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:2.0:1788746682.915790:0:20831:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788746682.915796:0:20831:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 4 00000004:00080000:2.0:1788746682.915816:0:20831:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788746682.915818:0:20831:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1788746682.916419:0:17799:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1788746682.916424:0:17799:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 1 count 1 00000040:00080000:0.0:1788746682.916434:0:17799:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 2 count 2 00000100:00080000:2.0:1788746682.918672:0:20831:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788746682.918680:0:20831:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 4 00000004:00080000:2.0:1788746682.918699:0:20831:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788746682.918714:0:20831:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1788746682.919227:0:17801:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1788746682.919232:0:17801:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 1 count 1 00000040:00080000:3.0:1788746682.919244:0:17801:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 2 count 2 00000020:00000080:2.0:1788746682.921581:0:20831:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xfac36e8915413da5 00000020:00000080:2.0:1788746682.921593:0:20831:0:(genops.c:885:class_export_put()) final put ffff8a4483769800/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1788746682.921874:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a4483769800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1788746682.925980:0:20831:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xfac36e8915413dba 00000020:00000080:3.0:1788746682.925994:0:20831:0:(genops.c:885:class_export_put()) final put ffff8a4483746000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:3.0:1788746682.926011:0:20831:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-mdtlov (flags='') 00000020:00000080:3.0:1788746682.926017:0:20831:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788746682.926026:0:20831:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788746682.926031:0:20831:0:(genops.c:1557:class_disconnect_exports()) OBD device 13 (ffff8a45bdd799c0) has no exports 00000004:01000000:3.0:1788746682.926207:0:20831:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:3.0:1788746682.926218:0:20831:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xfac36e8915413e0e 00000020:00000080:3.0:1788746682.926223:0:20831:0:(genops.c:885:class_export_put()) final put ffff8a45b7e40000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:3.0:1788746682.926227:0:20831:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0001 (flags='') 00000020:00000080:3.0:1788746682.926232:0:20831:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788746682.926236:0:20831:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788746682.926239:0:20831:0:(genops.c:1557:class_disconnect_exports()) OBD device 18 (ffff8a45bdd78000) has no exports 00000020:00000080:3.0:1788746682.926245:0:20831:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xfac36e8915413e07 00000020:00000080:3.0:1788746682.926249:0:20831:0:(genops.c:885:class_export_put()) final put ffff8a4483122800/lustre-MDT0001-osd_UUID 00010000:01000000:3.0:1788746682.926624:0:20831:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0001: client import never connected 00000100:00080000:3.0:1788746682.926629:0:20831:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1788746682.926633:0:20831:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 5 00000004:00080000:3.0:1788746682.926639:0:20831:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788746682.926653:0:20831:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788746682.926690:0:20831:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788746682.926697:0:20831:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788746682.926704:0:20831:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xfac36e8915413df9 00000020:00000080:3.0:1788746682.926708:0:20831:0:(genops.c:885:class_export_put()) final put ffff8a4483124800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:3.0:1788746682.926712:0:20831:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0001 (flags='') 00000020:00000080:3.0:1788746682.926716:0:20831:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788746682.926719:0:20831:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788746682.926722:0:20831:0:(genops.c:1557:class_disconnect_exports()) OBD device 17 (ffff8a45872999c0) has no exports 00000020:00000080:3.0:1788746682.926726:0:20831:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xfac36e8915413deb 00000020:00000080:3.0:1788746682.926729:0:20831:0:(genops.c:885:class_export_put()) final put ffff8a45bd7b8000/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1788746682.926918:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a4483746000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:00000080:0.0:1788746682.926927:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a45b7e40000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:00000080:0.0:1788746682.926932:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a4483122800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:0.0:1788746682.926937:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8a4483126000 for lustre-OST0001-osc-MDT0001 00000020:00000080:0.0:1788746682.926943:0:8:0:(genops.c:885:class_export_put()) final put ffff8a4483127000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1788746682.926945:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a4483127000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:01000000:0.0:1788746682.926949:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00010000:01000000:3.0:1788746682.927041:0:20831:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0001: client import never connected 00000020:00000080:0.0:1788746682.927041:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a4483124800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000100:00080000:3.0:1788746682.927044:0:20831:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000020:00000080:0.0:1788746682.927045:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a45bd7b8000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000100:00100000:3.0:1788746682.927046:0:20831:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 5 00000004:00080000:3.0:1788746682.927050:0:20831:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788746682.927051:0:20831:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788746682.927070:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8a45bd7bb800 for lustre-OST0000-osc-MDT0001 00000020:00000080:3.0:1788746682.927080:0:20831:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788746682.927085:0:20831:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788746682.927088:0:20831:0:(genops.c:885:class_export_put()) final put ffff8a448376a000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788746682.927090:0:20831:0:(genops.c:844:class_export_destroy()) destroying export ffff8a448376a000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:01000000:3.0:1788746682.927094:0:20831:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000004:01000000:3.0:1788746682.927142:0:20831:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:3.0:1788746682.927148:0:20831:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xfac36e8915413ddd 00000020:00000080:3.0:1788746682.927152:0:20831:0:(genops.c:885:class_export_put()) final put ffff8a4483746800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:3.0:1788746682.927167:0:20831:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osp-MDT0001 (flags='F') 00000020:00000080:3.0:1788746682.927170:0:20831:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788746682.927174:0:20831:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osp-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788746682.927177:0:20831:0:(genops.c:1557:class_disconnect_exports()) OBD device 16 (ffff8a458729cd40) has no exports 00000020:00000080:3.0:1788746682.927181:0:20831:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xfac36e8915413dd6 00000020:00000080:3.0:1788746682.927184:0:20831:0:(genops.c:885:class_export_put()) final put ffff8a4483744000/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1788746682.927283:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a4483746800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:00000080:0.0:1788746682.927304:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a4483744000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:2.0:1788746682.931416:0:20831:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-osp-MDT0001: client import never connected 00000100:00080000:2.0:1788746682.931425:0:20831:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788746682.931429:0:20831:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788746682.931437:0:20831:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788746682.931497:0:20831:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788746682.931509:0:20831:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1788746682.931532:0:20831:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788746682.931536:0:20831:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1788746682.931541:0:20831:0:(genops.c:885:class_export_put()) final put ffff8a45bc9b5000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1788746682.931545:0:20831:0:(genops.c:844:class_export_destroy()) destroying export ffff8a45bc9b5000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:2.0:1788746682.931556:0:20831:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-mdtlov (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1788746682.931789:0:20831:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xfac36e8915413dc1 00000020:00000080:2.0:1788746682.931796:0:20831:0:(genops.c:885:class_export_put()) final put ffff8a4483740000/lustre-MDD0001_UUID 00000020:01000000:2.0:1788746682.931802:0:20831:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0001 (flags='') 00000020:00000080:2.0:1788746682.931805:0:20831:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788746682.931810:0:20831:0:(obd_config.c:956:class_cleanup()) lustre-MDD0001: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788746682.931814:0:20831:0:(genops.c:1557:class_disconnect_exports()) OBD device 15 (ffff8a45c0d9b380) has no exports 00000020:00000080:2.0:1788746682.931831:0:20831:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788746682.931834:0:20831:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000020:00000080:2.0:1788746682.931839:0:20831:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xfac36e8915413dc8 00000020:00000080:2.0:1788746682.931843:0:20831:0:(genops.c:885:class_export_put()) final put ffff8a4483747800/lustre-MDT0001-osd_UUID 00000020:01000004:2.0:1788746682.931851:0:20831:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8a45bc9b2000 from lustre-MDT0001, refs=2 00000020:01000004:2.0:1788746682.931854:0:20831:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8a45bc9b2000 2 00000020:01000004:2.0:1788746682.931857:0:20831:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8a45bc9b2000 from lustre-MDT0001 00000020:00000080:2.0:1788746682.931875:0:20831:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788746682.931878:0:20831:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:00000080:2.0:1788746682.931880:0:20831:0:(genops.c:885:class_export_put()) final put ffff8a448376c800/lustre-MDT0001_UUID 00000020:00000080:2.0:1788746682.931882:0:20831:0:(genops.c:844:class_export_destroy()) destroying export ffff8a448376c800/lustre-MDT0001_UUID for lustre-MDT0001 00000020:01000000:2.0:1788746682.931889:0:20831:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001 (lustre-MDT0001_UUID) 00000020:01000004:2.0:1788746682.931929:0:20831:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000000:2.0:1788746682.931932:0:20831:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0001 (flags='F') 00000020:00000080:2.0:1788746682.931935:0:20831:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788746682.931939:0:20831:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0001: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788746682.931946:0:20831:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-MDT0001: ACTIVE ffff8a45b0c1e800 lustre-MDT0000-lwp-MDT0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788746682.931951:0:20831:0:(genops.c:1552:class_disconnect_exports()) OBD device 19 (ffff8a45bdd7cd40) has exports, disconnecting them 00000020:00080000:2.0:1788746682.931955:0:20831:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0001: disconnecting export at 0@lo (ffff8a45b0c1e800), last request at 1788746601 00000020:00000080:2.0:1788746682.931959:0:20831:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xfac36e8915413e46 00000020:00080000:2.0:1788746682.931972:0:20831:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8a45b0c1e800): rc 0 00000020:00000080:2.0:1788746682.931975:0:20831:0:(genops.c:885:class_export_put()) final put ffff8a45b0c1e800/lustre-MDT0000-lwp-MDT0001 00000020:00000080:0.0:1788746682.932686:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8a4483741000 for lustre-MDT0000-osp-MDT0001 00000020:00000080:0.0:1788746682.932697:0:8:0:(genops.c:885:class_export_put()) final put ffff8a4483740800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1788746682.932699:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a4483740800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:01000000:0.0:1788746682.932705:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osp-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788746682.932799:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a4483740000/lustre-MDD0001_UUID for lustre-MDD0001 00000020:00000080:0.0:1788746682.932803:0:8:0:(genops.c:885:class_export_put()) final put ffff8a4483768000/lustre-MDD0001_UUID 00000020:00000080:0.0:1788746682.932805:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a4483768000/lustre-MDD0001_UUID for lustre-MDD0001 00000020:01000000:0.0:1788746682.932808:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0001 (lustre-MDD0001_UUID) 00000020:00000080:0.0:1788746682.932912:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a4483747800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:0.0:1788746682.932916:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a45b0c1e800/lustre-MDT0000-lwp-MDT0001 for lustre-MDT0000-lwp-MDT0001 00010000:01000000:0.0:1788746682.947401:0:20831:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0001: client import never connected 00000100:00080000:0.0:1788746682.947410:0:20831:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788746682.947425:0:20831:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788746682.947432:0:20831:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788746682.947461:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8a4583eed800 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:0.0:1788746682.947674:0:20831:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788746682.947683:0:20831:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000020:00000080:0.0:1788746682.947689:0:20831:0:(genops.c:885:class_export_put()) final put ffff8a45912b3000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00000080:0.0:1788746682.947692:0:20831:0:(genops.c:844:class_export_destroy()) destroying export ffff8a45912b3000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000-lwp-MDT0001 00000020:01000000:0.0:1788746682.947701:0:20831:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0001 (lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000004:0.0:1788746682.947779:0:20831:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8a45bc9b2000 1 00000020:00000080:0.0:1788746682.947785:0:20831:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xfac36e8915413d6d 00000020:00000080:0.0:1788746682.947797:0:20831:0:(genops.c:885:class_export_put()) final put ffff8a45a8d01800/lustre-MDT0001-osd_UUID 00000020:01000000:0.0:1788746682.947812:0:20831:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osd (flags='') 00000020:00000080:0.0:1788746682.947820:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a45a8d01800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:0.0:1788746682.947830:0:20831:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788746682.947835:0:20831:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788746682.947839:0:20831:0:(genops.c:1557:class_disconnect_exports()) OBD device 12 (ffff8a44824019c0) has no exports 00000020:00000080:0.0:1788746683.009108:0:20831:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788746683.009125:0:20831:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00000020:00000080:0.0:1788746683.009132:0:20831:0:(genops.c:885:class_export_put()) final put ffff8a45bc9b6000/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1788746683.009136:0:20831:0:(genops.c:844:class_export_destroy()) destroying export ffff8a45bc9b6000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:0.0:1788746683.009148:0:20831:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osd (lustre-MDT0001-osd_UUID) 00000020:01000004:0.0:1788746683.009273:0:20831:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8a45bc9b2800 00000020:01000000:0.0:1788746683.009545:0:20831:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:0.0:1788746683.009551:0:20831:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788746683.009555:0:20831:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788746683.009559:0:20831:0:(genops.c:1557:class_disconnect_exports()) OBD device 3 (ffff8a45b7ea99c0) has no exports 00000100:00100000:2.0:1788746683.010020:0:17059:0:(service.c:3188:ptlrpc_main()) mdt00_001: service thread [ffff8a45a90c4400:17059] 1 exiting: rc = 0 00000100:00100000:3.0:1788746683.010028:0:19851:0:(service.c:3188:ptlrpc_main()) mdt00_003: service thread [ffff8a4483149600:19851] 3 exiting: rc = 0 00000100:00100000:1.0:1788746683.010106:0:17060:0:(service.c:3188:ptlrpc_main()) mdt00_002: service thread [ffff8a45a90c5c00:17060] 2 exiting: rc = 0 00000100:00100000:3.0:1788746683.010224:0:17058:0:(service.c:3188:ptlrpc_main()) mdt00_000: service thread [ffff8a45a92c4400:17058] 0 exiting: rc = 1 00000100:00100000:0.0:1788746683.010444:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788746683.010919:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788746683.010925:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788746683.010930:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788746683.010935:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788746683.010949:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788746683.010955:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788746683.010961:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788746683.010966:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788746683.010971:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788746683.010977:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788746683.010982:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788746683.010989:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788746683.010996:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788746683.011002:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788746683.011008:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788746683.011015:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788746683.011021:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788746683.011027:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788746683.011033:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788746683.011039:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788746683.011044:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788746683.011049:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788746683.011055:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788746683.011061:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788746683.011067:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788746683.011072:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788746683.011077:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788746683.011082:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788746683.011086:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788746683.011092:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788746683.011097:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788746683.011102:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788746683.011106:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788746683.011178:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788746683.011184:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788746683.011190:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788746683.011197:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788746683.011204:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788746683.011209:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788746683.011222:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788746683.011228:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788746683.011233:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788746683.011238:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788746683.011246:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788746683.011251:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788746683.011256:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788746683.011261:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788746683.011266:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788746683.011272:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788746683.011277:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788746683.011282:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788746683.011308:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788746683.011315:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788746683.011333:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788746683.011339:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788746683.011345:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788746683.011354:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788746683.011358:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788746683.011364:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788746683.011368:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788746683.011373:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788746683.011378:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788746683.011383:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746683.017648:0:17062:0:(service.c:3188:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff8a45bc973200:17062] 1 exiting: rc = 0 00000100:00100000:3.0:1788746683.017760:0:17061:0:(service.c:3188:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff8a45bc973800:17061] 0 exiting: rc = 1 00000100:00100000:1.0:1788746683.017832:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.017840:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.017847:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.017853:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.017858:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.017863:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.017868:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.017874:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.017880:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.017885:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.017901:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.017906:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.017912:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.017917:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.017922:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.017927:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.017933:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.017938:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.017944:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.017949:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.017956:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.017961:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.017965:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.017971:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.017977:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.017983:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.017988:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.017993:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.017999:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.018004:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.018009:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.018014:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.018019:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.018024:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.018029:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.018034:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.018039:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.018044:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.018050:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.018054:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.018059:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.018064:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.018069:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.018074:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.018079:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.018090:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.018095:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.018100:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.018104:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.018109:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.018127:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.018132:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.018138:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.018143:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.018148:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.018153:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.018159:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.018164:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.018169:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.018174:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.018180:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.018185:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.018190:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.018195:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.018637:0:17064:0:(service.c:3188:ptlrpc_main()) mdt_out00_001: service thread [ffff8a45bc973400:17064] 1 exiting: rc = 0 00000100:00100000:1.0:1788746683.018714:0:18090:0:(service.c:3188:ptlrpc_main()) mdt_out00_002: service thread [ffff8a45845f6600:18090] 2 exiting: rc = 0 00000100:00100000:2.0:1788746683.019134:0:17063:0:(service.c:3188:ptlrpc_main()) mdt_out00_000: service thread [ffff8a44822e5a00:17063] 0 exiting: rc = 1 00000100:00100000:1.0:1788746683.020731:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.020739:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.020745:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.020762:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.020785:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.020791:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.020798:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.020819:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.020825:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.020832:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.020837:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.020843:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.020848:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.020854:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.020871:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.020890:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.020896:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.020902:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.020923:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.020930:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.020936:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.020942:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.020960:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.020967:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.020973:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.020979:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.020997:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.021032:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.021039:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.021046:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.021063:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.021069:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.021075:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.021081:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.021098:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.021106:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.021122:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.021139:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.021146:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.021179:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.021186:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.021193:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.021199:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.021207:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.021215:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.021257:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.021282:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.021327:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.021348:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.021362:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.021368:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.021391:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.021398:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.021404:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.021410:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.021416:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.021421:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.021427:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.021434:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.021454:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.021497:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.021505:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.021533:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.021562:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746683.030640:0:17065:0:(service.c:3188:ptlrpc_main()) mdt_seqs_0000: service thread [ffff8a45bc972c00:17065] 0 exiting: rc = 1 00000100:00100000:0.0:1788746683.030756:0:17066:0:(service.c:3188:ptlrpc_main()) mdt_seqs_0001: service thread [ffff8a45c0cbba00:17066] 1 exiting: rc = 0 00000100:00100000:1.0:1788746683.030814:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.030821:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.030826:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.030832:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.030841:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.030846:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.030852:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.030857:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.030862:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.030868:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.030873:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.030879:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.030889:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.030894:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.030899:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.030904:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.030909:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.030913:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.030918:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.030922:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.030941:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.030945:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.030950:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.030954:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.030958:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.030963:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.030968:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.030972:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.030977:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.030983:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.030988:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.030993:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.030999:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.031004:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.031009:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.031015:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.031020:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.031025:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.031030:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.031036:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.031041:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.031046:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.031052:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.031057:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.031062:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.031067:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.031072:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.031077:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.031082:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.031087:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.031092:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.031097:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.031101:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.031106:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.031112:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.031125:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.031130:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.031135:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.031140:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.031144:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.031149:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.031154:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.031160:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.031165:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746683.031641:0:17068:0:(service.c:3188:ptlrpc_main()) mdt_seqm_0001: service thread [ffff8a45c0cbb200:17068] 1 exiting: rc = 0 00000100:00100000:2.0:1788746683.031742:0:17067:0:(service.c:3188:ptlrpc_main()) mdt_seqm_0000: service thread [ffff8a45c0cba000:17067] 0 exiting: rc = 1 00000100:00100000:0.0:1788746683.031825:0:20199:0:(service.c:3188:ptlrpc_main()) mdt_seqm_0002: service thread [ffff8a4483e4fe00:20199] 2 exiting: rc = 0 00000100:00100000:1.0:1788746683.031926:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.031933:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.031938:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.031943:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.031948:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.031954:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.031959:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.031965:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.031970:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.031976:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.031981:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.031986:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.031991:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.031996:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.032002:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.032006:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.032012:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.032017:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.032023:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.032028:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.032032:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.032038:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.032042:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.032048:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.032053:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.032058:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.032071:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.032076:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.032081:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.032086:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.032091:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.032096:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.032101:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.032106:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.032112:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.032117:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.032122:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.032127:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.032132:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.032136:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.032142:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.032146:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.032151:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.032156:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.032162:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.032167:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.032172:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.032177:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.032181:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.032186:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.032192:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.032197:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.032202:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.032206:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.032212:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.032216:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.032222:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.032226:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.032231:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.032236:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.032241:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.032254:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.032258:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.032263:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746683.035335:0:17070:0:(service.c:3188:ptlrpc_main()) mdt_fld_0001: service thread [ffff8a45c0cbbc00:17070] 1 exiting: rc = 0 00000100:00100000:2.0:1788746683.035366:0:17069:0:(service.c:3188:ptlrpc_main()) mdt_fld_0000: service thread [ffff8a45c0cbae00:17069] 0 exiting: rc = 1 00000100:00100000:1.0:1788746683.035498:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.035506:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.035512:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.035518:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.035523:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.035529:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.035534:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.035539:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.035544:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.035550:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.035556:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.035561:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.035567:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.035575:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.035584:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.035592:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.035598:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.035603:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.035607:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.035612:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.035686:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.035695:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.035700:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.035705:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.035710:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.035715:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.035720:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.035725:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.035730:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.035736:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.035741:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.035746:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.035764:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.035770:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.035776:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.035782:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.035788:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.035793:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.035798:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.035803:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.035807:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.035811:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.035817:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.035822:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.035827:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.035832:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.035838:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.035843:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.035847:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.035852:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.035857:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.035863:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.035868:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.035874:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.035879:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.035884:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.035888:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.035892:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.035897:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.035901:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.035906:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.035911:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.035916:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.035920:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788746683.036530:0:17073:0:(service.c:3188:ptlrpc_main()) mdt_io00_002: service thread [ffff8a4483596800:17073] 2 exiting: rc = 0 00000100:00100000:3.0:1788746683.036564:0:17072:0:(service.c:3188:ptlrpc_main()) mdt_io00_001: service thread [ffff8a44836e2800:17072] 1 exiting: rc = 0 00000100:00100000:2.0:1788746683.036810:0:17071:0:(service.c:3188:ptlrpc_main()) mdt_io00_000: service thread [ffff8a4483347c00:17071] 0 exiting: rc = 1 00000100:00100000:1.0:1788746683.036868:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.036877:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.036884:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.036898:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.036903:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.036909:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.036915:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.036922:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.036930:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.036937:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.036950:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.036957:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.036963:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.037114:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.037122:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.037143:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.037150:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.037155:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.037160:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.037165:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.037170:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.037176:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.037183:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.037192:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.037202:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.037211:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.037216:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.037222:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.037227:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.037233:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.037239:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.037245:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.037251:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.037256:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.037262:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.037267:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.037273:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.037279:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.037313:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.037347:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.037354:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.037358:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.037364:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.037369:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.037374:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.037380:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.037386:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.037392:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.037397:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.037402:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.037408:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.037413:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.037419:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.037425:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.037434:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.037441:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.037447:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.037453:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.037460:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.037466:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.037472:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.037478:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.037485:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788746683.037490:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1788746683.041519:0:20831:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788746683.041532:0:20831:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:1.0:1788746683.041538:0:20831:0:(genops.c:885:class_export_put()) final put ffff8a45b59a2000/MDS_uuid 00000020:00000080:1.0:1788746683.041542:0:20831:0:(genops.c:844:class_export_destroy()) destroying export ffff8a45b59a2000/MDS_uuid for MDS 00000020:01000000:1.0:1788746683.041551:0:20831:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:1.0:1788746683.041719:0:20831:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-MDT0001 complete 00010000:00010000:2.0:1788746683.795511:0:17047:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788746684.820417:0:20832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788746685.842991:0:17046:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788746686.162441:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 7bf60f24-4000-471c-bcb3-0ae64e0e499e->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788746686.162451:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) 7bf60f24-4000-471c-bcb3-0ae64e0e499e->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788746686.162454:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788746686.162467:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788746686.162472:0:8:0:(import.c:65:import_set_state_nolock()) ffff8a45a22f2800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788746686.162481:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 610 00000100:00080000:2.0:1788746686.162488:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788746686.162501:0:8:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8a45a22f2800 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:2.0:1788746686.162551:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a4482712d80 x1875636324106240/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788746686.162628:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a4482712d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3642:1875636324106240:0@lo:38:kworker.0 00000400:00000100:3.0:1788746686.162678:0:3642:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875636324106240 offset 0 length 520: 4 00000100:00080000:2.0:1788746686.162898:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788746686.162916:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788746686.162918:0:8:0:(import.c:65:import_set_state_nolock()) ffff8a4482506000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788746686.162922:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 610 00000100:00080000:2.0:1788746686.162925:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788746686.162930:0:8:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8a4482506000 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:2.0:1788746686.162945:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a4482711c00 x1875636324106496/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788746686.162991:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a4482712300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3643:1875636324106368:0@lo:400:kworker.0 00000400:00000100:0.0:1788746686.163015:0:3643:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875636324106368 offset 0 length 224: 4 00000100:00100000:3.0:1788746686.163513:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a4482711c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3642:1875636324106496:0@lo:38:kworker.0 00000400:00000100:3.0:1788746686.163538:0:3642:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875636324106496 offset 0 length 520: 4 00000100:00100000:1.0:1788746686.163908:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a45bca90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3644:1875636324106624:0@lo:400:kworker.0 00000400:00000100:1.0:1788746686.163934:0:3644:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875636324106624 offset 0 length 224: 4 00000020:01000004:3.0:1788746686.680626:0:21033:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:3.0:1788746686.703827:0:21033:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-OST0000 00010000:00010000:3.0:1788746686.703885:0:21033:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.139@tcp lock: ffff8a44825c3a00/0xfac36e8915413ee0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xfac36e8915413ee7 expref: -99 pid: 18560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746686.703902:0:21033:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff8a44825c3a00/0xfac36e8915413ee0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xfac36e8915413ee7 expref: -99 pid: 18560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746686.703910:0:21033:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff8a44825c3a00/0xfac36e8915413ee0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xfac36e8915413ee7 expref: -99 pid: 18560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746686.703918:0:21033:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.139@tcp lock: ffff8a44825c3a00/0xfac36e8915413ee0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xfac36e8915413ee7 expref: -99 pid: 18560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746686.703947:0:21033:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788746686.703953:0:21033:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1788746686.703982:0:21033:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00010000:00010000:2.0:1788746686.703984:0:17047:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788746686.703994:0:17047:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.139@tcp lock: ffff8a44825c3a00/0xfac36e8915413ee0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xfac36e8915413ee7 expref: -99 pid: 18560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746686.704003:0:17047:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a44825c3a00 already unused, calling callback (ffffffffc1180c20) 10000000:00010000:2.0:1788746686.704007:0:17047:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.139@tcp lock: ffff8a44825c3a00/0xfac36e8915413ee0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xfac36e8915413ee7 expref: -99 pid: 18560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746686.704017:0:17047:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.139@tcp lock: ffff8a44825c3a00/0xfac36e8915413ee0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0xfac36e8915413ee7 expref: -99 pid: 18560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788746686.704025:0:17047:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.139@tcp lock: ffff8a44825c3a00/0xfac36e8915413ee0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0xfac36e8915413ee7 expref: -99 pid: 18560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788746686.704031:0:17047:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788746686.704034:0:17047:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1788746686.704037:0:17047:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1788746686.704050:0:17047:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8a45b59a7000 00010000:00010000:2.0:1788746686.704053:0:17047:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.139@tcp lock: ffff8a44825c3a00/0xfac36e8915413ee0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0xfac36e8915413ee7 expref: -99 pid: 18560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746686.704075:0:17047:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.139@tcp lock: ffff8a44825c3a00/0xfac36e8915413ee0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0xfac36e8915413ee7 expref: -99 pid: 18560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746686.704101:0:17047:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788746686.704103:0:17047:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788746686.704105:0:17047:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788746686.704702:0:21033:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8a4482712d80 x1875636324106240/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788746701 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788746686.704743:0:21033:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1788746686.704750:0:21033:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788746686.704756:0:21033:0:(import.c:65:import_set_state_nolock()) ffff8a45a22f2800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:3.0:1788746686.704763:0:21033:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788746686.704769:0:21033:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8a4482712d80 x1875636324106240/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788746701 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788746686.704778:0:21033:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1788746686.704781:0:21033:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00100000:1.0:1788746686.704800:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a4482712d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3642:1875636324106240:0@lo:38:kworker.0 00000100:00080000:3.0:1788746686.708072:0:21033:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788746686.708089:0:21033:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8a4482712300 x1875636324106368/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788746702 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788746686.708105:0:21033:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1788746686.708111:0:21033:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1788746686.708134:0:21033:0:(import.c:65:import_set_state_nolock()) ffff8a45bcb83000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1788746686.710157:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a4482712300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3643:1875636324106368:0@lo:400:kworker.0 00000100:00100000:1.0:1788746686.710343:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a45bca93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3642:1875636324106752:0@lo:39:umount.0 00000400:00000100:1.0:1788746686.710400:0:3642:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875636324106752 offset 0 length 224: 4 00010000:00010000:0.0:1788746686.866594:0:20832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788746687.890497:0:17046:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788746688.212025:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 7bf60f24-4000-471c-bcb3-0ae64e0e499e->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788746688.212036:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) 7bf60f24-4000-471c-bcb3-0ae64e0e499e->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788746688.212039:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788746688.212042:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788746688.212327:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788746688.212351:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a4483cbe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3646:1875636324106880:0@lo:400:kworker.0 00000400:00000100:3.0:1788746688.212414:0:3646:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875636324106880 offset 0 length 224: 4 00010000:00010000:2.0:1788746688.914521:0:17047:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788746689.938775:0:20832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788746690.962648:0:17046:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788746691.218460:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 7bf60f24-4000-471c-bcb3-0ae64e0e499e->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788746691.218471:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) 7bf60f24-4000-471c-bcb3-0ae64e0e499e->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788746691.218474:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788746691.218477:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788746691.218606:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788746691.218629:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a4483590e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3645:1875636324107008:0@lo:400:kworker.0 00000400:00000100:2.0:1788746691.218682:0:3645:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875636324107008 offset 0 length 224: 4 00010000:00010000:2.0:1788746691.988368:0:17047:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788746692.884409:0:3642:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788746682/real 1788746682] req@ffff8a4483cbd180 x1875636324105856/t0(0) o250->MGC192.168.204.139@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788746692 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788746692.884446:0:3642:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8a4483cbd180 x1875636324105856/t0(0) o250->MGC192.168.204.139@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788746692 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788746692.884467:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8a45b59a7000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788746692.884489:0:3642:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:1.0:1788746692.884493:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a4483cbd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:7bf60f24-4000-471c-bcb3-0ae64e0e499e:3642:1875636324105856:0@lo:250:ptlrpcd_00_00.0 00000100:00080000:0.0:1788746692.884583:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 7bf60f24-4000-471c-bcb3-0ae64e0e499e->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788746692.884594:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788746692.884598:0:8:0:(import.c:65:import_set_state_nolock()) ffff8a45b59a7000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788746692.884606:0:8:0:(import.c:545:import_select_connection()) MGC192.168.204.139@tcp: connect to NID 0@lo last attempt 612 00000100:00080000:0.0:1788746692.884614:0:8:0:(import.c:630:import_select_connection()) MGC192.168.204.139@tcp: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788746692.884630:0:8:0:(import.c:666:import_select_connection()) MGC192.168.204.139@tcp: import ffff8a45b59a7000 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:0.0:1788746692.884676:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a4483cbed80 x1875636324107136/t0(0) o250->MGC192.168.204.139@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788746692.884715:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788746692.884719:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788746692.884861:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788746692.884881:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a4483cbea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3644:1875636324107264:0@lo:400:kworker.0 00000400:00000100:3.0:1788746692.884945:0:3644:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875636324107264 offset 0 length 224: 4 00000100:00100000:1.0:1788746692.885360:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a4483cbed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:7bf60f24-4000-471c-bcb3-0ae64e0e499e:3642:1875636324107136:0@lo:250:kworker.0 00000400:00000100:1.0:1788746692.885392:0:3642:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875636324107136 offset 0 length 520: 4 00010000:00010000:0.0:1788746693.015329:0:20832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788746694.035061:0:17046:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788746695.058594:0:17047:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788746696.085509:0:20832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788746696.978434:0:3642:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788746686/real 1788746686] req@ffff8a45bca93480 x1875636324106752/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788746696 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788746696.978474:0:3642:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8a45bca93480 x1875636324106752/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788746696 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788746696.978516:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8a45bcb83000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1788746696.978540:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a45bca93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3642:1875636324106752:0@lo:39:umount.0 00000100:00080000:3.0:1788746696.978635:0:21033:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788746696.978641:0:21033:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1788746696.978647:0:21033:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1788746696.979952:0:21033:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.139@tcp lock: ffff8a45ae45f800/0xfac36e8915413eb6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xfac36e8915413ebd expref: -99 pid: 18560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746696.979992:0:21033:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff8a45ae45f800/0xfac36e8915413eb6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xfac36e8915413ebd expref: -99 pid: 18560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746696.980000:0:21033:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff8a45ae45f800/0xfac36e8915413eb6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xfac36e8915413ebd expref: -99 pid: 18560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746696.980007:0:21033:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.139@tcp lock: ffff8a45ae45f800/0xfac36e8915413eb6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xfac36e8915413ebd expref: -99 pid: 18560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746696.980090:0:21033:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788746696.980099:0:21033:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.139@tcp lock: ffff8a4483ed6600/0xfac36e891541420c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfac36e8915414213 expref: -99 pid: 17055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746696.980107:0:21033:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff8a4483ed6600/0xfac36e891541420c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xfac36e8915414213 expref: -99 pid: 17055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746696.980113:0:21033:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff8a4483ed6600/0xfac36e891541420c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xfac36e8915414213 expref: -99 pid: 17055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746696.980120:0:21033:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.139@tcp lock: ffff8a4483ed6600/0xfac36e891541420c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xfac36e8915414213 expref: -99 pid: 17055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746696.981358:0:17046:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788746696.981373:0:17046:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.139@tcp lock: ffff8a45ae45f800/0xfac36e8915413eb6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xfac36e8915413ebd expref: -99 pid: 18560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746696.981383:0:17046:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a45ae45f800 already unused, calling callback (ffffffffc1180c20) 10000000:00010000:1.0:1788746696.981387:0:17046:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.139@tcp lock: ffff8a45ae45f800/0xfac36e8915413eb6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xfac36e8915413ebd expref: -99 pid: 18560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746696.981397:0:17046:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.139@tcp lock: ffff8a45ae45f800/0xfac36e8915413eb6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xfac36e8915413ebd expref: -99 pid: 18560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788746696.981404:0:17046:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.139@tcp lock: ffff8a45ae45f800/0xfac36e8915413eb6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xfac36e8915413ebd expref: -99 pid: 18560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788746696.981410:0:17046:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788746696.981412:0:17046:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 00010000:00010000:1.0:1788746696.981426:0:17046:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8a45b59a7000 00010000:00010000:1.0:1788746696.981430:0:17046:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.139@tcp lock: ffff8a45ae45f800/0xfac36e8915413eb6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xfac36e8915413ebd expref: -99 pid: 18560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746696.981437:0:17046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.139@tcp lock: ffff8a45ae45f800/0xfac36e8915413eb6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xfac36e8915413ebd expref: -99 pid: 18560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746696.981455:0:17046:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788746696.981459:0:17046:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.139@tcp lock: ffff8a4483ed6600/0xfac36e891541420c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xfac36e8915414213 expref: -99 pid: 17055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746696.981486:0:17046:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a4483ed6600 already unused, calling callback (ffffffffc1180c20) 10000000:00010000:1.0:1788746696.981489:0:17046:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.139@tcp lock: ffff8a4483ed6600/0xfac36e891541420c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xfac36e8915414213 expref: -99 pid: 17055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746696.981496:0:17046:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.139@tcp lock: ffff8a4483ed6600/0xfac36e891541420c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xfac36e8915414213 expref: -99 pid: 17055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788746696.981501:0:17046:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.139@tcp lock: ffff8a4483ed6600/0xfac36e891541420c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xfac36e8915414213 expref: -99 pid: 17055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788746696.981505:0:17046:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1788746696.981508:0:17046:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:1.0:1788746696.981513:0:17046:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8a45b59a7000 00010000:00010000:1.0:1788746696.981515:0:17046:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.139@tcp lock: ffff8a4483ed6600/0xfac36e891541420c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xfac36e8915414213 expref: -99 pid: 17055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746696.981522:0:17046:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788746696.981523:0:17046:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788746696.981525:0:17046:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788746696.981695:0:21033:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788746696.981702:0:21033:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.139@tcp lock: ffff8a4483ed6600/0xfac36e891541420c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xfac36e8915414213 expref: -99 pid: 17055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788746696.981714:0:21033:0:(mgc_request.c:130:config_log_put()) dropping config log params 10000000:01000000:3.0:1788746696.981720:0:21033:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 10000000:01000000:3.0:1788746696.981723:0:21033:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:3.0:1788746696.981765:0:21033:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-OST0000 00000020:01000000:3.0:1788746696.981769:0:21033:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:3.0:1788746696.981776:0:21033:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788746696.981782:0:21033:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788746696.981786:0:21033:0:(genops.c:1557:class_disconnect_exports()) OBD device 22 (ffff8a448313b380) has no exports 00000020:00080000:3.0:1788746696.981811:0:21033:0:(genops.c:1557:class_disconnect_exports()) OBD device 22 (ffff8a448313b380) has no exports 00000020:01000000:3.0:1788746696.986765:0:21033:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8a45bd664cc0 - data ffff8a45c11b2e58/ffff8a45845b1400 00000020:01000000:3.0:1788746696.986920:0:21033:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8a4591e6d0c0 - data ffff8a4481c1bbd0/ffff8a4483063c00 00010000:00010000:2.0:1788746696.987635:0:17047:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:3.0:1788746696.997489:0:21033:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1788746697.002823:0:21033:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xfac36e8915413ecb 00000020:00000080:2.0:1788746697.002837:0:21033:0:(genops.c:885:class_export_put()) final put ffff8a4482025800/lustre-OST0000-osd_UUID 00000020:01000004:2.0:1788746697.002849:0:21033:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8a45a8fde800 from lustre-OST0000, refs=2 00000020:01000004:2.0:1788746697.002853:0:21033:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8a45a8fde800 2 00000020:01000004:2.0:1788746697.002856:0:21033:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8a45a8fde800 from lustre-OST0000 00000020:00000080:2.0:1788746697.002882:0:21033:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788746697.002893:0:21033:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:2.0:1788746697.002896:0:21033:0:(genops.c:885:class_export_put()) final put ffff8a4482021000/lustre-OST0000_UUID 00000020:00000080:2.0:1788746697.002899:0:21033:0:(genops.c:844:class_export_destroy()) destroying export ffff8a4482021000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:2.0:1788746697.002906:0:21033:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:2.0:1788746697.002959:0:21033:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:2.0:1788746697.002964:0:21033:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:2.0:1788746697.002968:0:21033:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788746697.002973:0:21033:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788746697.002981:0:21033:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff8a45912b4000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788746697.002987:0:21033:0:(genops.c:1552:class_disconnect_exports()) OBD device 23 (ffff8a45847b4d40) has exports, disconnecting them 00000020:00080000:2.0:1788746697.002993:0:21033:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff8a45912b4000), last request at 1788746617 00000020:00000080:2.0:1788746697.002997:0:21033:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xfac36e8915413ef5 00000020:00080000:2.0:1788746697.003018:0:21033:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8a45912b4000): rc 0 00000020:00000080:2.0:1788746697.003024:0:21033:0:(genops.c:885:class_export_put()) final put ffff8a45912b4000/lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1788746697.003173:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a4482025800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:0.0:1788746697.003188:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a45912b4000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:0.0:1788746697.007765:0:21033:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:0.0:1788746697.007775:0:21033:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788746697.007780:0:21033:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788746697.007787:0:21033:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788746697.007972:0:21033:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788746697.007981:0:21033:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:0.0:1788746697.008003:0:21033:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:0.0:1788746697.008007:0:21033:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788746697.008012:0:21033:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788746697.008019:0:21033:0:(genops.c:1818:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff8a45912b0000 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788746697.008032:0:21033:0:(genops.c:1552:class_disconnect_exports()) OBD device 24 (ffff8a458729b380) has exports, disconnecting them 00000020:00080000:0.0:1788746697.008037:0:21033:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffff8a45912b0000), last request at 1788746617 00000020:00000080:0.0:1788746697.008041:0:21033:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xfac36e8915413f0a 00000020:00080000:0.0:1788746697.008074:0:21033:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8a45912b0000): rc 0 00000020:00000080:0.0:1788746697.008080:0:21033:0:(genops.c:885:class_export_put()) final put ffff8a45912b0000/lustre-MDT0001-lwp-OST0000 00000020:00000080:1.0:1788746697.008766:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8a45a22f2800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1788746697.008777:0:8:0:(genops.c:885:class_export_put()) final put ffff8a45a8d30000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:1.0:1788746697.008780:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a45a8d30000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:1.0:1788746697.008794:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:1.0:1788746697.008863:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a45912b0000/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00010000:01000000:1.0:1788746697.008888:0:21033:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:1.0:1788746697.008892:0:21033:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1788746697.008895:0:21033:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1788746697.008899:0:21033:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788746697.008924:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8a45bcb83000 for lustre-MDT0001-lwp-OST0000 00000020:00000080:1.0:1788746697.009068:0:21033:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788746697.009074:0:21033:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:00000080:1.0:1788746697.009078:0:21033:0:(genops.c:885:class_export_put()) final put ffff8a45bcb85000/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:1.0:1788746697.009081:0:21033:0:(genops.c:844:class_export_destroy()) destroying export ffff8a45bcb85000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:1.0:1788746697.009085:0:21033:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:1.0:1788746697.009114:0:21033:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8a45a8fde800 1 00000020:00000080:1.0:1788746697.009120:0:21033:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xfac36e8915413ea8 00000020:00000080:1.0:1788746697.009125:0:21033:0:(genops.c:885:class_export_put()) final put ffff8a45a8fd9000/lustre-OST0000-osd_UUID 00000020:01000000:1.0:1788746697.009134:0:21033:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:1.0:1788746697.009141:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a45a8fd9000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1788746697.009150:0:21033:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788746697.009155:0:21033:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788746697.009158:0:21033:0:(genops.c:1557:class_disconnect_exports()) OBD device 20 (ffff8a45bdd7b380) has no exports 00000020:00000080:1.0:1788746697.072721:0:21033:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788746697.072737:0:21033:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:1.0:1788746697.072743:0:21033:0:(genops.c:885:class_export_put()) final put ffff8a45a8fda000/lustre-OST0000-osd_UUID 00000020:00000080:1.0:1788746697.072748:0:21033:0:(genops.c:844:class_export_destroy()) destroying export ffff8a45a8fda000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:1.0:1788746697.072760:0:21033:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:1.0:1788746697.072882:0:21033:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8a45a8fdb000 00000020:02000400:1.0:1788746697.072939:0:21033:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:1.0:1788746697.131782:0:20832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788746697.946359:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 7bf60f24-4000-471c-bcb3-0ae64e0e499e->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788746697.946370:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 7bf60f24-4000-471c-bcb3-0ae64e0e499e->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788746697.946373:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788746697.946376:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788746697.946458:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a45bca90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3644:1875636324107392:0@lo:400:kworker.0 00000400:00000100:2.0:1788746697.946512:0:3644:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875636324107392 offset 0 length 224: 4 00010000:00010000:1.0:1788746698.198521:0:17046:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788746699.223071:0:17047:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788746700.245701:0:20832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788746700.902694:0:21236:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:2.0:1788746700.916950:0:21236:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-OST0001 00010000:00010000:3.0:1788746700.917094:0:21236:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.139@tcp lock: ffff8a45b7f94e00/0xfac36e8915414045 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xfac36e891541404c expref: -99 pid: 19378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746700.917110:0:21236:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff8a45b7f94e00/0xfac36e8915414045 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xfac36e891541404c expref: -99 pid: 19378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746700.917117:0:21236:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff8a45b7f94e00/0xfac36e8915414045 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xfac36e891541404c expref: -99 pid: 19378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746700.917126:0:21236:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.139@tcp lock: ffff8a45b7f94e00/0xfac36e8915414045 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xfac36e891541404c expref: -99 pid: 19378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746700.917156:0:21236:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788746700.917176:0:21236:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00010000:00010000:1.0:1788746700.917199:0:17046:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00080000:3.0:1788746700.917206:0:21236:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00010000:00010000:1.0:1788746700.917209:0:17046:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.139@tcp lock: ffff8a45b7f94e00/0xfac36e8915414045 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xfac36e891541404c expref: -99 pid: 19378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746700.917219:0:17046:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a45b7f94e00 already unused, calling callback (ffffffffc1180c20) 00000100:00100000:3.0:1788746700.917222:0:21236:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8a4482711c00 x1875636324106496/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788746701 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:00010000:1.0:1788746700.917224:0:17046:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.139@tcp lock: ffff8a45b7f94e00/0xfac36e8915414045 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xfac36e891541404c expref: -99 pid: 19378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746700.917255:0:17046:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.139@tcp lock: ffff8a45b7f94e00/0xfac36e8915414045 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xfac36e891541404c expref: -99 pid: 19378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788746700.917260:0:21236:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 10000000:00010000:1.0:1788746700.917263:0:17046:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.139@tcp lock: ffff8a45b7f94e00/0xfac36e8915414045 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xfac36e891541404c expref: -99 pid: 19378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788746700.917268:0:21236:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 10000000:01000000:1.0:1788746700.917270:0:17046:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788746700.917275:0:17046:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 00000100:00080000:3.0:1788746700.917276:0:21236:0:(import.c:65:import_set_state_nolock()) ffff8a4482506000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 10000000:01000000:1.0:1788746700.917278:0:17046:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00000100:00080000:3.0:1788746700.917283:0:21236:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788746700.917317:0:21236:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8a4482711c00 x1875636324106496/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788746701 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1788746700.917317:0:17046:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8a45b59a7000 00010000:00010000:1.0:1788746700.917323:0:17046:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.139@tcp lock: ffff8a45b7f94e00/0xfac36e8915414045 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xfac36e891541404c expref: -99 pid: 19378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788746700.917333:0:21236:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00010000:00010000:1.0:1788746700.917336:0:17046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.139@tcp lock: ffff8a45b7f94e00/0xfac36e8915414045 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xfac36e891541404c expref: -99 pid: 19378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788746700.917339:0:21236:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 1s for inflight to error out 00010000:00010000:1.0:1788746700.917352:0:17046:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788746700.917354:0:17046:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788746700.917356:0:17046:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788746700.917534:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a4482711c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3642:1875636324106496:0@lo:38:kworker.0 00000100:00080000:3.0:1788746700.919245:0:21236:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788746700.919261:0:21236:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8a45bca90700 x1875636324106624/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788746702 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788746700.919391:0:21236:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8a4483cbe680 x1875636324106880/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788746704 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788746700.919406:0:21236:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8a4483590e00 x1875636324107008/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788746707 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788746700.919420:0:21236:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8a4483cbea00 x1875636324107264/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788746708 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788746700.919427:0:21236:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8a45bca90380 x1875636324107392/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788746713 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788746700.919434:0:21236:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00100000:3.0:1788746700.919463:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a4483cbe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3646:1875636324106880:0@lo:400:kworker.0 00000100:00080000:3.0:1788746700.919503:0:21236:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1788746700.919527:0:21236:0:(import.c:65:import_set_state_nolock()) ffff8a44824a6800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1788746700.919723:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a45bca91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3642:1875636324107520:0@lo:39:umount.0 00000400:00000100:2.0:1788746700.919787:0:3642:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875636324107520 offset 0 length 224: 4 00000100:00100000:2.0:1788746700.919848:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a4483590e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3645:1875636324107008:0@lo:400:kworker.0 00000100:00100000:0.0:1788746700.920012:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a45bca90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3644:1875636324106624:0@lo:400:kworker.0 00000100:00100000:1.0:1788746700.920259:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a45bca90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3644:1875636324107392:0@lo:400:kworker.0 00000100:00100000:1.0:1788746700.920268:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a4483cbea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3644:1875636324107264:0@lo:400:kworker.0 00010000:00010000:3.0:1788746701.266693:0:17047:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788746702.290427:0:20832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788746703.060309:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 7bf60f24-4000-471c-bcb3-0ae64e0e499e->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788746703.060320:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) 7bf60f24-4000-471c-bcb3-0ae64e0e499e->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:1.0:1788746703.314601:0:17046:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788746704.338791:0:17047:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788746705.362615:0:20832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788746706.386434:0:17046:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788746707.091558:0:3642:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788746692/real 1788746692] req@ffff8a4483cbed80 x1875636324107136/t0(0) o250->MGC192.168.204.139@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788746707 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788746707.091620:0:3642:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8a4483cbed80 x1875636324107136/t0(0) o250->MGC192.168.204.139@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788746707 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788746707.091642:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8a45b59a7000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788746707.091669:0:3642:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:1.0:1788746707.091674:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a4483cbed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:7bf60f24-4000-471c-bcb3-0ae64e0e499e:3642:1875636324107136:0@lo:250:kworker.0 00000100:00080000:0.0:1788746707.091763:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 7bf60f24-4000-471c-bcb3-0ae64e0e499e->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788746707.091769:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788746707.091772:0:36:0:(import.c:65:import_set_state_nolock()) ffff8a45b59a7000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788746707.091777:0:36:0:(import.c:545:import_select_connection()) MGC192.168.204.139@tcp: connect to NID 0@lo last attempt 622 00000100:00080000:0.0:1788746707.091782:0:36:0:(import.c:630:import_select_connection()) MGC192.168.204.139@tcp: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1788746707.091793:0:36:0:(import.c:666:import_select_connection()) MGC192.168.204.139@tcp: import ffff8a45b59a7000 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:0.0:1788746707.091825:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a4483cbdc00 x1875636324107648/t0(0) o250->MGC192.168.204.139@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788746707.091962:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a4483cbdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:7bf60f24-4000-471c-bcb3-0ae64e0e499e:3642:1875636324107648:0@lo:250:kworker.0 00000400:00000100:1.0:1788746707.092007:0:3642:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875636324107648 offset 0 length 520: 4 00010000:00010000:3.0:1788746707.410781:0:17047:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788746708.434807:0:20832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788746709.458460:0:17046:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788746710.163911:0:3642:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788746700/real 1788746700] req@ffff8a45bca91f80 x1875636324107520/t0(0) o39->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788746710 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788746710.163946:0:3642:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8a45bca91f80 x1875636324107520/t0(0) o39->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788746710 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788746710.163966:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8a44824a6800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1788746710.163989:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a45bca91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3642:1875636324107520:0@lo:39:umount.0 00000100:00080000:3.0:1788746710.164075:0:21236:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788746710.164080:0:21236:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1788746710.164085:0:21236:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1788746710.165008:0:21236:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.139@tcp lock: ffff8a45ae45f000/0xfac36e891541401b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfac36e8915414022 expref: -99 pid: 19378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746710.165023:0:21236:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff8a45ae45f000/0xfac36e891541401b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xfac36e8915414022 expref: -99 pid: 19378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746710.165031:0:21236:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff8a45ae45f000/0xfac36e891541401b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xfac36e8915414022 expref: -99 pid: 19378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746710.165038:0:21236:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.139@tcp lock: ffff8a45ae45f000/0xfac36e891541401b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xfac36e8915414022 expref: -99 pid: 19378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746710.165068:0:21236:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788746710.165075:0:21236:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.139@tcp lock: ffff8a4580031a00/0xfac36e89154141fe lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfac36e8915414205 expref: -99 pid: 17055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746710.165082:0:21236:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff8a4580031a00/0xfac36e89154141fe lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xfac36e8915414205 expref: -99 pid: 17055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746710.165087:0:21236:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff8a4580031a00/0xfac36e89154141fe lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xfac36e8915414205 expref: -99 pid: 17055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746710.165111:0:21236:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.139@tcp lock: ffff8a4580031a00/0xfac36e89154141fe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xfac36e8915414205 expref: -99 pid: 17055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746710.165114:0:17047:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788746710.165121:0:17047:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.139@tcp lock: ffff8a45ae45f000/0xfac36e891541401b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xfac36e8915414022 expref: -99 pid: 19378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746710.165128:0:17047:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a45ae45f000 already unused, calling callback (ffffffffc1180c20) 00010000:00010000:3.0:1788746710.165133:0:21236:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:00010000:2.0:1788746710.165133:0:17047:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.139@tcp lock: ffff8a45ae45f000/0xfac36e891541401b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xfac36e8915414022 expref: -99 pid: 19378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788746710.165137:0:21236:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00010000:00010000:2.0:1788746710.165141:0:17047:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.139@tcp lock: ffff8a45ae45f000/0xfac36e891541401b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xfac36e8915414022 expref: -99 pid: 19378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788746710.165147:0:17047:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.139@tcp lock: ffff8a45ae45f000/0xfac36e891541401b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xfac36e8915414022 expref: -99 pid: 19378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788746710.165153:0:17047:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788746710.165155:0:17047:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:2.0:1788746710.165157:0:17047:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00000020:01000004:3.0:1788746710.165163:0:21236:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-OST0001 00000020:01000000:3.0:1788746710.165167:0:21236:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00010000:00010000:2.0:1788746710.165171:0:17047:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8a45b59a7000 00000020:00000080:3.0:1788746710.165172:0:21236:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788746710.165178:0:21236:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788746710.165182:0:21236:0:(genops.c:1557:class_disconnect_exports()) OBD device 26 (ffff8a45b4dbb380) has no exports 00010000:00010000:2.0:1788746710.165191:0:17047:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.139@tcp lock: ffff8a45ae45f000/0xfac36e891541401b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xfac36e8915414022 expref: -99 pid: 19378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746710.165197:0:17047:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.139@tcp lock: ffff8a45ae45f000/0xfac36e891541401b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xfac36e8915414022 expref: -99 pid: 19378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1788746710.165208:0:21236:0:(genops.c:1557:class_disconnect_exports()) OBD device 26 (ffff8a45b4dbb380) has no exports 00010000:00010000:2.0:1788746710.165210:0:17047:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788746710.165213:0:17047:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.139@tcp lock: ffff8a4580031a00/0xfac36e89154141fe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xfac36e8915414205 expref: -99 pid: 17055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746710.165218:0:17047:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a4580031a00 already unused, calling callback (ffffffffc1180c20) 10000000:00010000:2.0:1788746710.165221:0:17047:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.139@tcp lock: ffff8a4580031a00/0xfac36e89154141fe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xfac36e8915414205 expref: -99 pid: 17055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746710.165227:0:17047:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.139@tcp lock: ffff8a4580031a00/0xfac36e89154141fe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xfac36e8915414205 expref: -99 pid: 17055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788746710.165233:0:17047:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.139@tcp lock: ffff8a4580031a00/0xfac36e89154141fe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xfac36e8915414205 expref: -99 pid: 17055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788746710.165238:0:17047:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1788746710.165240:0:17047:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1788746710.165242:0:17047:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1788746710.165256:0:17047:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8a45b59a7000 00010000:00010000:2.0:1788746710.165263:0:17047:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.139@tcp lock: ffff8a4580031a00/0xfac36e89154141fe lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xfac36e8915414205 expref: -99 pid: 17055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746710.165269:0:17047:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.139@tcp lock: ffff8a4580031a00/0xfac36e89154141fe lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xfac36e8915414205 expref: -99 pid: 17055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746710.165284:0:17047:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788746710.165351:0:17047:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788746710.165353:0:17047:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788746710.167198:0:20832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:3.0:1788746710.171832:0:21236:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8a45bd664d20 - data ffff8a45c12b3798/ffff8a44827e7800 00000020:01000000:3.0:1788746710.172517:0:21236:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8a45b592a5a0 - data ffff8a45c114e5e8/ffff8a44827e6400 00100000:10000000:3.0:1788746710.182114:0:21236:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1788746710.200819:0:21236:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xfac36e8915414030 00000020:00000080:0.0:1788746710.200832:0:21236:0:(genops.c:885:class_export_put()) final put ffff8a44824a3000/lustre-OST0001-osd_UUID 00000020:01000004:0.0:1788746710.200853:0:21236:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8a4482024000 from lustre-OST0001, refs=2 00000020:01000004:0.0:1788746710.200856:0:21236:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8a4482024000 2 00000020:01000004:0.0:1788746710.200859:0:21236:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8a4482024000 from lustre-OST0001 00000020:00000080:0.0:1788746710.200884:0:21236:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788746710.200897:0:21236:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:2.0:1788746710.200899:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8a44824a3000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:0.0:1788746710.200901:0:21236:0:(genops.c:885:class_export_put()) final put ffff8a44824a7800/lustre-OST0001_UUID 00000020:00000080:0.0:1788746710.200912:0:21236:0:(genops.c:844:class_export_destroy()) destroying export ffff8a44824a7800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:0.0:1788746710.200926:0:21236:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:0.0:1788746710.201029:0:21236:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 7bf60f24-4000-471c-bcb3-0ae64e0e499e->MGS 00010000:00010000:0.0:1788746710.201045:0:21236:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.139@tcp lock: ffff8a4483ed7200/0xfac36e8915413d74 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xfac36e8915413d7b expref: -99 pid: 17790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788746710.201057:0:21236:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.139@tcp lock: ffff8a4483ed7200/0xfac36e8915413d74 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xfac36e8915413d7b expref: -99 pid: 17790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788746710.201063:0:21236:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:0.0:1788746710.201066:0:21236:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:0.0:1788746710.201069:0:21236:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:0.0:1788746710.201082:0:21236:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8a45b59a7000 00010000:00010000:0.0:1788746710.201086:0:21236:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.139@tcp lock: ffff8a4483ed7200/0xfac36e8915413d74 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xfac36e8915413d7b expref: -99 pid: 17790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746710.201100:0:21236:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.139@tcp lock: ffff8a45ae45e600/0xfac36e8915413c63 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xfac36e8915413c6a expref: -99 pid: 17037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788746710.201107:0:21236:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.139@tcp lock: ffff8a45ae45e600/0xfac36e8915413c63 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xfac36e8915413c6a expref: -99 pid: 17037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788746710.201112:0:21236:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788746710.201114:0:21236:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:0.0:1788746710.201115:0:21236:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:0.0:1788746710.201124:0:21236:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8a45b59a7000 00010000:00010000:0.0:1788746710.201127:0:21236:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.139@tcp lock: ffff8a45ae45e600/0xfac36e8915413c63 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xfac36e8915413c6a expref: -99 pid: 17037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788746710.201142:0:21236:0:(import.c:65:import_set_state_nolock()) ffff8a45b59a7000 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:0.0:1788746710.201146:0:21236:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1788746710.201148:0:21236:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1788746710.201150:0:21236:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1788746710.201154:0:21236:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1788746710.201172:0:21236:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8a4483cbdc00 x1875636324107648/t0(0) o250->MGC192.168.204.139@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1788746727 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1788746710.201193:0:21236:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1788746710.201195:0:21236:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 22s for inflight to error out 00000100:00100000:2.0:1788746710.201265:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a4483cbdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:7bf60f24-4000-471c-bcb3-0ae64e0e499e:3642:1875636324107648:0@lo:250:kworker.0 10000000:01000000:0.0:1788746710.202215:0:21236:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1788746710.202229:0:21236:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xfac36e8915413c4e 00000020:00000080:0.0:1788746710.202248:0:21236:0:(genops.c:885:class_export_put()) final put ffff8a45b59a3000/7bf60f24-4000-471c-bcb3-0ae64e0e499e 00000020:01000000:0.0:1788746710.202267:0:21236:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.204.139@tcp (flags='') 00000020:00000080:0.0:1788746710.202272:0:21236:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788746710.202278:0:21236:0:(obd_config.c:956:class_cleanup()) MGC192.168.204.139@tcp: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1788746710.202282:0:21236:0:(genops.c:1557:class_disconnect_exports()) OBD device 2 (ffff8a45b7eab380) has no exports 10000000:01000000:0.0:1788746710.202336:0:17055:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:0.0:1788746710.202391:0:21236:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.204.139@tcp: client import never connected 00000100:00080000:0.0:1788746710.202394:0:21236:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:0.0:1788746710.202396:0:21236:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1788746710.202399:0:21236:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:0.0:1788746710.202401:0:21236:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1788746710.202842:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8a45b59a3000/7bf60f24-4000-471c-bcb3-0ae64e0e499e for MGC192.168.204.139@tcp 00000020:00000080:2.0:1788746710.202854:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8a45b59a7000 for MGC192.168.204.139@tcp 00000020:00000080:0.0:1788746710.203018:0:21236:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788746710.203025:0:21236:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.204.139@tcp (uuid 7bf60f24-4000-471c-bcb3-0ae64e0e499e) 00000020:00000080:0.0:1788746710.203029:0:21236:0:(genops.c:885:class_export_put()) final put ffff8a45b59a6000/7bf60f24-4000-471c-bcb3-0ae64e0e499e 00000020:00000080:0.0:1788746710.203031:0:21236:0:(genops.c:844:class_export_destroy()) destroying export ffff8a45b59a6000/7bf60f24-4000-471c-bcb3-0ae64e0e499e for MGC192.168.204.139@tcp 00000020:01000000:0.0:1788746710.203036:0:21236:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.204.139@tcp (7bf60f24-4000-471c-bcb3-0ae64e0e499e) 00000020:01000000:0.0:1788746710.205078:0:21236:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:0.0:1788746710.205088:0:21236:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788746710.205097:0:21236:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788746710.205105:0:21236:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff8a4482507800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788746710.205111:0:21236:0:(genops.c:1552:class_disconnect_exports()) OBD device 27 (ffff8a4483138000) has exports, disconnecting them 00000020:00080000:0.0:1788746710.205117:0:21236:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff8a4482507800), last request at 1788746634 00000020:00000080:0.0:1788746710.205121:0:21236:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xfac36e891541405a 00000020:00080000:0.0:1788746710.205140:0:21236:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8a4482507800): rc 0 00000020:00000080:0.0:1788746710.205159:0:21236:0:(genops.c:885:class_export_put()) final put ffff8a4482507800/lustre-MDT0000-lwp-OST0001 00000020:00000080:2.0:1788746710.209973:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8a4482507800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:1.0:1788746710.212848:0:21236:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:1.0:1788746710.212857:0:21236:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788746710.212861:0:21236:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:1.0:1788746710.212869:0:21236:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788746710.213094:0:21236:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788746710.213104:0:21236:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000000:1.0:1788746710.213112:0:21236:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0001 (flags='F') 00000020:00000080:1.0:1788746710.213119:0:21236:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788746710.213124:0:21236:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788746710.213143:0:21236:0:(genops.c:1818:print_export_data()) lustre-MDT0001-lwp-OST0001: ACTIVE ffff8a45bd67e000 lustre-MDT0001-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788746710.213149:0:21236:0:(genops.c:1552:class_disconnect_exports()) OBD device 28 (ffff8a45b4dbcd40) has exports, disconnecting them 00000020:00080000:1.0:1788746710.213154:0:21236:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0001: disconnecting export at 0@lo (ffff8a45bd67e000), last request at 1788746634 00000020:00000080:1.0:1788746710.213158:0:21236:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xfac36e891541406f 00000020:00080000:1.0:1788746710.213171:0:21236:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8a45bd67e000): rc 0 00000020:00000080:1.0:1788746710.213176:0:21236:0:(genops.c:885:class_export_put()) final put ffff8a45bd67e000/lustre-MDT0001-lwp-OST0001 00000020:00000080:2.0:1788746710.213435:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8a4482506000 for lustre-MDT0000-lwp-OST0001 00000020:00000080:2.0:1788746710.213444:0:36:0:(genops.c:885:class_export_put()) final put ffff8a4482500000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:2.0:1788746710.213447:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8a4482500000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:2.0:1788746710.213453:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:2.0:1788746710.213519:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8a45bd67e000/lustre-MDT0001-lwp-OST0001 for lustre-MDT0001-lwp-OST0001 00010000:01000000:1.0:1788746710.214875:0:21236:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0001: client import never connected 00000100:00080000:1.0:1788746710.214881:0:21236:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1788746710.214884:0:21236:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:1.0:1788746710.214890:0:21236:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1788746710.215059:0:17046:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00000020:00000080:2.0:1788746710.220455:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8a44824a6800 for lustre-MDT0001-lwp-OST0001 00010000:00010000:2.0:1788746710.271423:0:17047:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:2.0:1788746710.271590:0:20832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:2.0:1788746710.271723:0:17041:0:(service.c:3188:ptlrpc_main()) ldlm_cb00_000: service thread [ffff8a45a8de8400:17041] 0 exiting: rc = 1 00000100:00100000:0.0:1788746710.272168:0:19396:0:(service.c:3188:ptlrpc_main()) ldlm_cb00_002: service thread [ffff8a4482508200:19396] 2 exiting: rc = 0 00000100:00100000:0.0:1788746710.296828:0:17042:0:(service.c:3188:ptlrpc_main()) ldlm_cb00_001: service thread [ffff8a45a8de9400:17042] 1 exiting: rc = 0 00000100:00100000:2.0:1788746710.297123:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788746710.297976:0:17045:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_002: service thread [ffff8a4583bcaa00:17045] 2 exiting: rc = 0 00000100:00100000:0.0:1788746710.298069:0:17044:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_001: service thread [ffff8a4483dcaa00:17044] 1 exiting: rc = 0 00000100:00100000:1.0:1788746710.298266:0:17043:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_000: service thread [ffff8a4483dcae00:17043] 0 exiting: rc = 1 00000100:00100000:2.0:1788746710.303084:0:18212:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_003: service thread [ffff8a45c0e59400:18212] 3 exiting: rc = 0 00000100:00100000:2.0:1788746710.303194:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746710.303202:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746710.303209:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746710.303216:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746710.303222:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746710.303229:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746710.303458:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746710.303467:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746710.303473:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746710.303477:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746710.303482:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746710.303501:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746710.303506:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746710.303510:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746710.303515:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746710.303520:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746710.303524:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746710.303529:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746710.303598:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746710.303609:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746710.303614:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746710.303620:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746710.303624:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746710.303630:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746710.303635:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746710.303640:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746710.303645:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746710.303650:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746710.303655:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746710.303659:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746710.303664:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746710.303668:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746710.303672:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746710.303677:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746710.303683:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746710.303687:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746710.303692:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746710.303697:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746710.303701:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746710.303706:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746710.303710:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746710.303715:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746710.303720:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746710.303725:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746710.303730:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746710.303736:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746710.303749:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746710.303754:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746710.303761:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746710.303767:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746710.303772:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746710.303777:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746710.303781:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746710.303786:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746710.303803:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746710.303809:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746710.303815:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746710.303819:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746710.303824:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746710.303829:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746710.303834:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746710.303840:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746710.303845:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746710.303850:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1788746710.305079:0:21236:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788746710.305091:0:21236:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000020:00000080:2.0:1788746710.305097:0:21236:0:(genops.c:885:class_export_put()) final put ffff8a44824a3800/lustre-MDT0001-lwp-OST0001_UUID 00000020:00000080:2.0:1788746710.305102:0:21236:0:(genops.c:844:class_export_destroy()) destroying export ffff8a44824a3800/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001-lwp-OST0001 00000020:01000000:2.0:1788746710.305108:0:21236:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0001 (lustre-MDT0001-lwp-OST0001_UUID) 00000020:01000004:2.0:1788746710.305158:0:21236:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8a4482024000 1 00000020:00000080:2.0:1788746710.305165:0:21236:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xfac36e8915414014 00000020:00000080:2.0:1788746710.305172:0:21236:0:(genops.c:885:class_export_put()) final put ffff8a45912b2000/lustre-OST0001-osd_UUID 00000020:01000000:2.0:1788746710.305222:0:21236:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:2.0:1788746710.305227:0:21236:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788746710.305232:0:21236:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788746710.305248:0:21236:0:(genops.c:1557:class_disconnect_exports()) OBD device 25 (ffff8a44831399c0) has no exports 00000020:00000080:0.0:1788746710.309641:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8a45912b2000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:3.0:1788746710.357869:0:21236:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788746710.357883:0:21236:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:3.0:1788746710.357889:0:21236:0:(genops.c:885:class_export_put()) final put ffff8a4482022000/lustre-OST0001-osd_UUID 00000020:00000080:3.0:1788746710.357893:0:21236:0:(genops.c:844:class_export_destroy()) destroying export ffff8a4482022000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:3.0:1788746710.357904:0:21236:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:3.0:1788746710.358247:0:21236:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8a4482025000 00000020:01000000:3.0:1788746710.358277:0:21236:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:3.0:1788746710.358282:0:21236:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788746710.358329:0:21236:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788746710.358334:0:21236:0:(genops.c:1557:class_disconnect_exports()) OBD device 21 (ffff8a45847b0000) has no exports 00000020:00000080:3.0:1788746710.358363:0:21236:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788746710.358368:0:21236:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:3.0:1788746710.358372:0:21236:0:(genops.c:885:class_export_put()) final put ffff8a4591091800/OSS_uuid 00000020:00000080:3.0:1788746710.358374:0:21236:0:(genops.c:844:class_export_destroy()) destroying export ffff8a4591091800/OSS_uuid for OSS 00000020:01000000:3.0:1788746710.358378:0:21236:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:3.0:1788746710.358445:0:18566:0:(service.c:3188:ptlrpc_main()) ll_ost00_001: service thread [ffff8a4584604e00:18566] 1 exiting: rc = 0 00000100:00100000:3.0:1788746710.358567:0:18567:0:(service.c:3188:ptlrpc_main()) ll_ost00_002: service thread [ffff8a4584605000:18567] 2 exiting: rc = 0 00000100:00080000:3.0:1788746710.358612:0:17054:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:3.0:1788746710.358714:0:19014:0:(service.c:3188:ptlrpc_main()) ll_ost00_003: service thread [ffff8a4481b14600:19014] 3 exiting: rc = 0 00000100:00100000:1.0:1788746710.361360:0:18565:0:(service.c:3188:ptlrpc_main()) ll_ost00_000: service thread [ffff8a45934bc200:18565] 0 exiting: rc = 1 00000100:00100000:3.0:1788746710.361536:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746710.361547:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746710.361552:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746710.361558:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746710.361563:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746710.361569:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746710.361575:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746710.361589:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746710.361595:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746710.361600:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746710.361604:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746710.361610:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746710.361614:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746710.361620:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746710.361627:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746710.361631:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746710.361636:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746710.361641:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746710.361645:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746710.361650:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746710.361655:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746710.361660:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746710.361665:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746710.361670:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746710.361691:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746710.361699:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746710.361704:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746710.361709:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746710.361715:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746710.361720:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746710.361726:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746710.361731:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746710.361752:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746710.361757:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746710.361762:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746710.361767:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746710.361772:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746710.361779:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746710.361784:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746710.361799:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746710.361805:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746710.361810:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746710.361815:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746710.361819:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746710.361823:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746710.361827:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746710.361832:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746710.361836:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746710.361842:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746710.361848:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746710.361852:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746710.361857:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746710.361862:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746710.361866:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746710.361872:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746710.361877:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746710.361882:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746710.361887:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746710.361892:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746710.361896:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746710.361901:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746710.361906:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746710.361911:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746710.361916:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746710.371484:0:18568:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_000: service thread [ffff8a458422de00:18568] 0 exiting: rc = 1 00000100:00100000:3.0:1788746710.371655:0:18569:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_001: service thread [ffff8a458422c000:18569] 1 exiting: rc = 0 00000100:00100000:3.0:1788746710.371744:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746710.371764:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746710.371769:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746710.371775:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746710.371780:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746710.371785:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746710.371800:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746710.371806:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746710.371813:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746710.371827:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746710.371834:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746710.371840:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746710.371855:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746710.371877:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746710.371883:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746710.371887:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746710.371892:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746710.371896:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746710.371900:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746710.371905:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746710.371909:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746710.371913:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746710.371917:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746710.371921:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746710.371925:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746710.371929:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746710.371934:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746710.371938:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746710.371942:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746710.371946:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746710.371957:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746710.371972:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746710.371990:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746710.372003:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746710.372012:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746710.372025:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746710.372170:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746710.372179:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746710.372183:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746710.372188:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746710.372192:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746710.372197:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746710.372201:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746710.372212:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746710.372218:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746710.372223:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746710.372234:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746710.372239:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746710.372244:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746710.372250:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746710.372255:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746710.372260:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746710.372265:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746710.372270:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746710.372274:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746710.372280:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746710.372325:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746710.372332:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746710.372337:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746710.372341:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746710.372346:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746710.372350:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746710.372355:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746710.372359:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746710.376630:0:20200:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_003: service thread [ffff8a45b49e8e00:20200] 3 exiting: rc = 0 00000100:00100000:1.0:1788746710.378639:0:18571:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_001: service thread [ffff8a458422d800:18571] 1 exiting: rc = 0 00000100:00100000:3.0:1788746710.379403:0:18572:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_002: service thread [ffff8a458422d600:18572] 2 exiting: rc = 0 00000100:00100000:2.0:1788746710.380147:0:18570:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_000: service thread [ffff8a458422da00:18570] 0 exiting: rc = 1 00000100:00100000:2.0:1788746710.384573:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746710.384588:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746710.384622:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746710.384629:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746710.384635:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746710.384643:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746710.384653:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746710.384659:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746710.384666:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746710.384672:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746710.384679:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746710.384686:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746710.384691:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746710.384699:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746710.384743:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746710.384756:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746710.384762:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746710.384768:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746710.384775:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746710.384781:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746710.384788:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746710.384810:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746710.384818:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746710.384823:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746710.384833:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746710.384840:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746710.384848:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746710.384857:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746710.384873:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746710.385582:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746710.385593:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746710.385600:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746710.385607:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746710.385613:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746710.385620:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746710.385628:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746710.385635:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746710.385655:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746710.385685:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746710.385693:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746710.385700:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746710.385707:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746710.387006:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746710.387021:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746710.387038:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746710.387051:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746710.387058:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746710.387065:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746710.387072:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746710.387078:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746710.387086:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746710.387093:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746710.387101:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746710.387109:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746710.387127:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746710.387175:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746710.387193:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746710.387211:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746710.387229:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746710.387249:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746710.387267:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746710.387274:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746710.387281:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788746710.388165:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746710.398368:0:18573:0:(service.c:3188:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff8a458422ca00:18573] 0 exiting: rc = 1 00000100:00100000:1.0:1788746710.398776:0:18574:0:(service.c:3188:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff8a458422d000:18574] 1 exiting: rc = 0 00000100:00100000:3.0:1788746710.398924:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746710.398932:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746710.398946:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746710.398969:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746710.398974:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746710.398980:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746710.398985:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746710.398990:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746710.398996:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746710.399002:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746710.399009:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746710.399015:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746710.399021:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746710.399027:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746710.399034:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746710.399039:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746710.399046:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746710.399052:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746710.399058:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746710.399063:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746710.399069:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746710.399074:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746710.399080:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746710.399086:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746710.399092:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746710.399099:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746710.399110:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746710.399116:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746710.399121:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746710.399127:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746710.399133:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746710.399139:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746710.399144:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746710.399151:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746710.399156:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746710.399162:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746710.399168:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746710.399174:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746710.399189:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746710.399195:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746710.399201:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746710.399207:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746710.399214:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746710.399222:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746710.399230:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746710.399237:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746710.399243:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746710.399250:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746710.399256:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746710.399263:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746710.399268:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746710.399276:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746710.399282:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746710.399313:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746710.399320:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746710.399326:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746710.399331:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746710.399337:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746710.399343:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746710.399349:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746710.399355:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746710.399361:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746710.399367:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746710.399382:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746710.400274:0:18576:0:(service.c:3188:ptlrpc_main()) ll_ost_out00_001: service thread [ffff8a44837efc00:18576] 1 exiting: rc = 0 00000100:00100000:0.0:1788746710.400396:0:18575:0:(service.c:3188:ptlrpc_main()) ll_ost_out00_000: service thread [ffff8a44837ef200:18575] 0 exiting: rc = 1 00000100:00100000:3.0:1788746710.401673:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746710.401698:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746710.401706:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746710.401713:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746710.401719:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746710.401726:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746710.401759:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746710.401767:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746710.401799:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746710.401806:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746710.401812:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746710.401818:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746710.401825:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746710.401831:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746710.401838:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746710.401845:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746710.401851:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746710.401858:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746710.401884:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746710.401893:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746710.401899:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746710.401906:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746710.401912:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746710.401919:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746710.401925:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746710.401932:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746710.401938:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746710.401944:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746710.401950:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746710.401957:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746710.401979:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746710.401987:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746710.401993:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746710.401999:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746710.402006:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746710.402012:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746710.402019:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746710.402026:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746710.402033:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746710.402038:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746710.402044:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746710.402051:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746710.402071:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746710.402085:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746710.402091:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746710.402098:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746710.402104:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746710.402110:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746710.402117:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746710.402124:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746710.402130:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746710.402138:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746710.402147:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746710.402153:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746710.402174:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746710.402182:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746710.402188:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746710.402194:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746710.402202:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746710.402208:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746710.402214:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746710.402221:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746710.402239:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788746710.402253:0:21236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:2.0:1788746710.433135:0:21236:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:0.0:1788746730.412165:0:22003:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg439-server.virtnet: executing load_modules_local 00000020:01000004:1.0:1788746741.554686:0:22602:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1788746741.554692:0:22602:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:1.0:1788746741.554693:0:22602:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:1.0:1788746741.554984:0:22602:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8a45847a0000 00000020:01000004:1.0:1788746741.554999:0:22602:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:1.0:1788746741.555007:0:22602:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1788746741.555021:0:22602:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff8a44831399c0) 00000020:00000080:1.0:1788746741.555034:0:22602:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1788746741.608958:0:22602:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:3.0:1788746741.609392:0:22602:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1788746741.612900:0:22602:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:3.0:1788746741.613421:0:22602:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:3.0:1788746741.613658:0:22602:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:3.0:1788746741.613892:0:22602:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:3.0:1788746741.614109:0:22602:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1788746741.614551:0:22602:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:3.0:1788746741.614760:0:22602:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1788746741.614943:0:22602:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:3.0:1788746741.615137:0:22602:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:3.0:1788746741.615583:0:22602:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:3.0:1788746741.615779:0:22602:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:3.0:1788746741.616063:0:22602:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1788746741.622046:0:22602:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:2.0:1788746741.624204:0:22602:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:2.0:1788746741.624627:0:22602:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:2.0:1788746741.624962:0:22602:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:2.0:1788746741.625205:0:22602:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:2.0:1788746741.625664:0:22602:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:2.0:1788746741.625869:0:22602:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:2.0:1788746741.626159:0:22602:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:2.0:1788746741.626501:0:22602:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:2.0:1788746741.626813:0:22602:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:2.0:1788746741.627171:0:22602:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:2.0:1788746741.627984:0:22602:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:2.0:1788746741.628487:0:22602:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:2.0:1788746741.628739:0:22602:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:2.0:1788746741.628992:0:22602:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:2.0:1788746741.629246:0:22602:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:2.0:1788746741.629627:0:22602:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:2.0:1788746741.629897:0:22602:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:2.0:1788746741.630222:0:22602:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:2.0:1788746741.630531:0:22602:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:2.0:1788746741.630779:0:22602:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:2.0:1788746741.631103:0:22602:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:2.0:1788746741.631551:0:22602:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:2.0:1788746741.631901:0:22602:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:2.0:1788746741.632693:0:22602:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:2.0:1788746741.632974:0:22602:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:2.0:1788746741.633233:0:22602:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:2.0:1788746741.633609:0:22602:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:2.0:1788746741.633864:0:22602:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:2.0:1788746741.634144:0:22602:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:2.0:1788746741.634438:0:22602:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:2.0:1788746741.634620:0:22602:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:2.0:1788746741.634794:0:22602:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:2.0:1788746741.640378:0:22602:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:2.0:1788746741.640774:0:22602:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:2.0:1788746741.641116:0:22602:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:2.0:1788746741.641612:0:22602:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:2.0:1788746741.641800:0:22602:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:2.0:1788746741.642129:0:22602:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00080000:01000000:2.0:1788746741.643107:0:22602:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1788746741.643521:0:22602:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1788746741.643531:0:22602:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788746741.643545:0:22602:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xfac36e89154144c1 00000020:01000004:2.0:1788746741.643552:0:22602:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:2.0:1788746741.643557:0:22602:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1788746741.643562:0:22602:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8a45847a0000 from MGS 00000020:01000004:2.0:1788746741.643566:0:22602:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1788746741.643576:0:22602:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff8a4587298000) 00000020:00000080:2.0:1788746741.643586:0:22602:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1788746741.643697:0:22602:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8a45847a0000 from MGS, refs=2 00080000:01000000:2.0:1788746741.643702:0:22602:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788746741.643707:0:22602:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xfac36e89154144cf 00000100:00100000:2.0:1788746741.643842:0:22602:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1788746741.643984:0:22602:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1788746741.643990:0:22602:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:1.0:1788746741.644965:0:22602:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:1.0:1788746741.644974:0:22602:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1788746741.645812:0:22602:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788746741.646149:0:22602:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1788746741.646155:0:22602:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1788746741.646812:0:22602:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1788746741.646819:0:22602:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1788746741.651488:0:22602:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1788746741.651512:0:22602:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:2.0:1788746741.653098:0:22611:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788746741.653103:0:22611:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788746741.653111:0:22611:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788746741.653709:0:22612:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788746741.653712:0:22612:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788746741.653714:0:22612:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788746741.658001:0:22602:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:2.0:1788746741.660136:0:22611:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:0.0:1788746741.670922:0:22602:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:0.0:1788746741.672021:0:22614:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:2.0:1788746741.672076:0:22602:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:2.0:1788746741.672117:0:22602:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1788746741.672971:0:22602:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:2.0:1788746741.673525:0:22602:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788746741.673704:0:22602:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:2.0:1788746741.673710:0:22602:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1788746741.678952:0:22602:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1788746741.678968:0:22602:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1788746741.683573:0:22602:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1788746741.683588:0:22602:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:1.0:1788746741.685243:0:22602:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1788746741.685268:0:22602:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.204.139@tcp' 00000020:01000004:1.0:1788746741.685270:0:22602:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:1.0:1788746741.685330:0:22602:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.204.139@tcp (typ=mgc) 00000020:00000080:1.0:1788746741.685342:0:22602:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.204.139@tcp (ffff8a4483138000) 00000020:00000080:1.0:1788746741.685357:0:22602:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:1.0:1788746741.685438:0:22602:0:(ldlm_lib.c:103:import_set_conn()) imp ffff8a44831fc000@MGC192.168.204.139@tcp: add connection 192.168.204.139@tcp at head 00010000:00010000:1.0:1788746741.685597:0:22602:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.204.139@tcp-0 is initialized 00000040:01000000:1.0:1788746741.685603:0:22602:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.139@tcp ctxt 1 is initialized 00000100:00080000:3.0:1788746741.687410:0:22619:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:3.0:1788746741.689473:0:22620:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:2.0:1788746741.689567:0:22602:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.204.139@tcp (uuid 41310026-2b0a-472c-80e6-fbabf81d5070) 00000020:00000080:2.0:1788746741.689593:0:22602:0:(genops.c:1384:class_connect()) connect: client 41310026-2b0a-472c-80e6-fbabf81d5070, cookie 0xfac36e89154144dd 00000100:00080000:2.0:1788746741.689605:0:22602:0:(import.c:545:import_select_connection()) MGC192.168.204.139@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788746741.689617:0:22602:0:(import.c:666:import_select_connection()) MGC192.168.204.139@tcp: import ffff8a44831fc000 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:2.0:1788746741.689649:0:22602:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a4482711c00 x1875636324107776/t0(0) o250->MGC192.168.204.139@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788746741.689723:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a4482711c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:41310026-2b0a-472c-80e6-fbabf81d5070:3642:1875636324107776:0@lo:250:mount.lustre.0 00000100:00100000:3.0:1788746741.689803:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746741.689928:0:22615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324107776 00000100:00100000:0.0:1788746741.689937:0:22615:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324107776 00000100:00100000:0.0:1788746741.689974:0:22615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788746741.689982:0:22615:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4483d5fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3642:x1875636324107776:12345-0@lo:250:mount.lustre.0 00010000:00080000:0.0:1788746741.690005:0:22615:0:(ldlm_lib.c:1456:target_handle_connect()) MGS: connection from 41310026-2b0a-472c-80e6-fbabf81d5070@0@lo t0 exp 0000000000000000 cur 671 last 0 00000020:00000080:0.0:1788746741.690034:0:22615:0:(genops.c:1384:class_connect()) connect: client 41310026-2b0a-472c-80e6-fbabf81d5070, cookie 0xfac36e89154144e4 00000100:00080000:0.0:1788746741.690182:0:22615:0:(import.c:65:import_set_state_nolock()) ffff8a45ac641800 : changing import state from RECOVER to FULL 00000100:00080000:2.0:1788746741.691357:0:22602:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 41310026-2b0a-472c-80e6-fbabf81d5070->MGS 00000020:01000004:2.0:1788746741.691389:0:22602:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1788746741.691396:0:22602:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:2.0:1788746741.691411:0:22602:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff8a458729b380) 00000020:00000080:2.0:1788746741.691427:0:22602:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:0.0:1788746741.697453:0:22615:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4483d5fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41310026-2b0a-472c-80e6-fbabf81d5070+5:3642:x1875636324107776:12345-0@lo:250:mount.lustre.0 Request processed in 7458us (7637us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746741.697472:0:22615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788746741.697697:0:3642:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.204.139@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1788746741.697712:0:3642:0:(import.c:1177:ptlrpc_connect_interpret()) MGC192.168.204.139@tcp: connect to target with instance 0 00000100:00080000:0.0:1788746741.697724:0:3642:0:(import.c:1001:ptlrpc_connect_set_flags()) MGC192.168.204.139@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1788746741.697730:0:3642:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1788746741.697734:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8a44831fc000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1788746741.697737:0:3642:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1788746741.697749:0:3642:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1788746741.697756:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a4482711c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:41310026-2b0a-472c-80e6-fbabf81d5070:3642:1875636324107776:0@lo:250:mount.lustre.0 00000100:00100000:2.0:1788746741.704391:0:22602:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788746741.704661:0:22602:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:2.0:1788746741.704669:0:22602:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:1.0:1788746741.705755:0:22602:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:1.0:1788746741.705764:0:22602:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:2.0:1788746741.711663:0:22602:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:2.0:1788746741.711682:0:22602:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:3.0:1788746741.714767:0:22602:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788746741.717879:0:22602:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:2.0:1788746741.717890:0:22602:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:2.0:1788746741.718724:0:22602:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:2.0:1788746741.718737:0:22602:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:3.0:1788746741.762218:0:22602:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788746741.762457:0:22602:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:3.0:1788746741.762463:0:22602:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:2.0:1788746741.764798:0:22602:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:2.0:1788746741.764819:0:22602:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:2.0:1788746741.765808:0:22602:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788746741.766444:0:22602:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788746741.766452:0:22602:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:3.0:1788746741.767582:0:22602:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788746741.769080:0:22602:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1788746741.769848:0:22602:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788746741.770116:0:22602:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788746741.770123:0:22602:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1788746741.777099:0:22602:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788746741.777117:0:22602:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:2.0:1788746741.778011:0:22602:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788746741.778366:0:22602:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788746741.778372:0:22602:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1788746741.779124:0:22602:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788746741.779133:0:22602:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:0.0:1788746741.802279:0:22602:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788746741.802643:0:22602:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1788746741.802650:0:22602:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:0.0:1788746741.804224:0:22602:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1788746741.804238:0:22602:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:0.0:1788746741.805234:0:22602:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1788746741.805244:0:22602:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:0.0:1788746741.806261:0:22602:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:0.0:1788746741.806387:0:22602:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:0.0:1788746741.806394:0:22602:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.139@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:0.0:1788746741.806512:0:22602:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.139@tcp ctxt 0 is initialized 00000020:01000004:0.0:1788746741.806550:0:22602:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.204.139@tcp, index=0000, flags=0x20005 00000020:01000004:0.0:1788746741.806555:0:22602:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788746741.806557:0:22602:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788746741.806558:0:22602:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788746741.806559:0:22602:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788746741.806560:0:22602:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788746741.806562:0:22602:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788746741.806564:0:22602:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788746741.806565:0:22602:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788746741.806567:0:22602:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788746741.806568:0:22602:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788746741.806571:0:22602:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:0.0:1788746741.806573:0:22602:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788746741.806575:0:22602:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788746741.806576:0:22602:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788746741.806577:0:22602:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788746741.806578:0:22602:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788746741.806579:0:22602:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788746741.806580:0:22602:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788746741.806581:0:22602:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788746741.806582:0:22602:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788746741.806583:0:22602:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788746741.807736:0:22602:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1788746741.808092:0:22602:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a4483cbf480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41310026-2b0a-472c-80e6-fbabf81d5070:22602:1875636324107904:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788746741.808178:0:22602:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746741.808320:0:22602:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a4581377840 going to sleep for 11 seconds 00000100:00100000:3.0:1788746741.814676:0:22618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324107904 00000100:00100000:3.0:1788746741.814692:0:22618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324107904 00000100:00100000:3.0:1788746741.814756:0:22618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788746741.814766:0:22618:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4483d5c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41310026-2b0a-472c-80e6-fbabf81d5070+5:22602:x1875636324107904:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788746741.814835:0:22618:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788746741.814838:0:22618:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1788746741.814841:0:22618:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:3.0:1788746741.815424:0:22639:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1788746741.816139:0:22618:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 10 20000000:01000000:2.0:1788746741.821978:0:22640:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:2.0:1788746741.821988:0:22640:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:2.0:1788746741.821991:0:22640:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:2.0:1788746741.821994:0:22640:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:2.0:1788746741.822427:0:22640:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:1.0:1788746741.824487:0:22618:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1788746741.824501:0:22618:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1788746741.827222:0:22618:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4483d5c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41310026-2b0a-472c-80e6-fbabf81d5070+5:22602:x1875636324107904:12345-0@lo:253:mount.lustre.0 Request processed in 12440us (19026us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746741.827242:0:22618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788746741.830040:0:22602:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a4483cbf480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41310026-2b0a-472c-80e6-fbabf81d5070:22602:1875636324107904:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788746741.830060:0:22602:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1788746741.830064:0:22602:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788746741.830065:0:22602:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788746741.830067:0:22602:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788746741.830068:0:22602:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788746741.830069:0:22602:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788746741.830070:0:22602:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788746741.830071:0:22602:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788746741.830073:0:22602:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788746741.830074:0:22602:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788746741.830076:0:22602:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788746741.830126:0:22602:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8a45847a0000 from lustre-MDT0000 10000000:01000000:0.0:1788746741.830543:0:22602:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:0.0:1788746741.830547:0:22602:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1788746741.830552:0:22602:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff8a4483138000 10000000:01000000:0.0:1788746741.830556:0:22602:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788746741.830566:0:22602:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8a4483138000 from 1 10000000:01000000:0.0:1788746741.830569:0:22602:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788746741.830625:0:22602:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.139@tcp lock: ffff8a44825c3400/0xfac36e89154144f2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746741.830636:0:22602:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.139@tcp lock: ffff8a44825c3400/0xfac36e89154144f2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746741.830647:0:22602:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.139@tcp lock: ffff8a44825c3400/0xfac36e89154144f2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788746741.830667:0:22602:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a4483cbf480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41310026-2b0a-472c-80e6-fbabf81d5070:22602:1875636324108032:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788746741.830733:0:22602:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746741.830781:0:22602:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a4585180c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788746741.830943:0:22617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324108032 00000100:00100000:3.0:1788746741.830951:0:22617:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324108032 00000100:00100000:3.0:1788746741.831003:0:22617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788746741.831012:0:22617:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4483cddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41310026-2b0a-472c-80e6-fbabf81d5070+5:22602:x1875636324108032:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788746741.831035:0:22617:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788746741.831051:0:22617:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a45c216dc00/0xfac36e89154144f9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xfac36e89154144f2 expref: -99 pid: 22617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746741.831098:0:22617:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a45c216dc00/0xfac36e89154144f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfac36e89154144f2 expref: 6 pid: 22617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746741.831109:0:22617:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a45c216dc00/0xfac36e89154144f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfac36e89154144f2 expref: 6 pid: 22617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746741.831119:0:22617:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a45c216dc00, rc 0) 00000100:00100000:3.0:1788746741.831170:0:22617:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4483cddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41310026-2b0a-472c-80e6-fbabf81d5070+6:22602:x1875636324108032:12345-0@lo:101:mount.lustre.0 Request processed in 159us (437us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746741.831176:0:22617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788746741.832577:0:22602:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a4483cbf480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41310026-2b0a-472c-80e6-fbabf81d5070:22602:1875636324108032:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788746741.832723:0:22602:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.139@tcp lock: ffff8a44825c3400/0xfac36e89154144f2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfac36e89154144f9 expref: -99 pid: 22602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746741.832737:0:22602:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.139@tcp lock: ffff8a44825c3400/0xfac36e89154144f2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xfac36e89154144f9 expref: -99 pid: 22602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788746741.832816:0:22602:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a4482713b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41310026-2b0a-472c-80e6-fbabf81d5070:22602:1875636324108160:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788746741.833858:0:22602:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746741.833905:0:22602:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a458553f6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788746741.833984:0:22618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324108160 00000100:00100000:1.0:1788746741.833992:0:22618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324108160 00000100:00100000:1.0:1788746741.834107:0:22618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788746741.834117:0:22618:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4483cdcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41310026-2b0a-472c-80e6-fbabf81d5070+6:22602:x1875636324108160:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788746741.834313:0:22618:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4483cdcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41310026-2b0a-472c-80e6-fbabf81d5070+6:22602:x1875636324108160:12345-0@lo:501:mount.lustre.0 Request processed in 197us (458us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788746741.834321:0:22618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788746741.836927:0:22602:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a4482713b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41310026-2b0a-472c-80e6-fbabf81d5070:22602:1875636324108160:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1788746741.837419:0:22602:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.139@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1788746741.837452:0:22602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff8a44825c3400/0xfac36e89154144f2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfac36e89154144f9 expref: -99 pid: 22602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746741.837464:0:22602:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.139@tcp lock: ffff8a44825c3400/0xfac36e89154144f2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfac36e89154144f9 expref: -99 pid: 22602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788746741.837473:0:22602:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8a45847a0000 10000000:01000000:0.0:1788746741.837480:0:22602:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1788746741.837485:0:22602:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8a45847a0000 10000000:01000000:0.0:1788746741.837489:0:22602:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1788746741.837492:0:22602:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8a45847a0000 from 1 10000000:01000000:0.0:1788746741.837494:0:22602:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1788746741.837537:0:22602:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.139@tcp lock: ffff8a44825c3000/0xfac36e8915414500 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746741.837546:0:22602:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.139@tcp lock: ffff8a44825c3000/0xfac36e8915414500 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746741.837556:0:22602:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.139@tcp lock: ffff8a44825c3000/0xfac36e8915414500 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788746741.837576:0:22602:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a4483cbc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41310026-2b0a-472c-80e6-fbabf81d5070:22602:1875636324108288:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788746741.837638:0:22602:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746741.837754:0:22602:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a4585180240 going to sleep for 11 seconds 00000100:00100000:1.0:1788746741.837853:0:22615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324108288 00000100:00100000:1.0:1788746741.837860:0:22615:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324108288 00000100:00100000:1.0:1788746741.837910:0:22615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788746741.837919:0:22615:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4483cde850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41310026-2b0a-472c-80e6-fbabf81d5070+6:22602:x1875636324108288:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788746741.837931:0:22615:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788746741.838015:0:22615:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a45ae45f600/0xfac36e8915414507 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xfac36e8915414500 expref: -99 pid: 22615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746741.838610:0:22615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a45ae45f600/0xfac36e8915414507 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfac36e8915414500 expref: 7 pid: 22615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746741.838639:0:22615:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a45ae45f600/0xfac36e8915414507 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfac36e8915414500 expref: 7 pid: 22615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746741.838649:0:22615:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a45ae45f600, rc 0) 00000100:00100000:1.0:1788746741.839571:0:22615:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4483cde850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41310026-2b0a-472c-80e6-fbabf81d5070+7:22602:x1875636324108288:12345-0@lo:101:mount.lustre.0 Request processed in 1648us (1928us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746741.839580:0:22615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788746741.839670:0:22602:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a4483cbc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41310026-2b0a-472c-80e6-fbabf81d5070:22602:1875636324108288:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788746741.839689:0:22602:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.139@tcp lock: ffff8a44825c3000/0xfac36e8915414500 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfac36e8915414507 expref: -99 pid: 22602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746741.839714:0:22602:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.139@tcp lock: ffff8a44825c3000/0xfac36e8915414500 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xfac36e8915414507 expref: -99 pid: 22602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788746741.839732:0:22602:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.139@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1788746741.839810:0:22602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff8a44825c3000/0xfac36e8915414500 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfac36e8915414507 expref: -99 pid: 22602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746741.839819:0:22602:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.139@tcp lock: ffff8a44825c3000/0xfac36e8915414500 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfac36e8915414507 expref: -99 pid: 22602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788746741.839827:0:22602:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1788746741.839832:0:22602:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788746741.839838:0:22602:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8a45847a0000 10000000:01000000:0.0:1788746741.839841:0:22602:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1788746741.839844:0:22602:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:0.0:1788746741.839847:0:22602:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1788746741.839874:0:22602:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.139@tcp lock: ffff8a44825c2c00/0xfac36e891541450e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746741.839881:0:22602:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.139@tcp lock: ffff8a44825c2c00/0xfac36e891541450e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746741.839889:0:22602:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.139@tcp lock: ffff8a44825c2c00/0xfac36e891541450e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788746741.839907:0:22602:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a4483cbc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41310026-2b0a-472c-80e6-fbabf81d5070:22602:1875636324108416:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788746741.839949:0:22602:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746741.840570:0:22602:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a4585180240 going to sleep for 11 seconds 00000100:00100000:1.0:1788746741.840656:0:22617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324108416 00000100:00100000:1.0:1788746741.840665:0:22617:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324108416 00000100:00100000:1.0:1788746741.840878:0:22617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788746741.840890:0:22617:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4483cdc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41310026-2b0a-472c-80e6-fbabf81d5070+7:22602:x1875636324108416:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788746741.840904:0:22617:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788746741.840918:0:22617:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a45ae45ec00/0xfac36e8915414515 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xfac36e891541450e expref: -99 pid: 22617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746741.840941:0:22617:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a45ae45ec00/0xfac36e8915414515 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfac36e891541450e expref: 8 pid: 22617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746741.840952:0:22617:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a45ae45ec00/0xfac36e8915414515 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfac36e891541450e expref: 8 pid: 22617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746741.840961:0:22617:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a45ae45ec00, rc 0) 00000100:00100000:1.0:1788746741.844766:0:22617:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4483cdc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41310026-2b0a-472c-80e6-fbabf81d5070+8:22602:x1875636324108416:12345-0@lo:101:mount.lustre.0 Request processed in 3867us (4805us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746741.844781:0:22617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788746741.845440:0:22602:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a4483cbc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41310026-2b0a-472c-80e6-fbabf81d5070:22602:1875636324108416:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788746741.845467:0:22602:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.139@tcp lock: ffff8a44825c2c00/0xfac36e891541450e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfac36e8915414515 expref: -99 pid: 22602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746741.845479:0:22602:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.139@tcp lock: ffff8a44825c2c00/0xfac36e891541450e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xfac36e8915414515 expref: -99 pid: 22602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788746741.845572:0:22602:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a4483cbc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41310026-2b0a-472c-80e6-fbabf81d5070:22602:1875636324108544:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788746741.845624:0:22602:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746741.846146:0:22602:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a4585180240 going to sleep for 11 seconds 00000100:00100000:3.0:1788746741.849332:0:22618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324108544 00000100:00100000:3.0:1788746741.849348:0:22618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324108544 00000100:00100000:3.0:1788746741.849523:0:22618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788746741.849535:0:22618:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4483cdf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41310026-2b0a-472c-80e6-fbabf81d5070+8:22602:x1875636324108544:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788746741.849758:0:22618:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4483cdf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41310026-2b0a-472c-80e6-fbabf81d5070+9:22602:x1875636324108544:12345-0@lo:501:mount.lustre.0 Request processed in 226us (4133us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746741.849772:0:22618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788746741.850339:0:22602:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a4483cbc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41310026-2b0a-472c-80e6-fbabf81d5070:22602:1875636324108544:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788746741.850394:0:22602:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a4483cbc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41310026-2b0a-472c-80e6-fbabf81d5070:22602:1875636324108672:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788746741.850456:0:22602:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746741.850496:0:22602:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a4585180240 going to sleep for 11 seconds 00000100:00100000:1.0:1788746741.850663:0:22617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324108672 00000100:00100000:1.0:1788746741.850670:0:22617:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324108672 00000100:00100000:1.0:1788746741.850709:0:22617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788746741.850716:0:22617:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4483cdd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41310026-2b0a-472c-80e6-fbabf81d5070+9:22602:x1875636324108672:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788746741.851644:0:22617:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4483cdd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41310026-2b0a-472c-80e6-fbabf81d5070+9:22602:x1875636324108672:12345-0@lo:503:mount.lustre.0 Request processed in 925us (1183us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746741.851653:0:22617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788746741.851771:0:22602:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a4483cbc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41310026-2b0a-472c-80e6-fbabf81d5070:22602:1875636324108672:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788746741.852741:0:22641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a4483cbc000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:41310026-2b0a-472c-80e6-fbabf81d5070:22641:1875636324108800:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788746741.852808:0:22641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746741.852997:0:22641:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a4585180840 going to sleep for 11 seconds 00000100:00100000:1.0:1788746741.854463:0:22615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324108800 00000100:00100000:1.0:1788746741.854473:0:22615:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324108800 00000100:00100000:1.0:1788746741.854596:0:22615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788746741.854608:0:22615:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4483cdd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41310026-2b0a-472c-80e6-fbabf81d5070+9:22641:x1875636324108800:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788746741.856716:0:22615:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4483cdd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41310026-2b0a-472c-80e6-fbabf81d5070+9:22641:x1875636324108800:12345-0@lo:502:llog_process_th.0 Request processed in 2101us (3898us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746741.856740:0:22615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788746741.856879:0:22641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a4483cbc000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:41310026-2b0a-472c-80e6-fbabf81d5070:22641:1875636324108800:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788746741.856924:0:22641:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788746741.856935:0:22641:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788746741.856938:0:22641:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1788746741.856943:0:22641:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:0.0:1788746741.856945:0:22641:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788746741.856961:0:22641:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff8a45b4dbb380) 00000020:00000080:0.0:1788746741.856978:0:22641:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:0.0:1788746741.856995:0:22641:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1788746741.857083:0:22641:0:(osd_handler.c:8924:osd_obd_connect()) connect #2 00000020:00000080:0.0:1788746741.857091:0:22641:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xfac36e8915414523 00000020:00000080:0.0:1788746741.857390:0:22641:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1788746741.857395:0:22641:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788746741.857399:0:22641:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788746741.857400:0:22641:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1788746741.857403:0:22641:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788746741.857407:0:22641:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788746741.857408:0:22641:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:0.0:1788746741.857411:0:22641:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788746741.857420:0:22641:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff8a45b4dbcd40) 00000020:00000080:0.0:1788746741.857430:0:22641:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:0.0:1788746741.857434:0:22641:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1788746741.857436:0:22641:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:0.0:1788746741.857439:0:22641:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:0.0:1788746741.857445:0:22641:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1788746741.857486:0:22641:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8a45847a0000 from lustre-MDT0000, refs=3 00000020:00000080:0.0:1788746741.857496:0:22641:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff8a45b4db8000) 00000020:00000080:0.0:1788746741.857503:0:22641:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:0.0:1788746741.857562:0:22641:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1788746741.857568:0:22641:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xfac36e8915414538 00000020:00000080:0.0:1788746741.857657:0:22641:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:0.0:1788746741.857664:0:22641:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1788746741.857668:0:22641:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xfac36e891541453f 00080000:01000000:0.0:1788746741.857673:0:22641:0:(osd_handler.c:8924:osd_obd_connect()) connect #3 00000020:00000080:0.0:1788746741.857676:0:22641:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xfac36e8915414546 00010000:00010000:3.0:1788746741.970777:0:22641:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:3.0:1788746741.971328:0:22641:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 8589934628 00000001:00080000:3.0:1788746741.972690:0:22641:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1788746741.973390:0:22641:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff8a45847b3380) 00000020:00000080:3.0:1788746741.973412:0:22641:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1788746741.973516:0:22641:0:(osd_handler.c:8924:osd_obd_connect()) connect #4 00000020:00000080:3.0:1788746741.973526:0:22641:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xfac36e8915414554 00000020:00000080:1.0:1788746741.983414:0:22641:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1788746741.986944:0:22641:0:(genops.c:1384:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xfac36e891541455b 00000020:00000080:1.0:1788746741.987441:0:22641:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1788746741.987452:0:22641:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788746741.987459:0:22641:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788746741.987461:0:22641:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1788746741.987464:0:22641:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788746741.987467:0:22641:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #9 00000020:01000000:1.0:1788746741.987469:0:22641:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788746741.987470:0:22641:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788746741.987472:0:22641:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788746741.987475:0:22641:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788746741.987476:0:22641:0:(obd_config.c:1563:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788746741.987479:0:22641:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788746741.987484:0:22641:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788746741.987486:0:22641:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1788746741.987490:0:22641:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1788746741.987543:0:22641:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1788746741.987571:0:22641:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788746741.987574:0:22641:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788746741.987575:0:22641:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:1.0:1788746741.987578:0:22641:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788746741.987581:0:22641:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788746741.987583:0:22641:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:1.0:1788746741.987586:0:22641:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788746741.987591:0:22641:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.139@tcp to nid 0x20000c0a8cc8b (192.168.204.139@tcp) 00000020:00000080:1.0:1788746741.987619:0:22641:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788746741.987634:0:22641:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff8a448313b380) 00000020:00000080:1.0:1788746741.987651:0:22641:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:1.0:1788746741.987660:0:22641:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788746741.987722:0:22641:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:1.0:1788746741.987728:0:22641:0:(osd_handler.c:8924:osd_obd_connect()) connect #5 00000020:00000080:1.0:1788746741.987896:0:22641:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xfac36e8915414569 00010000:00080000:1.0:1788746741.987932:0:22641:0:(ldlm_lib.c:103:import_set_conn()) imp ffff8a4583263800@lustre-MDT0001-osp-MDT0000: add connection 192.168.204.139@tcp at head 00010000:00010000:1.0:1788746741.993064:0:22641:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-1 is initialized 00000020:00000080:0.0:1788746741.995403:0:22641:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788746741.995421:0:22641:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:0.0:1788746741.995459:0:22641:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:0.0:1788746741.995489:0:22641:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xfac36e8915414570 00000100:00080000:0.0:1788746741.995503:0:22641:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788746741.995520:0:22641:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8a4583263800 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:0.0:1788746741.995567:0:22641:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a4483cbc000 x1875636324108928/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788746741.995598:0:22641:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:0.0:1788746741.995683:0:22641:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788746741.995687:0:22641:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788746741.995689:0:22641:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:0.0:1788746741.995692:0:22641:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1788746741.995695:0:22641:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #20 00000020:01000000:0.0:1788746741.995696:0:22641:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788746741.995699:0:22641:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788746741.995700:0:22641:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1788746741.995703:0:22641:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788746741.995704:0:22641:0:(obd_config.c:1563:class_process_config()) marker 20 (0x6) lustre sys.timeout 00000020:01000000:0.0:1788746741.995707:0:22641:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788746741.995713:0:22641:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:0.0:1788746741.995716:0:22641:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788746741.995717:0:22641:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1788746741.995721:0:22641:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788746741.995725:0:22641:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.139@tcp to nid 0x20000c0a8cc8b (192.168.204.139@tcp) 00000020:01000000:0.0:1788746741.995765:0:22641:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1788746741.995768:0:22641:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788746741.995784:0:22641:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff8a45b4db99c0) 00000020:00000080:0.0:1788746741.995796:0:22641:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:0.0:1788746741.995801:0:22641:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788746741.996083:0:22641:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:0.0:1788746741.996090:0:22641:0:(osd_handler.c:8924:osd_obd_connect()) connect #6 00000020:00000080:0.0:1788746741.996098:0:22641:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xfac36e891541457e 00010000:00080000:0.0:1788746741.996135:0:22641:0:(ldlm_lib.c:103:import_set_conn()) imp ffff8a45b7e60000@lustre-OST0000-osc-MDT0000: add connection 192.168.204.139@tcp at head 00010000:00010000:0.0:1788746741.996407:0:22641:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-2 is initialized 00000100:00100000:1.0:1788746741.997045:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a4483cbc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1875636324108928:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788746741.997122:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746741.997219:0:22628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324108928 00000100:00100000:1.0:1788746741.997226:0:22628:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324108928 00000100:00100000:1.0:1788746741.997256:0:22628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788746741.997263:0:22628:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4483592680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3642:x1875636324108928:12345-0@lo:38:llog_process_th.0 00010000:00020000:1.0:1788746741.997281:0:22628:0:(ldlm_lib.c:1202:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000040:01000000:0.0:1788746741.999977:0:22641:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1788746742.001053:0:22641:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1788746742.007039:0:22641:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788746742.008466:0:22641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].3, 64 off8384 00000040:00080000:3.0:1788746742.016577:0:22641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].1, 64 off8256 00000040:00080000:2.0:1788746742.017453:0:22647:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1788746742.017460:0:22647:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x10:0x0] at index 3 of catalog [0x1:0x2:0x0] 00000100:00100000:1.0:1788746742.021226:0:22628:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4483592680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3642:x1875636324108928:12345-0@lo:38:llog_process_th.0 Request processed in 23951us (24093us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788746742.021244:0:22628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1788746742.021270:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8a4583263800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788746742.021331:0:3642:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788746742.021337:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a4483cbc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1875636324108928:0@lo:38:llog_process_th.0 00000020:00000080:3.0:1788746742.022920:0:22641:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788746742.022935:0:22641:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788746742.022983:0:22641:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1788746742.023002:0:22641:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xfac36e8915414585 00000100:00080000:3.0:1788746742.023014:0:22641:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788746742.023464:0:22641:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8a45b7e60000 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:3.0:1788746742.023508:0:22641:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a45bca91500 x1875636324109056/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788746742.023540:0:22641:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1788746742.023625:0:22641:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788746742.023630:0:22641:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788746742.023632:0:22641:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1788746742.023635:0:22641:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788746742.023638:0:22641:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #28 00000020:01000000:3.0:1788746742.023640:0:22641:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788746742.023641:0:22641:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788746742.023643:0:22641:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788746742.023646:0:22641:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788746742.023647:0:22641:0:(obd_config.c:1563:class_process_config()) marker 28 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788746742.023649:0:22641:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788746742.023654:0:22641:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1788746742.023657:0:22641:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788746742.023658:0:22641:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000100:00100000:0.0:1788746742.023658:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a45bca91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1875636324109056:0@lo:8:llog_process_th.0 00000020:00000080:3.0:1788746742.023661:0:22641:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788746742.023664:0:22641:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.139@tcp to nid 0x20000c0a8cc8b (192.168.204.139@tcp) 00000020:01000000:3.0:1788746742.023687:0:22641:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1788746742.023690:0:22641:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788746742.023701:0:22641:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8a45847b19c0) 00000400:00000100:0.0:1788746742.023713:0:3642:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875636324109056 offset 0 length 520: 4 00000020:00000080:3.0:1788746742.023772:0:22641:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:3.0:1788746742.023779:0:22641:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788746742.023863:0:22641:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1788746742.023870:0:22641:0:(osd_handler.c:8924:osd_obd_connect()) connect #7 00000020:00000080:3.0:1788746742.023882:0:22641:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xfac36e8915414593 00010000:00080000:3.0:1788746742.023911:0:22641:0:(ldlm_lib.c:103:import_set_conn()) imp ffff8a45bfe8d800@lustre-OST0001-osc-MDT0000: add connection 192.168.204.139@tcp at head 00010000:00010000:3.0:1788746742.024510:0:22641:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-3 is initialized 00000040:01000000:3.0:1788746742.024593:0:22641:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1788746742.024611:0:22641:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1788746742.032584:0:22641:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788746742.033430:0:22641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].3, 64 off8384 00000040:00080000:3.0:1788746742.033630:0:22641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x12:0x0].1, 64 off8256 00000040:00080000:3.0:1788746742.036260:0:22649:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:3.0:1788746742.036268:0:22649:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x12:0x0] at index 3 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1788746742.037698:0:22641:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788746742.037714:0:22641:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788746742.037757:0:22641:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1788746742.037780:0:22641:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xfac36e891541459a 00000100:00080000:3.0:1788746742.037792:0:22641:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788746742.037805:0:22641:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8a45bfe8d800 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:3.0:1788746742.038215:0:22641:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a45bca91c00 x1875636324109184/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788746742.038245:0:22641:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1788746742.038340:0:22641:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788746742.038344:0:22641:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788746742.038346:0:22641:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1788746742.038349:0:22641:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788746742.038354:0:22641:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788746742.038355:0:22641:0:(obd_config.c:1563:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788746742.038358:0:22641:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788746742.038360:0:22641:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788746742.038362:0:22641:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788746742.038365:0:22641:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788746742.038366:0:22641:0:(obd_config.c:1563:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000020:01000000:3.0:1788746742.038368:0:22641:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788746742.038383:0:22641:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788746742.038385:0:22641:0:(obd_config.c:1563:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788746742.038389:0:22641:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1788746742.038422:0:22641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a45bca92300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:41310026-2b0a-472c-80e6-fbabf81d5070:22641:1875636324109312:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788746742.038514:0:22641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746742.038549:0:22641:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a45c0c0ee40 going to sleep for 11 seconds 00000100:00100000:1.0:1788746742.038734:0:22617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324109312 00000100:00100000:1.0:1788746742.038743:0:22617:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324109312 00000100:00100000:1.0:1788746742.038803:0:22617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788746742.038805:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a45bca91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1875636324109184:0@lo:8:llog_process_th.0 00000100:00100000:1.0:1788746742.038816:0:22617:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4483cdf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41310026-2b0a-472c-80e6-fbabf81d5070+9:22641:x1875636324109312:12345-0@lo:502:llog_process_th.0 00000400:00000100:0.0:1788746742.038850:0:3642:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875636324109184 offset 0 length 520: 4 00000100:00100000:1.0:1788746742.038956:0:22617:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4483cdf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41310026-2b0a-472c-80e6-fbabf81d5070+9:22641:x1875636324109312:12345-0@lo:502:llog_process_th.0 Request processed in 144us (454us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746742.038965:0:22617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788746742.039722:0:22641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a45bca92300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:41310026-2b0a-472c-80e6-fbabf81d5070:22641:1875636324109312:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788746742.039762:0:22641:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788746742.039769:0:22641:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788746742.039772:0:22641:0:(obd_config.c:1563:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1788746742.039776:0:22641:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:1.0:1788746742.039885:0:22602:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:1.0:1788746742.039911:0:22602:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.139@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1788746742.039996:0:22602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff8a44825c2c00/0xfac36e891541450e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfac36e8915414515 expref: -99 pid: 22602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746742.040019:0:22602:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.139@tcp lock: ffff8a44825c2c00/0xfac36e891541450e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfac36e8915414515 expref: -99 pid: 22602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788746742.040028:0:22602:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8a45847a0000 from 1 10000000:01000000:1.0:1788746742.040032:0:22602:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788746742.040067:0:22602:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.139@tcp lock: ffff8a45ae45e200/0xfac36e89154145a1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746742.040075:0:22602:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.139@tcp lock: ffff8a45ae45e200/0xfac36e89154145a1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746742.040085:0:22602:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.139@tcp lock: ffff8a45ae45e200/0xfac36e89154145a1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788746742.040103:0:22602:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a4483592a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41310026-2b0a-472c-80e6-fbabf81d5070:22602:1875636324109440:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788746742.040147:0:22602:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746742.040195:0:22602:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a45872d0240 going to sleep for 11 seconds 00000100:00100000:0.0:1788746742.040255:0:22615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324109440 00000100:00100000:0.0:1788746742.040261:0:22615:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324109440 00000100:00100000:0.0:1788746742.040354:0:22615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788746742.040363:0:22615:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4483cde450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41310026-2b0a-472c-80e6-fbabf81d5070+9:22602:x1875636324109440:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788746742.040375:0:22615:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788746742.040391:0:22615:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a44825c3c00/0xfac36e89154145a8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xfac36e89154145a1 expref: -99 pid: 22615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746742.040415:0:22615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a44825c3c00/0xfac36e89154145a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfac36e89154145a1 expref: 10 pid: 22615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746742.040428:0:22615:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a44825c3c00/0xfac36e89154145a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfac36e89154145a1 expref: 10 pid: 22615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746742.040438:0:22615:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a44825c3c00, rc 0) 00000100:00100000:0.0:1788746742.040473:0:22615:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4483cde450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41310026-2b0a-472c-80e6-fbabf81d5070+10:22602:x1875636324109440:12345-0@lo:101:mount.lustre.0 Request processed in 112us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746742.040489:0:22615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788746742.040752:0:22602:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a4483592a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41310026-2b0a-472c-80e6-fbabf81d5070:22602:1875636324109440:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788746742.040771:0:22602:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.139@tcp lock: ffff8a45ae45e200/0xfac36e89154145a1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfac36e89154145a8 expref: -99 pid: 22602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746742.040781:0:22602:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.139@tcp lock: ffff8a45ae45e200/0xfac36e89154145a1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xfac36e89154145a8 expref: -99 pid: 22602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788746742.041457:0:22602:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a45bca91180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41310026-2b0a-472c-80e6-fbabf81d5070:22602:1875636324109568:0@lo:256:mount.lustre.0 00000100:00100000:3.0:1788746742.041521:0:22602:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746742.041555:0:22602:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a45c0c0ee40 going to sleep for 11 seconds 00000100:00100000:0.0:1788746742.041945:0:22618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324109568 00000100:00100000:0.0:1788746742.041955:0:22618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324109568 00000100:00100000:0.0:1788746742.041995:0:22618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788746742.042003:0:22618:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4483cdc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41310026-2b0a-472c-80e6-fbabf81d5070+10:22602:x1875636324109568:12345-0@lo:256:mount.lustre.0 20000000:01000000:0.0:1788746742.042033:0:22618:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1788746742.042040:0:22618:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:0.0:1788746742.042119:0:22618:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4483cdc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41310026-2b0a-472c-80e6-fbabf81d5070+10:22602:x1875636324109568:12345-0@lo:256:mount.lustre.0 Request processed in 116us (597us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746742.042125:0:22618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788746742.042390:0:22602:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a45bca91180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41310026-2b0a-472c-80e6-fbabf81d5070:22602:1875636324109568:0@lo:256:mount.lustre.0 10000000:01000000:3.0:1788746742.045006:0:22602:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.139@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788746742.045050:0:22602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff8a45ae45e200/0xfac36e89154145a1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfac36e89154145a8 expref: -99 pid: 22602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746742.045066:0:22602:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.139@tcp lock: ffff8a45ae45e200/0xfac36e89154145a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfac36e89154145a8 expref: -99 pid: 22602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788746742.045076:0:22602:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8a45847a0000 from 1 10000000:01000000:3.0:1788746742.045079:0:22602:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788746742.045133:0:22602:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.139@tcp lock: ffff8a45c216c400/0xfac36e89154145af lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746742.045166:0:22602:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.139@tcp lock: ffff8a45c216c400/0xfac36e89154145af lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746742.045189:0:22602:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.139@tcp lock: ffff8a45c216c400/0xfac36e89154145af lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788746742.045217:0:22602:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a45bca91180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41310026-2b0a-472c-80e6-fbabf81d5070:22602:1875636324109696:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788746742.046306:0:22602:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746742.046383:0:22602:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a45c0c0ee40 going to sleep for 11 seconds 00000100:00100000:1.0:1788746742.047627:0:22618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324109696 00000100:00100000:1.0:1788746742.047638:0:22618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324109696 00000100:00100000:1.0:1788746742.047730:0:22618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788746742.047741:0:22618:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4483cdec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41310026-2b0a-472c-80e6-fbabf81d5070+10:22602:x1875636324109696:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788746742.047757:0:22618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788746742.047776:0:22618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a45ae45e600/0xfac36e89154145b6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xfac36e89154145af expref: -99 pid: 22618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746742.047803:0:22618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a45ae45e600/0xfac36e89154145b6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfac36e89154145af expref: 11 pid: 22618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746742.047815:0:22618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a45ae45e600/0xfac36e89154145b6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfac36e89154145af expref: 11 pid: 22618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746742.047835:0:22618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a45ae45e600, rc 0) 00000100:00100000:1.0:1788746742.047906:0:22618:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4483cdec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41310026-2b0a-472c-80e6-fbabf81d5070+11:22602:x1875636324109696:12345-0@lo:101:mount.lustre.0 Request processed in 168us (1619us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746742.047913:0:22618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788746742.049843:0:22602:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a45bca91180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41310026-2b0a-472c-80e6-fbabf81d5070:22602:1875636324109696:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788746742.049871:0:22602:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.139@tcp lock: ffff8a45c216c400/0xfac36e89154145af lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfac36e89154145b6 expref: -99 pid: 22602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746742.049882:0:22602:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.139@tcp lock: ffff8a45c216c400/0xfac36e89154145af lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xfac36e89154145b6 expref: -99 pid: 22602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788746742.049981:0:22602:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a45bca91180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41310026-2b0a-472c-80e6-fbabf81d5070:22602:1875636324109824:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788746742.050259:0:22602:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746742.050354:0:22602:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a45c0c0ee40 going to sleep for 11 seconds 00000100:00100000:1.0:1788746742.050750:0:22617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324109824 00000100:00100000:1.0:1788746742.050760:0:22617:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324109824 00000100:00100000:1.0:1788746742.050928:0:22617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788746742.050940:0:22617:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4483cdf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41310026-2b0a-472c-80e6-fbabf81d5070+11:22602:x1875636324109824:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788746742.051124:0:22617:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4483cdf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41310026-2b0a-472c-80e6-fbabf81d5070+11:22602:x1875636324109824:12345-0@lo:501:mount.lustre.0 Request processed in 187us (865us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746742.051204:0:22602:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a45bca91180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41310026-2b0a-472c-80e6-fbabf81d5070:22602:1875636324109824:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788746742.051268:0:22602:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a45bca91180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41310026-2b0a-472c-80e6-fbabf81d5070:22602:1875636324109952:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788746742.051337:0:22602:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746742.051364:0:22602:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a45c0c0ee40 going to sleep for 11 seconds 00000100:00100000:2.0:1788746742.051786:0:22618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324109952 00000100:00100000:2.0:1788746742.051793:0:22618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324109952 00000100:00100000:2.0:1788746742.051888:0:22618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788746742.051901:0:22618:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4483cde050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41310026-2b0a-472c-80e6-fbabf81d5070+12:22602:x1875636324109952:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788746742.052096:0:22618:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4483cde050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41310026-2b0a-472c-80e6-fbabf81d5070+12:22602:x1875636324109952:12345-0@lo:503:mount.lustre.0 Request processed in 197us (757us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746742.052103:0:22618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788746742.052262:0:22617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788746742.052435:0:22602:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a45bca91180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41310026-2b0a-472c-80e6-fbabf81d5070:22602:1875636324109952:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788746742.053096:0:22651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a4483592d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:41310026-2b0a-472c-80e6-fbabf81d5070:22651:1875636324110080:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788746742.053153:0:22651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746742.053395:0:22651:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a45872d0d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788746742.053446:0:22618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324110080 00000100:00100000:2.0:1788746742.053453:0:22618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324110080 00000100:00100000:2.0:1788746742.055370:0:22618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788746742.055392:0:22618:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4483cdc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41310026-2b0a-472c-80e6-fbabf81d5070+11:22651:x1875636324110080:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788746742.056370:0:22618:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4483cdc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41310026-2b0a-472c-80e6-fbabf81d5070+11:22651:x1875636324110080:12345-0@lo:502:llog_process_th.0 Request processed in 985us (3213us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746742.056381:0:22618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788746742.056536:0:22651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a4483592d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:41310026-2b0a-472c-80e6-fbabf81d5070:22651:1875636324110080:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788746742.056592:0:22651:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788746742.056606:0:22651:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788746742.056609:0:22651:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788746742.056618:0:22651:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8a45847a0000 00000020:00000080:1.0:1788746742.056622:0:22651:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788746742.056635:0:22651:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788746742.056637:0:22651:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788746742.056639:0:22651:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1788746742.056641:0:22651:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788746742.056643:0:22651:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788746742.056644:0:22651:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788746742.056647:0:22651:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8a45847a0000 00000020:00000080:1.0:1788746742.056649:0:22651:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788746742.056747:0:22651:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788746742.056752:0:22651:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788746742.056753:0:22651:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1788746742.056756:0:22651:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788746742.056759:0:22651:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788746742.056760:0:22651:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788746742.056764:0:22651:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8a45847a0000 00000020:00000080:1.0:1788746742.056767:0:22651:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788746742.056786:0:22651:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788746742.056789:0:22651:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788746742.056791:0:22651:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788746742.056793:0:22651:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788746742.056796:0:22651:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788746742.056798:0:22651:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1788746742.056802:0:22651:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8a45847a0000 00000020:00000080:1.0:1788746742.056804:0:22651:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788746742.056873:0:22651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a4483592d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:41310026-2b0a-472c-80e6-fbabf81d5070:22651:1875636324110208:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788746742.056928:0:22651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746742.065127:0:22615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324110208 00000100:00100000:0.0:1788746742.065143:0:22615:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324110208 00000100:00100000:0.0:1788746742.065221:0:22615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788746742.065233:0:22615:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4585541850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41310026-2b0a-472c-80e6-fbabf81d5070+11:22651:x1875636324110208:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788746742.065420:0:22615:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4585541850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41310026-2b0a-472c-80e6-fbabf81d5070+11:22651:x1875636324110208:12345-0@lo:502:llog_process_th.0 Request processed in 188us (8491us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746742.065428:0:22615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788746742.068392:0:22651:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a45872d0d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788746742.068442:0:22651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a4483592d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:41310026-2b0a-472c-80e6-fbabf81d5070:22651:1875636324110208:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788746742.068487:0:22651:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788746742.068496:0:22651:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788746742.068499:0:22651:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1788746742.068504:0:22651:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:3.0:1788746742.068737:0:22602:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:3.0:1788746742.068771:0:22602:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.139@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788746742.068792:0:22602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff8a45c216c400/0xfac36e89154145af lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfac36e89154145b6 expref: -99 pid: 22602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746742.068804:0:22602:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.139@tcp lock: ffff8a45c216c400/0xfac36e89154145af lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfac36e89154145b6 expref: -99 pid: 22602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788746742.069377:0:22602:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788746742.069381:0:22602:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8a45847a0000 10000000:01000000:3.0:1788746742.069384:0:22602:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8a45847a0000 10000000:01000000:3.0:1788746742.069388:0:22602:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788746742.069396:0:22602:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8a45847a0000 from 1 10000000:01000000:3.0:1788746742.069399:0:22602:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788746742.069439:0:22602:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.139@tcp lock: ffff8a45c216d200/0xfac36e89154145bd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746742.069449:0:22602:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.139@tcp lock: ffff8a45c216d200/0xfac36e89154145bd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746742.069459:0:22602:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.139@tcp lock: ffff8a45c216d200/0xfac36e89154145bd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788746742.069484:0:22602:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a45bca91180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41310026-2b0a-472c-80e6-fbabf81d5070:22602:1875636324110336:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788746742.069551:0:22602:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746742.069588:0:22602:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a4583971540 going to sleep for 11 seconds 00000100:00100000:2.0:1788746742.070090:0:22615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324110336 00000100:00100000:2.0:1788746742.070098:0:22615:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324110336 00000100:00100000:2.0:1788746742.070149:0:22615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788746742.070243:0:22615:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4585543450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41310026-2b0a-472c-80e6-fbabf81d5070+11:22602:x1875636324110336:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788746742.070267:0:22615:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788746742.070284:0:22615:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a4581527a00/0xfac36e89154145c4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xfac36e89154145bd expref: -99 pid: 22615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746742.070329:0:22615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a4581527a00/0xfac36e89154145c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfac36e89154145bd expref: 12 pid: 22615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746742.070341:0:22615:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a4581527a00/0xfac36e89154145c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfac36e89154145bd expref: 12 pid: 22615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746742.070352:0:22615:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a4581527a00, rc 0) 00000100:00100000:2.0:1788746742.070407:0:22615:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4585543450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41310026-2b0a-472c-80e6-fbabf81d5070+12:22602:x1875636324110336:12345-0@lo:101:mount.lustre.0 Request processed in 249us (856us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746742.070414:0:22615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788746742.071240:0:22602:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a45bca91180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41310026-2b0a-472c-80e6-fbabf81d5070:22602:1875636324110336:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788746742.071262:0:22602:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.139@tcp lock: ffff8a45c216d200/0xfac36e89154145bd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xfac36e89154145c4 expref: -99 pid: 22602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746742.071273:0:22602:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.139@tcp lock: ffff8a45c216d200/0xfac36e89154145bd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xfac36e89154145c4 expref: -99 pid: 22602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788746742.072118:0:22602:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a45bca91180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41310026-2b0a-472c-80e6-fbabf81d5070:22602:1875636324110464:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788746742.072923:0:22602:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746742.072971:0:22602:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a4583971540 going to sleep for 11 seconds 00000100:00100000:0.0:1788746742.073132:0:22617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324110464 00000100:00100000:0.0:1788746742.073141:0:22617:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324110464 00000100:00100000:0.0:1788746742.073283:0:22617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788746742.073317:0:22617:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4585542050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41310026-2b0a-472c-80e6-fbabf81d5070+12:22602:x1875636324110464:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788746742.073472:0:22617:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4585542050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41310026-2b0a-472c-80e6-fbabf81d5070+12:22602:x1875636324110464:12345-0@lo:501:mount.lustre.0 Request processed in 157us (549us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746742.073479:0:22617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788746742.073941:0:22602:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a45bca91180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41310026-2b0a-472c-80e6-fbabf81d5070:22602:1875636324110464:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788746742.073986:0:22602:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a45bca91180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41310026-2b0a-472c-80e6-fbabf81d5070:22602:1875636324110592:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788746742.074105:0:22602:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746742.074130:0:22602:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a4583971540 going to sleep for 11 seconds 00000100:00100000:3.0:1788746742.074151:0:22615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324110592 00000100:00100000:3.0:1788746742.075282:0:22615:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324110592 00000100:00100000:3.0:1788746742.075367:0:22615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788746742.075377:0:22615:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4585543850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41310026-2b0a-472c-80e6-fbabf81d5070+12:22602:x1875636324110592:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788746742.075516:0:22615:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4585543850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41310026-2b0a-472c-80e6-fbabf81d5070+12:22602:x1875636324110592:12345-0@lo:503:mount.lustre.0 Request processed in 141us (1410us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746742.075523:0:22615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788746742.075586:0:22602:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a45bca91180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41310026-2b0a-472c-80e6-fbabf81d5070:22602:1875636324110592:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788746742.086905:0:22656:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a45bca91180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:41310026-2b0a-472c-80e6-fbabf81d5070:22656:1875636324110720:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788746742.086991:0:22656:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746742.087041:0:22656:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a4583971780 going to sleep for 11 seconds 00000100:00100000:0.0:1788746742.087241:0:22618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324110720 00000100:00100000:0.0:1788746742.087250:0:22618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324110720 00000100:00100000:0.0:1788746742.087949:0:22618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788746742.087962:0:22618:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4585543c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41310026-2b0a-472c-80e6-fbabf81d5070+12:22656:x1875636324110720:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788746742.088104:0:22618:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4585543c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41310026-2b0a-472c-80e6-fbabf81d5070+12:22656:x1875636324110720:12345-0@lo:502:llog_process_th.0 Request processed in 144us (1114us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746742.088113:0:22618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788746742.088334:0:22656:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a45bca91180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:41310026-2b0a-472c-80e6-fbabf81d5070:22656:1875636324110720:0@lo:502:llog_process_th.0 00000020:01000004:3.0:1788746742.088402:0:22656:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1788746742.088420:0:22656:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff8a45847b0000) 00000020:00000080:3.0:1788746742.088440:0:22656:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type lwp with refcount 2 00000020:01000004:3.0:1788746742.088552:0:22656:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8a45847a0000 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1788746742.088563:0:22656:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8a45847a0000 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1788746742.088565:0:22656:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8a45847a0000 4 00010000:00080000:3.0:1788746742.088596:0:22656:0:(ldlm_lib.c:103:import_set_conn()) imp ffff8a45b7f9b000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.204.139@tcp at head 00010000:00010000:3.0:1788746742.095933:0:22656:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-4 is initialized 00000020:00000080:3.0:1788746742.096413:0:22656:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1788746742.096458:0:22656:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788746742.096473:0:22656:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xfac36e89154145d2 00000100:00080000:3.0:1788746742.096484:0:22656:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788746742.096496:0:22656:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8a45b7f9b000 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:3.0:1788746742.096667:0:22656:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a45bca91180 x1875636324110848/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788746742.096699:0:22656:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788746742.096719:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a45bca91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875636324110848:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788746742.096935:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746742.097270:0:22623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324110848 00000100:00100000:1.0:1788746742.097338:0:22623:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324110848 00000100:00100000:1.0:1788746742.097382:0:22623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788746742.097391:0:22623:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4483cbc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3642:x1875636324110848:12345-0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788746742.097457:0:22623:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4483cbc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3642:x1875636324110848:12345-0@lo:38:llog_process_th.0 Request processed in 66us (658us total) trans 0 rc -11/-11 00000100:00100000:1.0:1788746742.097464:0:22623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788746742.097760:0:22656:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a45bca92d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:41310026-2b0a-472c-80e6-fbabf81d5070:22656:1875636324110976:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788746742.097808:0:22656:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746742.097843:0:22656:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a4583971240 going to sleep for 11 seconds 00000100:00100000:1.0:1788746742.098388:0:3642:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788746742.098398:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8a45b7f9b000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788746742.098402:0:3642:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1788746742.098406:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a45bca91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875636324110848:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788746742.098473:0:22617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324110976 00000100:00100000:0.0:1788746742.098480:0:22617:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324110976 00000100:00100000:0.0:1788746742.098519:0:22617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788746742.098529:0:22617:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4585540850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41310026-2b0a-472c-80e6-fbabf81d5070+12:22656:x1875636324110976:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788746742.099126:0:22617:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4585540850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41310026-2b0a-472c-80e6-fbabf81d5070+12:22656:x1875636324110976:12345-0@lo:502:llog_process_th.0 Request processed in 597us (1315us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746742.099208:0:22617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788746742.100160:0:22656:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a45bca92d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:41310026-2b0a-472c-80e6-fbabf81d5070:22656:1875636324110976:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788746742.100251:0:22656:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a4483cbf800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:41310026-2b0a-472c-80e6-fbabf81d5070:22656:1875636324111104:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788746742.100326:0:22656:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746742.100360:0:22615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324111104 00000100:00100000:0.0:1788746742.100366:0:22615:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324111104 00000100:00100000:0.0:1788746742.100402:0:22615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788746742.100410:0:22615:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4585542450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41310026-2b0a-472c-80e6-fbabf81d5070+12:22656:x1875636324111104:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788746742.100502:0:22615:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4585542450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41310026-2b0a-472c-80e6-fbabf81d5070+12:22656:x1875636324111104:12345-0@lo:502:llog_process_th.0 Request processed in 92us (176us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746742.100510:0:22615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788746742.100554:0:22656:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a448366fa80 going to sleep for 11 seconds 00000100:00100000:0.0:1788746742.101050:0:22656:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a4483cbf800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:41310026-2b0a-472c-80e6-fbabf81d5070:22656:1875636324111104:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1788746742.101079:0:22656:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:3.0:1788746742.101380:0:22602:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:3.0:1788746742.101405:0:22602:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.139@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788746742.101426:0:22602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff8a45c216d200/0xfac36e89154145bd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xfac36e89154145c4 expref: -99 pid: 22602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746742.101439:0:22602:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.139@tcp lock: ffff8a45c216d200/0xfac36e89154145bd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xfac36e89154145c4 expref: -99 pid: 22602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788746742.101592:0:22602:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788746742.101596:0:22602:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788746742.101597:0:22602:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788746742.101598:0:22602:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788746742.101599:0:22602:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788746742.101601:0:22602:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788746742.101602:0:22602:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788746742.101609:0:22602:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788746742.101610:0:22602:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788746742.101612:0:22602:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788746742.101615:0:22602:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:3.0:1788746742.101618:0:22602:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788746742.101619:0:22602:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788746742.101620:0:22602:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788746742.101620:0:22602:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788746742.101621:0:22602:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788746742.101622:0:22602:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788746742.101623:0:22602:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788746742.101624:0:22602:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788746742.101625:0:22602:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788746742.101625:0:22602:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788746742.101643:0:22602:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1788746742.101658:0:22602:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a45bca91880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41310026-2b0a-472c-80e6-fbabf81d5070:22602:1875636324111232:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788746742.101708:0:22602:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746742.101749:0:22602:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a4583971f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788746742.101949:0:22618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324111232 00000100:00100000:1.0:1788746742.101956:0:22618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324111232 00000100:00100000:1.0:1788746742.102001:0:22618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788746742.102009:0:22618:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4585540c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41310026-2b0a-472c-80e6-fbabf81d5070+12:22602:x1875636324111232:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788746742.102100:0:22618:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1788746742.102114:0:22618:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1788746742.104687:0:22618:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788746742.104708:0:22618:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:1.0:1788746742.104991:0:22639:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788746742.104997:0:22639:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788746742.105030:0:22639:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a45ae45f000/0xfac36e89154145d9 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746742.105050:0:22639:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a44825c3c00/0xfac36e89154145a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfac36e89154145a1 expref: 12 pid: 22615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746742.105060:0:22639:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a45ae45f000/0xfac36e89154145d9 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746742.105104:0:22639:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a44825c3c00/0xfac36e89154145a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xfac36e89154145a1 expref: 12 pid: 22615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746742.105135:0:22639:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a44825c3c00/0xfac36e89154145a8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xfac36e89154145a1 expref: 12 pid: 22615 timeout: 771 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788746742.105168:0:22639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a4483592d80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22639:1875636324111360:0@lo:104: 00000100:00100000:1.0:1788746742.105440:0:22639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746742.105493:0:22639:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a45872d0a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788746742.106131:0:22618:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4585540c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41310026-2b0a-472c-80e6-fbabf81d5070+12:22602:x1875636324111232:12345-0@lo:253:mount.lustre.0 Request processed in 4118us (4418us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746742.106629:0:22602:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a45bca91880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41310026-2b0a-472c-80e6-fbabf81d5070:22602:1875636324111232:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788746742.106646:0:22602:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1788746742.106649:0:22602:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788746742.106651:0:22602:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788746742.106652:0:22602:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788746742.106654:0:22602:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788746742.106655:0:22602:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788746742.106656:0:22602:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788746742.106658:0:22602:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788746742.106659:0:22602:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788746742.106661:0:22602:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788746742.106662:0:22602:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788746742.106677:0:22602:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:0.0:1788746742.107885:0:22606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324111360 00000100:00100000:0.0:1788746742.107896:0:22606:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324111360 00000100:00100000:0.0:1788746742.107958:0:22606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788746742.107968:0:22606:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4483592a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:41310026-2b0a-472c-80e6-fbabf81d5070+3:22639:x1875636324111360:12345-0@lo:104: 00010000:00010000:0.0:1788746742.107983:0:22606:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.139@tcp lock: ffff8a45ae45e200/0xfac36e89154145a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xfac36e89154145a8 expref: -99 pid: 22602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746742.108069:0:22606:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788746742.108075:0:22606:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4483592a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:41310026-2b0a-472c-80e6-fbabf81d5070+3:22639:x1875636324111360:12345-0@lo:104: Request processed in 110us (2637us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746742.108083:0:22606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788746742.108126:0:22618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788746742.108126:0:22639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a4483592d80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22639:1875636324111360:0@lo:104: 00010000:00010000:0.0:1788746742.108153:0:22639:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a45ae45f000/0xfac36e89154145d9 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746742.108196:0:22612:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788746742.109121:0:22612:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.139@tcp lock: ffff8a45ae45e200/0xfac36e89154145a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xfac36e89154145a8 expref: -99 pid: 22602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746742.109132:0:22612:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a45ae45e200 already unused, calling callback (ffffffffc1180c20) 10000000:00010000:2.0:1788746742.109137:0:22612:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.139@tcp lock: ffff8a45ae45e200/0xfac36e89154145a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xfac36e89154145a8 expref: -99 pid: 22602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746742.109148:0:22612:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.139@tcp lock: ffff8a45ae45e200/0xfac36e89154145a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xfac36e89154145a8 expref: -99 pid: 22602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788746742.109172:0:22612:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.139@tcp lock: ffff8a45ae45e200/0xfac36e89154145a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xfac36e89154145a8 expref: -99 pid: 22602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788746742.109188:0:22612:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788746742.109379:0:22612:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.139@tcp lock: ffff8a45ae45e200/0xfac36e89154145a1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfac36e89154145a8 expref: -99 pid: 22602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746742.109386:0:22612:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788746742.109414:0:22612:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.139@tcp lock: ffff8a45ae45e200/0xfac36e89154145a1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfac36e89154145a8 expref: -99 pid: 22602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746742.109422:0:22612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.139@tcp lock: ffff8a45ae45e200/0xfac36e89154145a1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfac36e89154145a8 expref: -99 pid: 22602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746742.109446:0:22612:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788746742.109448:0:22612:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788746742.109450:0:22612:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788746742.109487:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a4482711f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:41310026-2b0a-472c-80e6-fbabf81d5070:3645:1875636324111488:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788746742.109535:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746742.109878:0:22608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324111488 00000100:00100000:0.0:1788746742.109886:0:22608:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324111488 00010000:00010000:0.0:1788746742.109915:0:22608:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a44825c3c00/0xfac36e89154145a8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfac36e89154145a1 expref: 12 pid: 22615 timeout: 771 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788746742.109959:0:22608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788746742.109968:0:22608:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4482711180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41310026-2b0a-472c-80e6-fbabf81d5070+12:3645:x1875636324111488:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788746742.109981:0:22608:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788746742.109988:0:22608:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a44825c3c00/0xfac36e89154145a8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfac36e89154145a1 expref: 12 pid: 22615 timeout: 771 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746742.110011:0:22608:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a44825c3c00/0xfac36e89154145a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xfac36e89154145a1 expref: 12 pid: 22615 timeout: 771 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746742.110028:0:22608:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a44825c3c00/0xfac36e89154145a8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xfac36e89154145a1 expref: 12 pid: 22615 timeout: 771 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746742.110043:0:22608:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a45ae45f000/0xfac36e89154145d9 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746742.110052:0:22608:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a45ae45f000/0xfac36e89154145d9 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788746742.110067:0:22608:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.005070968s 00010000:00010000:0.0:1788746742.110072:0:22608:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a45ae45f000/0xfac36e89154145d9 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746742.110092:0:22608:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a45ae45f000/0xfac36e89154145d9 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746742.110098:0:22608:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a45ae45f000/0xfac36e89154145d9 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746742.110104:0:22608:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a45ae45f000/0xfac36e89154145d9 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746742.110110:0:22608:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a45ae45f000 already unused, calling callback (ffffffffc0b5a8d0) 00010000:00010000:0.0:1788746742.110114:0:22608:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a45ae45f000/0xfac36e89154145d9 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746742.110121:0:22608:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a45ae45f000/0xfac36e89154145d9 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746742.110142:0:22608:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a45ae45f000/0xfac36e89154145d9 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746742.110152:0:22608:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788746742.110210:0:22608:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4482711180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41310026-2b0a-472c-80e6-fbabf81d5070+11:3645:x1875636324111488:12345-0@lo:103:ldlm_bl.0 Request processed in 243us (674us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746742.110218:0:22608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788746742.110251:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a4482711f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:41310026-2b0a-472c-80e6-fbabf81d5070:3645:1875636324111488:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788746742.110273:0:22639:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a45ae45f000/0xfac36e89154145d9 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746742.110281:0:22639:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a45ae45f000/0xfac36e89154145d9 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746742.110309:0:22639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a45ae45f000/0xfac36e89154145d9 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1788746742.132343:0:22602:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 4294967529 00000040:01000000:3.0:1788746742.132686:0:22602:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:2.0:1788746742.132839:0:22662:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 4294967529 00000020:00080000:2.0:1788746742.132843:0:22662:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967529 00000040:01000000:2.0:1788746742.132959:0:22663:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1788746742.133110:0:22602:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00080000:3.0:1788746742.133528:0:22664:0:(client.c:1846:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff8a45bca91880 x1875636324111616/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788746742.133541:0:22664:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a45914310c0 going to sleep for 0 seconds 00000040:01000000:2.0:1788746742.133982:0:22602:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1788746742.134019:0:22602:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1788746742.134551:0:22602:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1788746742.134558:0:22602:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1788746742.134596:0:22602:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788746742.136017:0:22602:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1788746742.138007:0:22602:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1788746742.138071:0:22602:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:3.0:1788746742.140338:0:22663:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788746742.143711:0:22602:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0xa:0x7:0x0] first idx 1, last_idx 2 00000040:00080000:3.0:1788746742.144053:0:22663:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1788746742.144128:0:22663:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00080000:10000000:1.0:1788746742.147531:0:22602:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/32) registered 00000001:00000004:0.0:1788746742.152967:0:22602:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884901888 00000001:00080000:0.0:1788746742.158349:0:22602:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1788746742.158392:0:22602:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffff9fe24197f988 00100000:10000000:0.0:1788746742.158400:0:22602:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:3.0:1788746742.159165:0:22602:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788746742.159193:0:22602:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.139@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788746742.159220:0:22602:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=46 00000080:00000004:3.0:1788746742.159238:0:22602:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:3.0:1788746742.160895:0:22602:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788746742.161939:0:22602:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788746742.677885:0:22611:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788746742.741906:0:22620:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788746742.741914:0:22620:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8a45847a0000 from 11 10000000:01000000:1.0:1788746742.741919:0:22620:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788746742.742514:0:22620:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.139@tcp lock: ffff8a45ae45ee00/0xfac36e89154145e0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746742.742528:0:22620:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.139@tcp lock: ffff8a45ae45ee00/0xfac36e89154145e0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746742.742540:0:22620:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.139@tcp lock: ffff8a45ae45ee00/0xfac36e89154145e0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788746742.742568:0:22620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a4483593480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:41310026-2b0a-472c-80e6-fbabf81d5070:22620:1875636324111744:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788746742.742650:0:22620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746742.742702:0:22620:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a4584d5bd80 going to sleep for 11 seconds 00000100:00100000:0.0:1788746742.742952:0:22617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324111744 00000100:00100000:0.0:1788746742.742963:0:22617:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324111744 00000100:00100000:0.0:1788746742.743015:0:22617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788746742.743026:0:22617:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4585541c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41310026-2b0a-472c-80e6-fbabf81d5070+11:22620:x1875636324111744:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788746742.743041:0:22617:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788746742.743064:0:22617:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a44825c3c00/0xfac36e89154145e7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xfac36e89154145e0 expref: -99 pid: 22617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746742.743092:0:22617:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a44825c3c00/0xfac36e89154145e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfac36e89154145e0 expref: 12 pid: 22617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746742.743103:0:22617:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a44825c3c00/0xfac36e89154145e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfac36e89154145e0 expref: 12 pid: 22617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746742.743114:0:22617:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a44825c3c00, rc 0) 00000100:00100000:0.0:1788746742.743177:0:22617:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4585541c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41310026-2b0a-472c-80e6-fbabf81d5070+12:22620:x1875636324111744:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 143us (516us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746742.743186:0:22617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788746742.744083:0:22620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a4483593480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:41310026-2b0a-472c-80e6-fbabf81d5070:22620:1875636324111744:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788746742.744107:0:22620:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.139@tcp lock: ffff8a45ae45ee00/0xfac36e89154145e0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfac36e89154145e7 expref: -99 pid: 22620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746742.744118:0:22620:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.139@tcp lock: ffff8a45ae45ee00/0xfac36e89154145e0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xfac36e89154145e7 expref: -99 pid: 22620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788746742.744253:0:22620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a45bca92d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:41310026-2b0a-472c-80e6-fbabf81d5070:22620:1875636324111872:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788746742.744328:0:22620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746742.744369:0:22620:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a4591431900 going to sleep for 11 seconds 00000100:00100000:1.0:1788746742.744891:0:22618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324111872 00000100:00100000:1.0:1788746742.744900:0:22618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324111872 00000100:00100000:1.0:1788746742.745692:0:22618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788746742.745705:0:22618:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4585543050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41310026-2b0a-472c-80e6-fbabf81d5070+12:22620:x1875636324111872:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1788746742.745730:0:22618:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788746742.745748:0:22618:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788746742.745752:0:22618:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 11 00000100:00100000:0.0:1788746742.748302:0:22618:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4585543050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41310026-2b0a-472c-80e6-fbabf81d5070+12:22620:x1875636324111872:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 2577us (3952us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746742.748319:0:22618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788746742.749015:0:22620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a45bca92d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:41310026-2b0a-472c-80e6-fbabf81d5070:22620:1875636324111872:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788746742.749083:0:22620:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.139@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788746742.749095:0:22620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff8a45ae45ee00/0xfac36e89154145e0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfac36e89154145e7 expref: -99 pid: 22620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746742.749106:0:22620:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.139@tcp lock: ffff8a45ae45ee00/0xfac36e89154145e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfac36e89154145e7 expref: -99 pid: 22620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788746743.129094:0:22657:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788746743.129105:0:22657:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788746743.133786:0:22657:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1788746743.133810:0:22657:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1788746743.186393:0:22664:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a45914310c0 going to sleep for 0 seconds 00010000:00010000:1.0:1788746743.699864:0:22612:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788746744.146466:0:22657:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788746744.146477:0:22657:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788746744.146605:0:22657:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 1 count 1 00000040:00080000:2.0:1788746744.146646:0:22657:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788746744.146953:0:22657:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 1 00000100:00100000:3.0:1788746744.210510:0:22664:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a45914310c0 going to sleep for 0 seconds 00010000:00010000:2.0:1788746744.724039:0:22611:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788746745.234534:0:22664:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a45914310c0 going to sleep for 0 seconds 00010000:00010000:1.0:1788746745.747145:0:22612:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788746746.265620:0:22664:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a45914310c0 going to sleep for 0 seconds 00000001:02000400:1.0:1788746746.726283:0:22907:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg439-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1788746746.774004:0:22611:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788746747.282421:0:22664:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a45914310c0 going to sleep for 0 seconds 00000100:00080000:0.0:1788746747.604683:0:14946:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788746747.604691:0:14946:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1788746747.604695:0:14946:0:(import.c:65:import_set_state_nolock()) ffff8a4583263800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788746747.604703:0:14946:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 671 00000100:00080000:0.0:1788746747.604717:0:14946:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788746747.604730:0:14946:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8a4583263800 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:2.0:1788746747.604748:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a4483cbf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:41310026-2b0a-472c-80e6-fbabf81d5070:3646:1875636324112000:0@lo:400:kworker.0 00000100:00100000:0.0:1788746747.604754:0:14946:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a4483cbd880 x1875636324112128/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788746747.604769:0:14946:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788746747.604783:0:14946:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788746747.604785:0:14946:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788746747.604788:0:14946:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788746747.604790:0:14946:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788746747.604793:0:14946:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788746747.604796:0:14946:0:(import.c:65:import_set_state_nolock()) ffff8a45b7f9b000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788746747.604802:0:14946:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8a45b7f9b000 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:0.0:1788746747.604814:0:14946:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a4483cbdf80 x1875636324112256/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788746747.604821:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746747.604825:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a4483cbd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1875636324112128:0@lo:38:kworker.0 00000100:00100000:2.0:1788746747.604893:0:22615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324112000 00000100:00100000:2.0:1788746747.604901:0:22615:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324112000 00000100:00100000:1.0:1788746747.604919:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788746747.604948:0:22615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788746747.604958:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a4483cbdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875636324112256:0@lo:38:kworker.0 00000100:00100000:2.0:1788746747.604961:0:22615:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4585540450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41310026-2b0a-472c-80e6-fbabf81d5070+12:3646:x1875636324112000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788746747.604990:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788746747.605024:0:22615:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4585540450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41310026-2b0a-472c-80e6-fbabf81d5070+12:3646:x1875636324112000:12345-0@lo:400:kworker.0 Request processed in 66us (202us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746747.605032:0:22615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788746747.605094:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a4483cbf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:41310026-2b0a-472c-80e6-fbabf81d5070:3646:1875636324112000:0@lo:400:kworker.0 00000100:00100000:0.0:1788746747.605856:0:22629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324112128 00000100:00100000:0.0:1788746747.605864:0:22629:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324112128 00000100:00100000:0.0:1788746747.605920:0:22629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788746747.605927:0:22629:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4483593480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3642:x1875636324112128:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788746747.605946:0:22629:0:(ldlm_lib.c:1202:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788746747.606004:0:22629:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4483593480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3642:x1875636324112128:12345-0@lo:38:kworker.0 Request processed in 76us (1085us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788746747.606012:0:22629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788746747.606044:0:22625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324112256 00000100:00100000:0.0:1788746747.606048:0:22625:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324112256 00000100:00100000:0.0:1788746747.606083:0:22625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788746747.606088:0:22625:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4483592300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3642:x1875636324112256:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1788746747.606105:0:22625:0:(ldlm_lib.c:1456:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 677 last 0 00000020:00000080:0.0:1788746747.606145:0:22625:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xfac36e89154145ee 00000004:00100000:0.0:1788746747.606161:0:22625:0:(mdt_handler.c:7495:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788746747.606340:0:22625:0:(import.c:65:import_set_state_nolock()) ffff8a448335b000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788746747.606378:0:22625:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4483592300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875636324112256:12345-0@lo:38:kworker.0 Request processed in 289us (1389us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746747.606386:0:22625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788746747.607561:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8a4483cbdf80 x1875636324112256/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788746757 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788746747.607579:0:3642:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 3 00000100:00080000:2.0:1788746747.607588:0:3642:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1788746747.607594:0:3642:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788746747.607598:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8a45b7f9b000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788746747.607604:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a4483cbdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875636324112256:0@lo:38:kworker.0 00000100:00080000:2.0:1788746747.607629:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8a4583263800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788746747.607633:0:3642:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788746747.607636:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a4483cbd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1875636324112128:0@lo:38:kworker.0 00010000:00010000:1.0:1788746747.794467:0:22612:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788746747.904791:0:22960:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788746747.905011:0:22960:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1788746748.306415:0:22664:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a45914310c0 going to sleep for 0 seconds 00010000:00010000:0.0:1788746748.818480:0:22611:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788746748.918682:0:23010:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788746748.918834:0:23010:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1788746749.330417:0:22664:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a45914310c0 going to sleep for 0 seconds 00010000:00010000:1.0:1788746749.842704:0:22612:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788746750.354830:0:22664:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a45914310c0 going to sleep for 0 seconds 00010000:00010000:0.0:1788746750.872353:0:22611:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788746751.378874:0:22664:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a45914310c0 going to sleep for 0 seconds 00010000:00010000:2.0:1788746751.892546:0:22612:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788746752.402351:0:22664:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a45914310c0 going to sleep for 0 seconds 00000100:00080000:0.0:1788746752.722393:0:14946:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788746752.722399:0:14946:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1788746752.722403:0:14946:0:(import.c:65:import_set_state_nolock()) ffff8a4583263800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788746752.722410:0:14946:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 677 00000100:00080000:0.0:1788746752.722415:0:14946:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1788746752.722426:0:14946:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8a4583263800 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:0.0:1788746752.722448:0:14946:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a4483cbdf80 x1875636324112512/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788746752.722460:0:14946:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788746752.722463:0:14946:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788746752.722466:0:14946:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788746752.722469:0:14946:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788746752.722521:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a4483cbd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:41310026-2b0a-472c-80e6-fbabf81d5070:3643:1875636324112384:0@lo:400:kworker.0 00000100:00100000:0.0:1788746752.722587:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746752.722694:0:3642:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788746742/real 1788746742] req@ffff8a45bca91c00 x1875636324109184/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788746752 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788746752.722703:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788746752.722709:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a4483cbf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875636324112640:0@lo:400:kworker.0 00000100:00100000:3.0:1788746752.722712:0:3642:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8a45bca91c00 x1875636324109184/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788746752 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788746752.722721:0:3642:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788746742/real 1788746742] req@ffff8a45bca91500 x1875636324109056/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788746752 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788746752.722732:0:3642:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8a45bca91500 x1875636324109056/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788746752 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788746752.722736:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746752.722743:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a4483cbdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1875636324112512:0@lo:38:kworker.0 00000100:00100000:3.0:1788746752.722772:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788746752.722793:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8a45bfe8d800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:0.0:1788746752.722801:0:22618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324112384 00000100:00080000:3.0:1788746752.722807:0:3642:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788746752.722809:0:22618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324112384 00000100:00100000:3.0:1788746752.722811:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a45bca91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1875636324109184:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1788746752.722826:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8a45b7e60000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:0.0:1788746752.722850:0:22618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788746752.722858:0:22618:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4585540050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41310026-2b0a-472c-80e6-fbabf81d5070+12:3643:x1875636324112384:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1788746752.722902:0:3642:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788746752.722903:0:22618:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4585540050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41310026-2b0a-472c-80e6-fbabf81d5070+12:3643:x1875636324112384:12345-0@lo:400:kworker.0 Request processed in 46us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746752.722906:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a45bca91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1875636324109056:0@lo:8:llog_process_th.0 00000100:00100000:0.0:1788746752.722911:0:22618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788746752.722935:0:22628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324112512 00000100:00100000:0.0:1788746752.722938:0:22623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324112640 00000100:00100000:3.0:1788746752.722939:0:22628:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324112512 00000100:00100000:0.0:1788746752.722940:0:22623:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324112640 00000100:00100000:3.0:1788746752.723024:0:22628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788746752.723029:0:22628:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a45bca91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3642:x1875636324112512:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788746752.723045:0:22628:0:(ldlm_lib.c:1202:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788746752.723081:0:22628:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a45bca91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3642:x1875636324112512:12345-0@lo:38:kworker.0 Request processed in 50us (307us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788746752.723087:0:22628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:3.0:1788746752.723106:0:14946:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788746752.723110:0:14946:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1788746752.723112:0:14946:0:(import.c:65:import_set_state_nolock()) ffff8a45b7e60000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788746752.723115:0:14946:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 671 00000100:00080000:3.0:1788746752.723118:0:14946:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788746752.723123:0:14946:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8a45b7e60000 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:3.0:1788746752.723137:0:14946:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a45bca91500 x1875636324112768/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788746752.723148:0:14946:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788746752.723151:0:14946:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788746752.723152:0:14946:0:(import.c:65:import_set_state_nolock()) ffff8a45bfe8d800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788746752.723155:0:14946:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 671 00000100:00080000:3.0:1788746752.723164:0:14946:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788746752.723169:0:14946:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8a45bfe8d800 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:3.0:1788746752.723181:0:14946:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a45bca91c00 x1875636324112896/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788746752.723188:0:22623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788746752.723200:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a45bca91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1875636324112768:0@lo:8:kworker.0 00000100:00100000:0.0:1788746752.723205:0:22623:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4483cbf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875636324112640:12345-0@lo:400:kworker.0 00000400:00000100:3.0:1788746752.723222:0:3642:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875636324112768 offset 0 length 520: 4 00000100:00100000:3.0:1788746752.723234:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a45bca91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1875636324112896:0@lo:8:kworker.0 00000400:00000100:3.0:1788746752.723251:0:3642:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875636324112896 offset 0 length 520: 4 00000100:00080000:3.0:1788746752.723270:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8a4583263800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788746752.723273:0:3642:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788746752.723276:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a4483cbdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1875636324112512:0@lo:38:kworker.0 00010000:00080000:2.0:1788746752.723548:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8a4483cbf800 x1875636324112640/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788746768 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788746752.723560:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a4483cbf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875636324112640:0@lo:400:kworker.0 00000100:00100000:2.0:1788746752.723569:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a4483cbd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:41310026-2b0a-472c-80e6-fbabf81d5070:3643:1875636324112384:0@lo:400:kworker.0 00000100:00100000:0.0:1788746752.723698:0:22623:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4483cbf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875636324112640:12345-0@lo:400:kworker.0 Request processed in 492us (959us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746752.723705:0:22623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:2.0:1788746752.917670:0:22611:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788746753.430631:0:22664:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a45914310c0 going to sleep for 0 seconds 00010000:00010000:2.0:1788746753.941407:0:22612:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788746754.388996:0:22657:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788746754.450387:0:22664:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a45914310c0 going to sleep for 0 seconds 00010000:00010000:2.0:1788746754.962515:0:22611:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788746755.474435:0:22664:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a45914310c0 going to sleep for 0 seconds 00010000:00010000:3.0:1788746755.992630:0:22612:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788746756.057867:0:23356:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1788746756.057872:0:23356:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:0.0:1788746756.057873:0:23356:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:0.0:1788746756.058019:0:23356:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8a4582bdb800 00000020:01000004:0.0:1788746756.058039:0:23356:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200001, mountfl=0 00000020:01000004:0.0:1788746756.058053:0:23356:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1788746756.058069:0:23356:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (ffff8a45bdd7b380) 00000020:00000080:0.0:1788746756.058087:0:23356:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1788746756.118689:0:23356:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xd:0x0] (16/1) registered 00100000:10000000:2.0:1788746756.120648:0:23356:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1788746756.121534:0:23356:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:2.0:1788746756.121759:0:23356:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x24:0x0] (24/16) registered 00100000:10000000:2.0:1788746756.122083:0:23356:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x20:0x0] (24/16) registered 00100000:10000000:2.0:1788746756.122262:0:23356:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:2.0:1788746756.122582:0:23356:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:2.0:1788746756.122875:0:23356:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:2.0:1788746756.123106:0:23356:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x22:0x0] (24/16) registered 00100000:10000000:2.0:1788746756.123314:0:23356:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:2.0:1788746756.123533:0:23356:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x23:0x0] (24/16) registered 00100000:10000000:2.0:1788746756.123764:0:23356:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:2.0:1788746756.124059:0:23356:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:2.0:1788746756.124265:0:23356:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:2.0:1788746756.125701:0:23356:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x10:0x0] (16/1) registered 00100000:10000000:2.0:1788746756.126055:0:23356:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:2.0:1788746756.126259:0:23356:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x12:0x0] (16/1) registered 00100000:10000000:2.0:1788746756.126654:0:23356:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:2.0:1788746756.126869:0:23356:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x21:0x0] (24/16) registered 00100000:10000000:2.0:1788746756.127152:0:23356:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xf:0x0] (16/1) registered 00100000:10000000:2.0:1788746756.127351:0:23356:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:2.0:1788746756.127564:0:23356:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:2.0:1788746756.127881:0:23356:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x11:0x0] (16/1) registered 00100000:10000000:2.0:1788746756.128236:0:23356:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:2.0:1788746756.128595:0:23356:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:2.0:1788746756.128767:0:23356:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1f:0x0] (24/16) registered 00100000:10000000:2.0:1788746756.129045:0:23356:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:2.0:1788746756.129210:0:23356:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:2.0:1788746756.129485:0:23356:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:2.0:1788746756.129689:0:23356:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:2.0:1788746756.129899:0:23356:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:2.0:1788746756.130101:0:23356:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:2.0:1788746756.130319:0:23356:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:2.0:1788746756.131000:0:23356:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xe:0x0] (16/1) registered 00100000:10000000:0.0:1788746756.131625:0:23356:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:0.0:1788746756.132249:0:23356:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00100000:10000000:0.0:1788746756.132535:0:23356:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:0.0:1788746756.132726:0:23356:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:0.0:1788746756.133008:0:23356:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:0.0:1788746756.133202:0:23356:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:0.0:1788746756.133641:0:23356:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:0.0:1788746756.133895:0:23356:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:0.0:1788746756.134093:0:23356:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00100000:10000000:0.0:1788746756.134282:0:23356:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:0.0:1788746756.134748:0:23356:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:0.0:1788746756.135040:0:23356:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00080000:01000000:0.0:1788746756.139217:0:23356:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1788746756.139759:0:23356:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:0.0:1788746756.139771:0:23356:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:0.0:1788746756.139783:0:23356:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xfac36e89154145fc 00000020:01000004:0.0:1788746756.139790:0:23356:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:0.0:1788746756.140048:0:23356:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.139@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1788746756.140053:0:23356:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.139@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1788746756.140061:0:23356:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:0.0:1788746756.140088:0:23356:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:0.0:1788746756.140091:0:23356:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.139@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:1.0:1788746756.145661:0:23356:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.139@tcp ctxt 0 is initialized 00000020:01000004:1.0:1788746756.145706:0:23356:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.204.139@tcp, index=0001, flags=0x20001 00000020:01000004:1.0:1788746756.145711:0:23356:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1788746756.145713:0:23356:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1788746756.145714:0:23356:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788746756.145716:0:23356:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788746756.145717:0:23356:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788746756.145718:0:23356:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788746756.145719:0:23356:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788746756.145721:0:23356:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788746756.145723:0:23356:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788746756.145727:0:23356:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020001 00000020:01000004:1.0:1788746756.145729:0:23356:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788746756.145730:0:23356:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1788746756.145731:0:23356:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788746756.145732:0:23356:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788746756.145733:0:23356:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788746756.145734:0:23356:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788746756.145735:0:23356:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788746756.145737:0:23356:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788746756.145738:0:23356:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788746756.145766:0:23356:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:1.0:1788746756.145788:0:23356:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a4483591180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41310026-2b0a-472c-80e6-fbabf81d5070:23356:1875636324113024:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788746756.145958:0:23356:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746756.146054:0:23356:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a4584d5b540 going to sleep for 11 seconds 00000100:00100000:0.0:1788746756.146108:0:22617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324113024 00000100:00100000:0.0:1788746756.146116:0:22617:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324113024 00000100:00100000:0.0:1788746756.146183:0:22617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788746756.146193:0:22617:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4585542c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41310026-2b0a-472c-80e6-fbabf81d5070+12:23356:x1875636324113024:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788746756.146233:0:22617:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1788746756.146237:0:22617:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0001 is running on 0@lo 20000000:01000000:0.0:1788746756.146246:0:22617:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:0.0:1788746756.147226:0:22617:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4585542c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41310026-2b0a-472c-80e6-fbabf81d5070+12:23356:x1875636324113024:12345-0@lo:253:mount.lustre.0 Request processed in 1029us (1263us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746756.147236:0:22617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788746756.147736:0:23356:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a4483591180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41310026-2b0a-472c-80e6-fbabf81d5070:23356:1875636324113024:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788746756.147749:0:23356:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:1.0:1788746756.147752:0:23356:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788746756.147754:0:23356:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1788746756.147755:0:23356:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788746756.147756:0:23356:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788746756.147758:0:23356:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788746756.147759:0:23356:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788746756.147767:0:23356:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788746756.147769:0:23356:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788746756.147771:0:23356:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1788746756.147792:0:23356:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8a4582bdb800 from lustre-MDT0001 10000000:01000000:1.0:1788746756.147886:0:23356:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:1.0:1788746756.147888:0:23356:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:1.0:1788746756.147895:0:23356:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8a4483138000 local copy 00010000:00010000:1.0:1788746756.147905:0:23356:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.139@tcp lock: ffff8a44825c3400/0xfac36e89154144f2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xfac36e89154144f9 expref: -99 pid: 22602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788746756.148008:0:23356:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a4483591180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41310026-2b0a-472c-80e6-fbabf81d5070:23356:1875636324113152:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788746756.148043:0:23356:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746756.148125:0:23356:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a4584d5be40 going to sleep for 11 seconds 00000100:00100000:2.0:1788746756.148164:0:22615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324113152 00000100:00100000:2.0:1788746756.148171:0:22615:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324113152 00000100:00100000:2.0:1788746756.148255:0:22615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788746756.148264:0:22615:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4585541050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41310026-2b0a-472c-80e6-fbabf81d5070+12:23356:x1875636324113152:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788746756.148365:0:22615:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4585541050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41310026-2b0a-472c-80e6-fbabf81d5070+12:23356:x1875636324113152:12345-0@lo:501:mount.lustre.0 Request processed in 103us (321us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788746756.148372:0:22615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788746756.148444:0:23356:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a4483591180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41310026-2b0a-472c-80e6-fbabf81d5070:23356:1875636324113152:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1788746756.148458:0:23356:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.139@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1788746756.148474:0:23356:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.139@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1788746756.148480:0:23356:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff8a44825c3400/0xfac36e89154144f2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xfac36e89154144f9 expref: -99 pid: 22602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746756.148490:0:23356:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.139@tcp lock: ffff8a44825c3400/0xfac36e89154144f2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xfac36e89154144f9 expref: -99 pid: 22602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788746756.148515:0:23356:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8a4582bdb800 10000000:01000000:1.0:1788746756.148532:0:23356:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788746756.148538:0:23356:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff8a4483138000 10000000:01000000:1.0:1788746756.148540:0:23356:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:1.0:1788746756.148543:0:23356:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8a4483138000 from 1 10000000:01000000:1.0:1788746756.148556:0:23356:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1788746756.148580:0:23356:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.139@tcp lock: ffff8a45ae45fc00/0xfac36e8915414603 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746756.148600:0:23356:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.139@tcp lock: ffff8a45ae45fc00/0xfac36e8915414603 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746756.148609:0:23356:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.139@tcp lock: ffff8a45ae45fc00/0xfac36e8915414603 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788746756.148622:0:23356:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a4483591180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41310026-2b0a-472c-80e6-fbabf81d5070:23356:1875636324113280:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788746756.148649:0:23356:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746756.149049:0:23356:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a4584d5be40 going to sleep for 11 seconds 00000100:00100000:0.0:1788746756.149352:0:22618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324113280 00000100:00100000:0.0:1788746756.149359:0:22618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324113280 00000100:00100000:0.0:1788746756.149392:0:22618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788746756.149400:0:22618:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a45af2a5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41310026-2b0a-472c-80e6-fbabf81d5070+12:23356:x1875636324113280:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788746756.149412:0:22618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788746756.149427:0:22618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a44825c3e00/0xfac36e891541460a lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xfac36e8915414603 expref: -99 pid: 22618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746756.149450:0:22618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a44825c3e00/0xfac36e891541460a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfac36e8915414603 expref: 13 pid: 22618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746756.149461:0:22618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a44825c3e00/0xfac36e891541460a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfac36e8915414603 expref: 13 pid: 22618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746756.149470:0:22618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a44825c3e00, rc 0) 00000100:00100000:0.0:1788746756.149509:0:22618:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a45af2a5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41310026-2b0a-472c-80e6-fbabf81d5070+13:23356:x1875636324113280:12345-0@lo:101:mount.lustre.0 Request processed in 110us (859us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746756.149516:0:22618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788746756.149682:0:23356:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a4483591180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41310026-2b0a-472c-80e6-fbabf81d5070:23356:1875636324113280:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788746756.149697:0:23356:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.139@tcp lock: ffff8a45ae45fc00/0xfac36e8915414603 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfac36e891541460a expref: -99 pid: 23356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746756.149706:0:23356:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.139@tcp lock: ffff8a45ae45fc00/0xfac36e8915414603 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xfac36e891541460a expref: -99 pid: 23356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788746756.149721:0:23356:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.139@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1788746756.149734:0:23356:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff8a45ae45fc00/0xfac36e8915414603 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfac36e891541460a expref: -99 pid: 23356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746756.149741:0:23356:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.139@tcp lock: ffff8a45ae45fc00/0xfac36e8915414603 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfac36e891541460a expref: -99 pid: 23356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788746756.149749:0:23356:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8a4582bdb800 10000000:01000000:1.0:1788746756.149763:0:23356:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1788746756.149766:0:23356:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8a4582bdb800 from 1 10000000:01000000:1.0:1788746756.149769:0:23356:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1788746756.149810:0:23356:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.139@tcp lock: ffff8a45ae45f800/0xfac36e8915414611 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746756.149818:0:23356:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.139@tcp lock: ffff8a45ae45f800/0xfac36e8915414611 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746756.149825:0:23356:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.139@tcp lock: ffff8a45ae45f800/0xfac36e8915414611 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788746756.149839:0:23356:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a4483591180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41310026-2b0a-472c-80e6-fbabf81d5070:23356:1875636324113408:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788746756.149869:0:23356:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746756.149884:0:23356:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a4584d5be40 going to sleep for 11 seconds 00000100:00100000:0.0:1788746756.149992:0:22618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324113408 00000100:00100000:0.0:1788746756.149997:0:22618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324113408 00000100:00100000:0.0:1788746756.150013:0:22618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788746756.150018:0:22618:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a45af2a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41310026-2b0a-472c-80e6-fbabf81d5070+13:23356:x1875636324113408:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788746756.150025:0:22618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788746756.150033:0:22618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a44825c2800/0xfac36e8915414618 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xfac36e8915414611 expref: -99 pid: 22618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746756.150047:0:22618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a44825c2800/0xfac36e8915414618 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfac36e8915414611 expref: 14 pid: 22618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746756.150055:0:22618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a44825c2800/0xfac36e8915414618 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfac36e8915414611 expref: 14 pid: 22618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746756.150068:0:22618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a44825c2800, rc 0) 00000100:00100000:0.0:1788746756.150104:0:22618:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a45af2a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41310026-2b0a-472c-80e6-fbabf81d5070+14:23356:x1875636324113408:12345-0@lo:101:mount.lustre.0 Request processed in 85us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746756.150110:0:22618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788746756.150170:0:23356:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a4483591180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41310026-2b0a-472c-80e6-fbabf81d5070:23356:1875636324113408:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788746756.150180:0:23356:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.139@tcp lock: ffff8a45ae45f800/0xfac36e8915414611 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfac36e8915414618 expref: -99 pid: 23356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746756.150188:0:23356:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.139@tcp lock: ffff8a45ae45f800/0xfac36e8915414611 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xfac36e8915414618 expref: -99 pid: 23356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788746756.150198:0:23356:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.139@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1788746756.150214:0:23356:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff8a45ae45f800/0xfac36e8915414611 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfac36e8915414618 expref: -99 pid: 23356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746756.150222:0:23356:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.139@tcp lock: ffff8a45ae45f800/0xfac36e8915414611 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfac36e8915414618 expref: -99 pid: 23356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788746756.150228:0:23356:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:1.0:1788746756.150231:0:23356:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788746756.150235:0:23356:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8a4582bdb800 10000000:01000000:1.0:1788746756.150243:0:23356:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1788746756.150246:0:23356:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:1.0:1788746756.150248:0:23356:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:1.0:1788746756.150262:0:23356:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.139@tcp lock: ffff8a45ae45fa00/0xfac36e891541461f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746756.150269:0:23356:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.139@tcp lock: ffff8a45ae45fa00/0xfac36e891541461f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746756.150276:0:23356:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.139@tcp lock: ffff8a45ae45fa00/0xfac36e891541461f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788746756.150312:0:23356:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a4483591180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41310026-2b0a-472c-80e6-fbabf81d5070:23356:1875636324113536:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788746756.150337:0:23356:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746756.150350:0:23356:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a4584d5be40 going to sleep for 11 seconds 00000100:00100000:0.0:1788746756.150415:0:22618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324113536 00000100:00100000:0.0:1788746756.150419:0:22618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324113536 00000100:00100000:0.0:1788746756.150438:0:22618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788746756.150444:0:22618:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a45af2a7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41310026-2b0a-472c-80e6-fbabf81d5070+14:23356:x1875636324113536:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788746756.150451:0:22618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788746756.150459:0:22618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a44825c3600/0xfac36e8915414626 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xfac36e891541461f expref: -99 pid: 22618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746756.150472:0:22618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a44825c3600/0xfac36e8915414626 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfac36e891541461f expref: 15 pid: 22618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746756.150480:0:22618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a44825c3600/0xfac36e8915414626 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfac36e891541461f expref: 15 pid: 22618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746756.150486:0:22618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a44825c3600, rc 0) 00000100:00100000:0.0:1788746756.150681:0:22618:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a45af2a7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41310026-2b0a-472c-80e6-fbabf81d5070+15:23356:x1875636324113536:12345-0@lo:101:mount.lustre.0 Request processed in 236us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746756.150688:0:22618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788746756.150906:0:23356:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a4483591180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41310026-2b0a-472c-80e6-fbabf81d5070:23356:1875636324113536:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788746756.150929:0:23356:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.139@tcp lock: ffff8a45ae45fa00/0xfac36e891541461f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xfac36e8915414626 expref: -99 pid: 23356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746756.150937:0:23356:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.139@tcp lock: ffff8a45ae45fa00/0xfac36e891541461f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xfac36e8915414626 expref: -99 pid: 23356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788746756.152493:0:23356:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 46 count 46 00000040:00080000:1.0:1788746756.153670:0:23356:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788746756.158251:0:23356:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:1.0:1788746756.158392:0:23356:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 136 off8552 00000040:00080000:1.0:1788746756.158407:0:23356:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 176 off8728 00000040:00080000:1.0:1788746756.158418:0:23356:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8952 00000040:00080000:1.0:1788746756.158429:0:23356:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 224 off9176 00000040:00080000:1.0:1788746756.158443:0:23356:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 120 off9296 00000040:00080000:1.0:1788746756.158466:0:23356:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 112 off9408 00000040:00080000:1.0:1788746756.158478:0:23356:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 160 off9568 00000040:00080000:1.0:1788746756.158490:0:23356:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9792 00000040:00080000:1.0:1788746756.158503:0:23356:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10016 00000040:00080000:1.0:1788746756.158516:0:23356:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 88 off10104 00000040:00080000:1.0:1788746756.158677:0:23356:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 144 off10248 00000040:00080000:1.0:1788746756.158693:0:23356:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].13, 152 off10400 00000040:00080000:1.0:1788746756.158708:0:23356:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].14, 168 off10568 00000040:00080000:1.0:1788746756.158723:0:23356:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].15, 224 off10792 00000040:00080000:1.0:1788746756.158737:0:23356:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].16, 224 off11016 00000040:00080000:1.0:1788746756.158752:0:23356:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].17, 80 off11096 00000040:00080000:1.0:1788746756.158768:0:23356:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].18, 224 off11320 00000040:00080000:1.0:1788746756.158789:0:23356:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].19, 224 off11544 00000040:00080000:1.0:1788746756.158881:0:23356:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].20, 160 off11704 00000040:00080000:1.0:1788746756.158899:0:23356:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].21, 224 off11928 00000040:00080000:1.0:1788746756.158924:0:23356:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].22, 224 off12152 00000040:00080000:1.0:1788746756.158939:0:23356:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].23, 80 off12232 00000040:00080000:1.0:1788746756.158952:0:23356:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].24, 224 off12456 00000040:00080000:1.0:1788746756.158964:0:23356:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].25, 224 off12680 00000040:00080000:1.0:1788746756.158976:0:23356:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].26, 88 off12768 00000040:00080000:1.0:1788746756.158989:0:23356:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].27, 144 off12912 00000040:00080000:1.0:1788746756.159001:0:23356:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].28, 152 off13064 00000040:00080000:1.0:1788746756.159013:0:23356:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].29, 136 off13200 00000040:00080000:1.0:1788746756.159028:0:23356:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].30, 224 off13424 00000040:00080000:1.0:1788746756.159042:0:23356:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].31, 224 off13648 00000040:00080000:1.0:1788746756.159055:0:23356:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].32, 80 off13728 00000040:00080000:1.0:1788746756.159069:0:23356:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].33, 224 off13952 00000040:00080000:1.0:1788746756.159083:0:23356:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].34, 224 off14176 00000040:00080000:1.0:1788746756.159093:0:23356:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].35, 88 off14264 00000040:00080000:1.0:1788746756.159104:0:23356:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].36, 144 off14408 00000040:00080000:1.0:1788746756.159118:0:23356:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].37, 152 off14560 00000040:00080000:1.0:1788746756.159132:0:23356:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].38, 136 off14696 00000040:00080000:1.0:1788746756.159145:0:23356:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].39, 224 off14920 00000040:00080000:1.0:1788746756.159169:0:23356:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].40, 224 off15144 00000040:00080000:1.0:1788746756.159182:0:23356:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].41, 80 off15224 00000040:00080000:1.0:1788746756.159194:0:23356:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].42, 224 off15448 00000040:00080000:1.0:1788746756.159208:0:23356:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].43, 224 off15672 00000040:00080000:1.0:1788746756.159224:0:23356:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].44, 120 off15792 00000040:00080000:1.0:1788746756.159256:0:23356:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].45, 224 off16016 00000040:00080000:1.0:1788746756.159262:0:23356:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 45 count 46 00000100:00100000:1.0:1788746756.159465:0:23356:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a4483591180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41310026-2b0a-472c-80e6-fbabf81d5070:23356:1875636324113664:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788746756.159668:0:23356:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746756.159780:0:23356:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a4584d5bf00 going to sleep for 11 seconds 00000100:00100000:0.0:1788746756.159891:0:22618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324113664 00000100:00100000:0.0:1788746756.159899:0:22618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324113664 00000100:00100000:0.0:1788746756.160014:0:22618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788746756.160025:0:22618:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a45af2a4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41310026-2b0a-472c-80e6-fbabf81d5070+15:23356:x1875636324113664:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788746756.160182:0:22618:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a45af2a4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41310026-2b0a-472c-80e6-fbabf81d5070+15:23356:x1875636324113664:12345-0@lo:501:mount.lustre.0 Request processed in 158us (513us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746756.160201:0:22618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788746756.160277:0:23356:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a4483591180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41310026-2b0a-472c-80e6-fbabf81d5070:23356:1875636324113664:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788746756.160355:0:23356:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a4483591180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41310026-2b0a-472c-80e6-fbabf81d5070:23356:1875636324113792:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788746756.160397:0:23356:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746756.160590:0:23356:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a4584d5bf00 going to sleep for 11 seconds 00000100:00100000:2.0:1788746756.160790:0:22615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324113792 00000100:00100000:2.0:1788746756.160806:0:22615:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324113792 00000100:00100000:2.0:1788746756.160836:0:22615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788746756.160843:0:22615:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a45af2a5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41310026-2b0a-472c-80e6-fbabf81d5070+15:23356:x1875636324113792:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788746756.161611:0:22615:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a45af2a5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41310026-2b0a-472c-80e6-fbabf81d5070+15:23356:x1875636324113792:12345-0@lo:503:mount.lustre.0 Request processed in 765us (1210us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746756.161618:0:22615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788746756.161841:0:23356:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a4483591180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41310026-2b0a-472c-80e6-fbabf81d5070:23356:1875636324113792:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788746756.162259:0:23356:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788746756.162352:0:23356:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a4483591180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41310026-2b0a-472c-80e6-fbabf81d5070:23356:1875636324113920:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788746756.162397:0:23356:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746756.162422:0:23356:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a4585352840 going to sleep for 11 seconds 00000100:00100000:2.0:1788746756.162479:0:22615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324113920 00000100:00100000:2.0:1788746756.162485:0:22615:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324113920 00000100:00100000:2.0:1788746756.162512:0:22615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788746756.162530:0:22615:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a45af2a6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41310026-2b0a-472c-80e6-fbabf81d5070+15:23356:x1875636324113920:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788746756.163220:0:22615:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a45af2a6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41310026-2b0a-472c-80e6-fbabf81d5070+15:23356:x1875636324113920:12345-0@lo:502:mount.lustre.0 Request processed in 700us (821us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746756.163227:0:22615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788746756.163381:0:23356:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a4483591180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41310026-2b0a-472c-80e6-fbabf81d5070:23356:1875636324113920:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788746756.163690:0:23356:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:1.0:1788746756.163719:0:23356:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 136 off8552 00000040:00080000:1.0:1788746756.163735:0:23356:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 176 off8728 00000040:00080000:1.0:1788746756.163750:0:23356:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8952 00000040:00080000:1.0:1788746756.163765:0:23356:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 224 off9176 00000040:00080000:1.0:1788746756.163780:0:23356:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 120 off9296 00000040:00080000:1.0:1788746756.163794:0:23356:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 112 off9408 00000040:00080000:1.0:1788746756.163819:0:23356:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 160 off9568 00000040:00080000:1.0:1788746756.163833:0:23356:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9792 00000040:00080000:1.0:1788746756.163846:0:23356:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10016 00000040:00080000:1.0:1788746756.163860:0:23356:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 88 off10104 00000040:00080000:1.0:1788746756.163875:0:23356:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 144 off10248 00000040:00080000:1.0:1788746756.163891:0:23356:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].13, 152 off10400 00000040:00080000:1.0:1788746756.163904:0:23356:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].14, 168 off10568 00000040:00080000:1.0:1788746756.163931:0:23356:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].15, 224 off10792 00000040:00080000:1.0:1788746756.163948:0:23356:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].16, 224 off11016 00000040:00080000:1.0:1788746756.163960:0:23356:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].17, 80 off11096 00000040:00080000:1.0:1788746756.163972:0:23356:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].18, 224 off11320 00000040:00080000:1.0:1788746756.163985:0:23356:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].19, 224 off11544 00000040:00080000:1.0:1788746756.163997:0:23356:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].20, 160 off11704 00000040:00080000:1.0:1788746756.164009:0:23356:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].21, 224 off11928 00000040:00080000:1.0:1788746756.164021:0:23356:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].22, 224 off12152 00000040:00080000:1.0:1788746756.164032:0:23356:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].23, 80 off12232 00000040:00080000:1.0:1788746756.164046:0:23356:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].24, 224 off12456 00000040:00080000:1.0:1788746756.164060:0:23356:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].25, 224 off12680 00000040:00080000:1.0:1788746756.164073:0:23356:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].26, 88 off12768 00000040:00080000:1.0:1788746756.164085:0:23356:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].27, 144 off12912 00000040:00080000:1.0:1788746756.164097:0:23356:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].28, 152 off13064 00000040:00080000:1.0:1788746756.164110:0:23356:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].29, 136 off13200 00000040:00080000:1.0:1788746756.164124:0:23356:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].30, 224 off13424 00000040:00080000:1.0:1788746756.164136:0:23356:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].31, 224 off13648 00000040:00080000:1.0:1788746756.164149:0:23356:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].32, 80 off13728 00000040:00080000:1.0:1788746756.164161:0:23356:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].33, 224 off13952 00000040:00080000:1.0:1788746756.164174:0:23356:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].34, 224 off14176 00000040:00080000:1.0:1788746756.164187:0:23356:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].35, 88 off14264 00000040:00080000:1.0:1788746756.164201:0:23356:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].36, 144 off14408 00000040:00080000:1.0:1788746756.164214:0:23356:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].37, 152 off14560 00000040:00080000:1.0:1788746756.164230:0:23356:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].38, 136 off14696 00000040:00080000:1.0:1788746756.164244:0:23356:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].39, 224 off14920 00000040:00080000:1.0:1788746756.164257:0:23356:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].40, 224 off15144 00000040:00080000:1.0:1788746756.164283:0:23356:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].41, 80 off15224 00000040:00080000:1.0:1788746756.164442:0:23356:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].42, 224 off15448 00000040:00080000:1.0:1788746756.164457:0:23356:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].43, 224 off15672 00000040:00080000:1.0:1788746756.164471:0:23356:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].44, 120 off15792 00000100:00100000:1.0:1788746756.164509:0:23356:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a4483591180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41310026-2b0a-472c-80e6-fbabf81d5070:23356:1875636324114048:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788746756.164764:0:23356:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746756.164801:0:23356:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a4585352840 going to sleep for 11 seconds 00000100:00100000:2.0:1788746756.164856:0:22615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324114048 00000100:00100000:2.0:1788746756.164864:0:22615:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324114048 00000100:00100000:2.0:1788746756.164898:0:22615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788746756.164906:0:22615:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a45af2a6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41310026-2b0a-472c-80e6-fbabf81d5070+15:23356:x1875636324114048:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788746756.165015:0:22615:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a45af2a6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41310026-2b0a-472c-80e6-fbabf81d5070+15:23356:x1875636324114048:12345-0@lo:502:mount.lustre.0 Request processed in 109us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746756.165022:0:22615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788746756.165172:0:23356:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a4483591180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41310026-2b0a-472c-80e6-fbabf81d5070:23356:1875636324114048:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788746756.165214:0:23356:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].45, 224 off16016 00000040:00080000:1.0:1788746756.165221:0:23356:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 45 count 46 00000020:01000000:1.0:1788746756.166132:0:23360:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788746756.166143:0:23360:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788746756.166145:0:23360:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:1.0:1788746756.166151:0:23360:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:1.0:1788746756.166154:0:23360:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788746756.166166:0:23360:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (ffff8a448313cd40) 00000020:00000080:1.0:1788746756.166185:0:23360:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type lod with refcount 2 00000020:00000080:1.0:1788746756.166190:0:23360:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1788746756.166252:0:23360:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788746756.166258:0:23360:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xfac36e8915414634 00000020:00000080:1.0:1788746756.166667:0:23360:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:1.0:1788746756.166672:0:23360:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788746756.166676:0:23360:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788746756.166677:0:23360:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:1.0:1788746756.166680:0:23360:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788746756.166684:0:23360:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788746756.166686:0:23360:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:1.0:1788746756.166689:0:23360:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788746756.166697:0:23360:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (ffff8a45c0ee3380) 00000020:00000080:1.0:1788746756.166709:0:23360:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdt with refcount 2 00000020:00000080:1.0:1788746756.166713:0:23360:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1788746756.166720:0:23360:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:1.0:1788746756.166723:0:23360:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:1.0:1788746756.166731:0:23360:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788746756.166776:0:23360:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8a4582bdb800 from lustre-MDT0001, refs=2 00000020:00000080:1.0:1788746756.166788:0:23360:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (ffff8a45c0ee4d40) 00000020:00000080:1.0:1788746756.166796:0:23360:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type mdd with refcount 2 00000004:01000000:1.0:1788746756.166859:0:23360:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1788746756.166866:0:23360:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xfac36e8915414649 00000020:00000080:1.0:1788746756.167063:0:23360:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:1.0:1788746756.167071:0:23360:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1788746756.167077:0:23360:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0xfac36e8915414650 00080000:01000000:1.0:1788746756.167082:0:23360:0:(osd_handler.c:8924:osd_obd_connect()) connect #2 00000020:00000080:1.0:1788746756.167085:0:23360:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xfac36e8915414657 00010000:00010000:0.0:1788746756.231087:0:23360:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:00000004:0.0:1788746756.231712:0:23360:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 8589934595 00000001:00080000:0.0:1788746756.232050:0:23360:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:1.0:1788746756.233098:0:23360:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:1.0:1788746756.233110:0:23360:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788746756.233116:0:23360:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788746756.233118:0:23360:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:1.0:1788746756.233122:0:23360:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788746756.233127:0:23360:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788746756.233128:0:23360:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:1.0:1788746756.233131:0:23360:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788746756.233136:0:23360:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.139@tcp to nid 0x20000c0a8cc8b (192.168.204.139@tcp) 00000020:00000080:1.0:1788746756.233168:0:23360:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788746756.233183:0:23360:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (ffff8a45c0ee0000) 00000020:00000080:1.0:1788746756.233205:0:23360:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osp with refcount 2 00000020:00000080:1.0:1788746756.233210:0:23360:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788746756.233414:0:23360:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:3.0:1788746756.233488:0:23360:0:(osd_handler.c:8924:osd_obd_connect()) connect #3 00000020:00000080:3.0:1788746756.233497:0:23360:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xfac36e8915414665 00010000:00080000:3.0:1788746756.233541:0:23360:0:(ldlm_lib.c:103:import_set_conn()) imp ffff8a45a0cf5800@lustre-MDT0000-osp-MDT0001: add connection 192.168.204.139@tcp at head 00010000:00010000:3.0:1788746756.235494:0:23360:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-5 is initialized 00000020:00000080:3.0:1788746756.244328:0:23360:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788746756.244345:0:23360:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:3.0:1788746756.244394:0:23360:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:3.0:1788746756.244419:0:23360:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xfac36e891541466c 00000100:00080000:3.0:1788746756.244430:0:23360:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788746756.244442:0:23360:0:(import.c:666:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8a45a0cf5800 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:3.0:1788746756.244480:0:23360:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a45bca92300 x1875636324114176/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788746756.244513:0:23360:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788746756.244692:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a45bca92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1875636324114176:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788746756.244770:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:3.0:1788746756.244929:0:23360:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788746756.244938:0:23360:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788746756.244940:0:23360:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:3.0:1788746756.244944:0:23360:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788746756.244947:0:23360:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:3.0:1788746756.244949:0:23360:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788746756.244950:0:23360:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788746756.244951:0:23360:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788746756.244954:0:23360:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788746756.244956:0:23360:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788746756.244959:0:23360:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788746756.244964:0:23360:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788746756.244965:0:23360:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:3.0:1788746756.244969:0:23360:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1788746756.245006:0:23360:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1788746756.245021:0:23360:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788746756.245025:0:23360:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788746756.245026:0:23360:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:3.0:1788746756.245029:0:23360:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788746756.245030:0:23360:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #19 00000020:01000000:3.0:1788746756.245032:0:23360:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788746756.245033:0:23360:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788746756.245035:0:23360:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788746756.245037:0:23360:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788746756.245038:0:23360:0:(obd_config.c:1563:class_process_config()) marker 19 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788746756.245041:0:23360:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788746756.245044:0:23360:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:3.0:1788746756.245047:0:23360:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788746756.245048:0:23360:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1788746756.245050:0:23360:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788746756.245054:0:23360:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.139@tcp to nid 0x20000c0a8cc8b (192.168.204.139@tcp) 00000020:01000000:3.0:1788746756.245074:0:23360:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:3.0:1788746756.245076:0:23360:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788746756.245089:0:23360:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff8a45847b4d40) 00000020:00000080:3.0:1788746756.245102:0:23360:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:3.0:1788746756.245114:0:23360:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788746756.245170:0:23360:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:3.0:1788746756.245176:0:23360:0:(osd_handler.c:8924:osd_obd_connect()) connect #4 00000020:00000080:3.0:1788746756.245183:0:23360:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xfac36e891541467a 00010000:00080000:3.0:1788746756.245222:0:23360:0:(ldlm_lib.c:103:import_set_conn()) imp ffff8a45bfe8f000@lustre-OST0000-osc-MDT0001: add connection 192.168.204.139@tcp at head 00010000:00010000:3.0:1788746756.245468:0:23360:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-6 is initialized 00000100:00080000:0.0:1788746756.245657:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788746756.245663:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1788746756.245667:0:36:0:(import.c:65:import_set_state_nolock()) ffff8a4583263800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788746756.245673:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 682 00000100:00080000:0.0:1788746756.245678:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1788746756.245685:0:36:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8a4583263800 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:0.0:1788746756.245715:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a4483cbf100 x1875636324114304/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788746756.245734:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788746756.245737:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788746756.245740:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788746756.245742:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788746756.245790:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a4483cbf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1875636324114304:0@lo:38:kworker.0 00000100:00100000:0.0:1788746756.245840:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746756.245882:0:22629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324114176 00000100:00100000:0.0:1788746756.245889:0:22629:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324114176 00000100:00100000:0.0:1788746756.245928:0:22629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324114304 00000100:00100000:0.0:1788746756.245931:0:22629:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324114304 00000100:00100000:0.0:1788746756.245965:0:22629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788746756.245973:0:22629:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4483cbfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3642:x1875636324114176:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1788746756.245999:0:22629:0:(ldlm_lib.c:1456:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 685 last 0 00000020:00000080:0.0:1788746756.246027:0:22629:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xfac36e8915414681 00000004:00100000:0.0:1788746756.246040:0:22629:0:(mdt_handler.c:7495:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:0.0:1788746756.246046:0:22629:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884901888 00000100:00100000:1.0:1788746756.246310:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a4483cbc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875636324114432:0@lo:400:kworker.0 00000100:00100000:1.0:1788746756.246345:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746756.246452:0:22625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324114432 00000100:00100000:0.0:1788746756.246457:0:22625:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324114432 00000100:00100000:0.0:1788746756.246496:0:22625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788746756.246504:0:22625:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4483591180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875636324114432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788746756.248104:0:22625:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4483591180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875636324114432:12345-0@lo:400:kworker.0 Request processed in 1593us (1750us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746756.248115:0:22625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788746756.248878:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8a4483cbc380 x1875636324114432/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788746772 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788746756.248895:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a4483cbc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875636324114432:0@lo:400:kworker.0 00000040:01000000:3.0:1788746756.249097:0:23360:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00080000:0.0:1788746756.251359:0:22629:0:(import.c:65:import_set_state_nolock()) ffff8a45a8fdf800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788746756.251471:0:22629:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4483cbfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3642:x1875636324114176:12345-0@lo:38:llog_process_th.0 Request processed in 5495us (6698us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746756.251482:0:22629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788746756.251514:0:22629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788746756.251687:0:3642:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788746756.251698:0:3642:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 3 00000100:00080000:1.0:1788746756.251707:0:3642:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:1.0:1788746756.251713:0:3642:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788746756.251716:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8a45a0cf5800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788746756.251731:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a45bca92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1875636324114176:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788746756.251789:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788746756.251802:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a4483593800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875636324114560:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788746756.251839:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746756.251874:0:22628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324114560 00000100:00100000:1.0:1788746756.251881:0:22628:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324114560 00000100:00100000:0.0:1788746756.252097:0:22629:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4483cbce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3642:x1875636324114304:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1788746756.252154:0:22629:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4483cbce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3642:x1875636324114304:12345-0@lo:38:kworker.0 Request processed in 58us (6313us total) trans 0 rc -11/-11 00000100:00100000:1.0:1788746756.252215:0:3642:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788746756.252220:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8a4583263800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788746756.252224:0:3642:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1788746756.252227:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a4483cbf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1875636324114304:0@lo:38:kworker.0 00000040:01000000:3.0:1788746756.252242:0:23360:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000100:00100000:0.0:1788746756.252888:0:22629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788746756.252918:0:22629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788746756.252927:0:22629:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4483590700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3645:x1875636324114560:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788746756.252955:0:22629:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1788746756.253065:0:22629:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4483590700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3645:x1875636324114560:12345-0@lo:41:osp-pre-0-1.0 Request processed in 139us (1225us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746756.253079:0:22629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788746756.253165:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a4483593800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875636324114560:0@lo:41:osp-pre-0-1.0 00000040:00080000:3.0:1788746756.254067:0:23360:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788746756.254212:0:23360:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].3, 64 off8384 00000040:00080000:3.0:1788746756.254398:0:23360:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:3.0:1788746756.255237:0:23365:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:3.0:1788746756.255241:0:23365:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 3 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1788746756.256066:0:23360:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788746756.256078:0:23360:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788746756.256116:0:23360:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1788746756.256143:0:23360:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xfac36e8915414688 00000100:00080000:3.0:1788746756.256154:0:23360:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788746756.256165:0:23360:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8a45bfe8f000 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:3.0:1788746756.256201:0:23360:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a45bca91f80 x1875636324114688/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788746756.256230:0:23360:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1788746756.256326:0:23360:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788746756.256331:0:23360:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788746756.256332:0:23360:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1788746756.256336:0:23360:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788746756.256338:0:23360:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #26 00000020:01000000:3.0:1788746756.256340:0:23360:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788746756.256342:0:23360:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788746756.256344:0:23360:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788746756.256346:0:23360:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788746756.256353:0:23360:0:(obd_config.c:1563:class_process_config()) marker 26 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788746756.256356:0:23360:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788746756.256360:0:23360:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:3.0:1788746756.256363:0:23360:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788746756.256365:0:23360:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1788746756.256368:0:23360:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788746756.256372:0:23360:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.139@tcp to nid 0x20000c0a8cc8b (192.168.204.139@tcp) 00000020:01000000:3.0:1788746756.256394:0:23360:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:3.0:1788746756.256397:0:23360:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788746756.256410:0:23360:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff8a45c0d9b380) 00000020:00000080:3.0:1788746756.256422:0:23360:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type osp with refcount 2 00000020:00000080:3.0:1788746756.256427:0:23360:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788746756.256492:0:23360:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:3.0:1788746756.256499:0:23360:0:(osd_handler.c:8924:osd_obd_connect()) connect #5 00000020:00000080:3.0:1788746756.256505:0:23360:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xfac36e8915414696 00000100:00100000:1.0:1788746756.256523:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a45bca91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1875636324114688:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1788746756.256584:0:3642:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875636324114688 offset 0 length 520: 4 00000100:00080000:0.0:1788746756.256795:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788746756.256800:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788746756.256803:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788746756.256805:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00080000:3.0:1788746756.256978:0:23360:0:(ldlm_lib.c:103:import_set_conn()) imp ffff8a45b7f9f000@lustre-OST0001-osc-MDT0001: add connection 192.168.204.139@tcp at head 00010000:00010000:3.0:1788746756.257204:0:23360:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-7 is initialized 00000040:01000000:3.0:1788746756.257276:0:23360:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1788746756.257403:0:23360:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:3.0:1788746756.259818:0:23360:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788746756.260023:0:23360:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].3, 64 off8384 00000040:00080000:3.0:1788746756.260150:0:23360:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 64 off8256 00000040:00080000:1.0:1788746756.260576:0:23367:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:1.0:1788746756.260581:0:23367:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 3 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1788746756.261240:0:23360:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788746756.261250:0:23360:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788746756.261283:0:23360:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1788746756.261449:0:23360:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xfac36e891541469d 00000100:00080000:3.0:1788746756.261461:0:23360:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788746756.261473:0:23360:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8a45b7f9f000 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:3.0:1788746756.261592:0:23360:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a45bca90380 x1875636324114816/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788746756.261619:0:23360:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:1.0:1788746756.261708:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a45bca90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1875636324114816:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1788746756.261772:0:3642:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875636324114816 offset 0 length 520: 4 00000020:01000000:3.0:1788746756.261848:0:23360:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788746756.261853:0:23360:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788746756.261855:0:23360:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1788746756.261858:0:23360:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788746756.261862:0:23360:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788746756.261864:0:23360:0:(obd_config.c:1563:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788746756.261866:0:23360:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788746756.261868:0:23360:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788746756.261870:0:23360:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788746756.261872:0:23360:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788746756.261873:0:23360:0:(obd_config.c:1563:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000020:01000000:3.0:1788746756.261875:0:23360:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788746756.261877:0:23360:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788746756.261878:0:23360:0:(obd_config.c:1563:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788746756.261894:0:23360:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1788746756.261920:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a4483cbdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:41310026-2b0a-472c-80e6-fbabf81d5070:3643:1875636324114944:0@lo:400:kworker.0 00000020:01000000:3.0:1788746756.261930:0:23360:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000100:00100000:2.0:1788746756.261961:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746756.262027:0:22615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324114944 00000100:00100000:1.0:1788746756.262035:0:22615:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324114944 00000100:00100000:1.0:1788746756.262096:0:22615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788746756.262105:0:22615:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a45af2a6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41310026-2b0a-472c-80e6-fbabf81d5070+15:3643:x1875636324114944:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1788746756.262257:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788746756.262261:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1788746756.262264:0:36:0:(import.c:65:import_set_state_nolock()) ffff8a4583263800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788746756.262273:0:36:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8a4583263800 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:0.0:1788746756.262313:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a4483cbed80 x1875636324115072/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788746756.262328:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788746756.262331:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788746756.262334:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788746756.262337:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000020:00000080:3.0:1788746756.262360:0:23360:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788746756.262361:0:23360:0:(obd_config.c:1563:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788746756.262365:0:23360:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 46 count 46 00000100:00100000:1.0:1788746756.262436:0:22615:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a45af2a6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41310026-2b0a-472c-80e6-fbabf81d5070+15:3643:x1875636324114944:12345-0@lo:400:kworker.0 Request processed in 331us (473us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746756.262443:0:22615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788746756.262511:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a4483cbdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:41310026-2b0a-472c-80e6-fbabf81d5070:3643:1875636324114944:0@lo:400:kworker.0 00000100:00100000:2.0:1788746756.262539:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788746756.262554:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a4483cbea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875636324115200:0@lo:400:kworker.0 00000100:00100000:2.0:1788746756.262583:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:2.0:1788746756.262625:0:23356:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-45 (rc=0) 10000000:01000000:2.0:1788746756.262664:0:23356:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.139@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1788746756.262680:0:23356:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff8a45ae45fa00/0xfac36e891541461f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xfac36e8915414626 expref: -99 pid: 23356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746756.262691:0:23356:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.139@tcp lock: ffff8a45ae45fa00/0xfac36e891541461f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xfac36e8915414626 expref: -99 pid: 23356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788746756.262699:0:23356:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8a4582bdb800 from 1 10000000:01000000:2.0:1788746756.262702:0:23356:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788746756.262726:0:23356:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.139@tcp lock: ffff8a4581527800/0xfac36e89154146a4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746756.262734:0:23356:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.139@tcp lock: ffff8a4581527800/0xfac36e89154146a4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746756.262744:0:23356:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.139@tcp lock: ffff8a4581527800/0xfac36e89154146a4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788746756.262760:0:23356:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a4482713480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41310026-2b0a-472c-80e6-fbabf81d5070:23356:1875636324115328:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788746756.262787:0:23356:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788746756.262815:0:23356:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a45873d3cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788746756.262867:0:22624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324115200 00000100:00100000:1.0:1788746756.262872:0:22624:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324115200 00000100:00100000:1.0:1788746756.262915:0:22624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788746756.262916:0:22617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324115328 00000100:00100000:3.0:1788746756.262919:0:22617:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324115328 00000100:00100000:1.0:1788746756.262922:0:22624:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4482710a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875636324115200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788746756.262956:0:22617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788746756.262961:0:22624:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4482710a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875636324115200:12345-0@lo:400:kworker.0 Request processed in 40us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746756.262962:0:22617:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a45af2a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41310026-2b0a-472c-80e6-fbabf81d5070+15:23356:x1875636324115328:12345-0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788746756.262968:0:22624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:3.0:1788746756.262970:0:22617:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788746756.262982:0:22617:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a45c216c200/0xfac36e89154146ab lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xfac36e89154146a4 expref: -99 pid: 22617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00080000:1.0:1788746756.262993:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8a4483cbea00 x1875636324115200/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788746772 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1788746756.263003:0:22617:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a45c216c200/0xfac36e89154146ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfac36e89154146a4 expref: 16 pid: 22617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788746756.263003:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a4483cbea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875636324115200:0@lo:400:kworker.0 00010000:00010000:3.0:1788746756.263014:0:22617:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a45c216c200/0xfac36e89154146ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfac36e89154146a4 expref: 16 pid: 22617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746756.263034:0:22617:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a45c216c200, rc 0) 00000100:00100000:3.0:1788746756.263067:0:22617:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a45af2a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41310026-2b0a-472c-80e6-fbabf81d5070+16:23356:x1875636324115328:12345-0@lo:101:mount.lustre.0 Request processed in 105us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746756.263073:0:22617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788746756.263075:0:23356:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a4482713480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41310026-2b0a-472c-80e6-fbabf81d5070:23356:1875636324115328:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788746756.263087:0:23356:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.139@tcp lock: ffff8a4581527800/0xfac36e89154146a4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfac36e89154146ab expref: -99 pid: 23356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746756.263096:0:23356:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.139@tcp lock: ffff8a4581527800/0xfac36e89154146a4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xfac36e89154146ab expref: -99 pid: 23356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788746756.263422:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a4483cbe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875636324115456:0@lo:400:kworker.0 00000100:00100000:1.0:1788746756.263453:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788746756.263457:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788746756.263460:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788746756.263495:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a4483cbed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1875636324115072:0@lo:38:kworker.0 00000100:00100000:3.0:1788746756.263523:0:22628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324115456 00000100:00100000:0.0:1788746756.263527:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746756.263528:0:22628:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324115456 00000100:00100000:1.0:1788746756.263566:0:22629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324115072 00000100:00100000:1.0:1788746756.263570:0:22629:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324115072 00000100:00100000:1.0:1788746756.263585:0:22629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788746756.263590:0:22629:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4483cbd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3642:x1875636324115072:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1788746756.263648:0:22629:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4483cbd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3642:x1875636324115072:12345-0@lo:38:kworker.0 Request processed in 56us (119us total) trans 0 rc -11/-11 00000100:00100000:1.0:1788746756.263654:0:22629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:0.0:1788746756.263721:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8a4583263800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788746756.263726:0:3642:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1788746756.263736:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a4483cbed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1875636324115072:0@lo:38:kworker.0 00000100:00100000:3.0:1788746756.264104:0:22628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788746756.264113:0:22628:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4483593800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3645:x1875636324115456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788746756.264153:0:22628:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4483593800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3645:x1875636324115456:12345-0@lo:400:kworker.0 Request processed in 43us (700us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746756.264159:0:22628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788746756.264235:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a4483cbe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875636324115456:0@lo:400:kworker.0 00000100:00100000:2.0:1788746756.264436:0:23356:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a4482713480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41310026-2b0a-472c-80e6-fbabf81d5070:23356:1875636324115584:0@lo:256:mount.lustre.0 00000100:00100000:2.0:1788746756.264472:0:23356:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788746756.264498:0:23356:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a45873d3cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788746756.264544:0:22615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324115584 00000100:00100000:0.0:1788746756.264549:0:22615:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324115584 00000100:00100000:0.0:1788746756.264578:0:22615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788746756.264583:0:22615:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a45af2a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41310026-2b0a-472c-80e6-fbabf81d5070+16:23356:x1875636324115584:12345-0@lo:256:mount.lustre.0 20000000:01000000:0.0:1788746756.264595:0:22615:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1788746756.264608:0:22615:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1788746756.264611:0:22615:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 11 00000100:00100000:0.0:1788746756.264673:0:22615:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a45af2a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41310026-2b0a-472c-80e6-fbabf81d5070+16:23356:x1875636324115584:12345-0@lo:256:mount.lustre.0 Request processed in 89us (199us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746756.264679:0:22615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788746756.264743:0:23356:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a4482713480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41310026-2b0a-472c-80e6-fbabf81d5070:23356:1875636324115584:0@lo:256:mount.lustre.0 10000000:01000000:2.0:1788746756.265976:0:23356:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.139@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788746756.266051:0:23356:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff8a4581527800/0xfac36e89154146a4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfac36e89154146ab expref: -99 pid: 23356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746756.266065:0:23356:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.139@tcp lock: ffff8a4581527800/0xfac36e89154146a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfac36e89154146ab expref: -99 pid: 23356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788746756.266073:0:23356:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8a4582bdb800 from 1 10000000:01000000:2.0:1788746756.266076:0:23356:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788746756.266114:0:23356:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.139@tcp lock: ffff8a4581527200/0xfac36e89154146b2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746756.266122:0:23356:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.139@tcp lock: ffff8a4581527200/0xfac36e89154146b2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746756.266131:0:23356:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.139@tcp lock: ffff8a4581527200/0xfac36e89154146b2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788746756.266203:0:23356:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a4482713480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41310026-2b0a-472c-80e6-fbabf81d5070:23356:1875636324115712:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788746756.266259:0:23356:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788746756.266326:0:23356:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a45873d3cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788746756.266414:0:22618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324115712 00000100:00100000:1.0:1788746756.266422:0:22618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324115712 00000100:00100000:1.0:1788746756.266517:0:22618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788746756.266525:0:22618:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a45af2a5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41310026-2b0a-472c-80e6-fbabf81d5070+16:23356:x1875636324115712:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788746756.266539:0:22618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788746756.266550:0:22618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a45ae45ea00/0xfac36e89154146b9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xfac36e89154146b2 expref: -99 pid: 22618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746756.266572:0:22618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a45ae45ea00/0xfac36e89154146b9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfac36e89154146b2 expref: 17 pid: 22618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746756.266582:0:22618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a45ae45ea00/0xfac36e89154146b9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfac36e89154146b2 expref: 17 pid: 22618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746756.266590:0:22618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a45ae45ea00, rc 0) 00000100:00100000:1.0:1788746756.266638:0:22618:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a45af2a5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41310026-2b0a-472c-80e6-fbabf81d5070+17:23356:x1875636324115712:12345-0@lo:101:mount.lustre.0 Request processed in 113us (378us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746756.266645:0:22618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788746756.266719:0:23356:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a4482713480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41310026-2b0a-472c-80e6-fbabf81d5070:23356:1875636324115712:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788746756.266733:0:23356:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.139@tcp lock: ffff8a4581527200/0xfac36e89154146b2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfac36e89154146b9 expref: -99 pid: 23356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746756.266742:0:23356:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.139@tcp lock: ffff8a4581527200/0xfac36e89154146b2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xfac36e89154146b9 expref: -99 pid: 23356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788746756.268137:0:23356:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 13 count 13 00000040:00080000:3.0:1788746756.269135:0:23356:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788746756.269448:0:23356:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:3.0:1788746756.269477:0:23356:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 112 off8528 00000040:00080000:3.0:1788746756.269491:0:23356:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 224 off8752 00000040:00080000:3.0:1788746756.269521:0:23356:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8976 00000040:00080000:3.0:1788746756.269538:0:23356:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 112 off9088 00000040:00080000:3.0:1788746756.269627:0:23356:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 224 off9312 00000040:00080000:3.0:1788746756.269645:0:23356:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 224 off9536 00000040:00080000:3.0:1788746756.269672:0:23356:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 128 off9664 00000040:00080000:3.0:1788746756.269687:0:23356:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:3.0:1788746756.269703:0:23356:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 224 off10112 00000040:00080000:3.0:1788746756.269717:0:23356:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 128 off10240 00000040:00080000:3.0:1788746756.269736:0:23356:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10464 00000040:00080000:3.0:1788746756.269742:0:23356:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 12 count 13 00000100:00100000:3.0:1788746756.269900:0:23356:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a45bca90700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41310026-2b0a-472c-80e6-fbabf81d5070:23356:1875636324115840:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788746756.269987:0:23356:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746756.270110:0:23356:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a45bcbca480 going to sleep for 11 seconds 00000100:00100000:2.0:1788746756.270221:0:22617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324115840 00000100:00100000:2.0:1788746756.270231:0:22617:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324115840 00000100:00100000:2.0:1788746756.270428:0:22617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788746756.270438:0:22617:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a45af2a7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41310026-2b0a-472c-80e6-fbabf81d5070+17:23356:x1875636324115840:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788746756.270610:0:22617:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a45af2a7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41310026-2b0a-472c-80e6-fbabf81d5070+17:23356:x1875636324115840:12345-0@lo:501:mount.lustre.0 Request processed in 173us (622us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746756.270618:0:22617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788746756.270811:0:23356:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a45bca90700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41310026-2b0a-472c-80e6-fbabf81d5070:23356:1875636324115840:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788746756.270847:0:23356:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a45bca90700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41310026-2b0a-472c-80e6-fbabf81d5070:23356:1875636324115968:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788746756.270892:0:23356:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746756.270965:0:23356:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a45bcbca480 going to sleep for 11 seconds 00000100:00100000:1.0:1788746756.271135:0:22618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324115968 00000100:00100000:1.0:1788746756.271141:0:22618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324115968 00000100:00100000:1.0:1788746756.271218:0:22618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788746756.271227:0:22618:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a45af2a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41310026-2b0a-472c-80e6-fbabf81d5070+17:23356:x1875636324115968:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788746756.271350:0:22618:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a45af2a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41310026-2b0a-472c-80e6-fbabf81d5070+17:23356:x1875636324115968:12345-0@lo:503:mount.lustre.0 Request processed in 124us (457us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746756.271358:0:22618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788746756.271490:0:23356:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a45bca90700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41310026-2b0a-472c-80e6-fbabf81d5070:23356:1875636324115968:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788746756.272032:0:23356:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788746756.272100:0:23356:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a45bca90700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41310026-2b0a-472c-80e6-fbabf81d5070:23356:1875636324116096:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788746756.272150:0:23356:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746756.272184:0:23356:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a45bcbca240 going to sleep for 11 seconds 00000100:00100000:1.0:1788746756.272239:0:22618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324116096 00000100:00100000:1.0:1788746756.272245:0:22618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324116096 00000100:00100000:1.0:1788746756.272282:0:22618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788746756.272323:0:22618:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a45af2a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41310026-2b0a-472c-80e6-fbabf81d5070+17:23356:x1875636324116096:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788746756.272406:0:22618:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a45af2a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41310026-2b0a-472c-80e6-fbabf81d5070+17:23356:x1875636324116096:12345-0@lo:502:mount.lustre.0 Request processed in 84us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746756.272419:0:22618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788746756.272612:0:23356:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a45bca90700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41310026-2b0a-472c-80e6-fbabf81d5070:23356:1875636324116096:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788746756.272778:0:23356:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:3.0:1788746756.272803:0:23356:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 112 off8528 00000040:00080000:3.0:1788746756.272820:0:23356:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 224 off8752 00000040:00080000:3.0:1788746756.272834:0:23356:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8976 00000040:00080000:3.0:1788746756.272849:0:23356:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 112 off9088 00000040:00080000:3.0:1788746756.272880:0:23356:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 224 off9312 00000040:00080000:3.0:1788746756.272896:0:23356:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 224 off9536 00000040:00080000:3.0:1788746756.272920:0:23356:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 128 off9664 00000040:00080000:3.0:1788746756.273022:0:23356:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:3.0:1788746756.273038:0:23356:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 224 off10112 00000040:00080000:3.0:1788746756.273049:0:23356:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 128 off10240 00000100:00100000:3.0:1788746756.273070:0:23356:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a45bca90700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41310026-2b0a-472c-80e6-fbabf81d5070:23356:1875636324116224:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788746756.273107:0:23356:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746756.273141:0:23356:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a45bcbca240 going to sleep for 11 seconds 00000100:00100000:1.0:1788746756.273188:0:22618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324116224 00000100:00100000:1.0:1788746756.273192:0:22618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324116224 00000100:00100000:1.0:1788746756.273262:0:22618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788746756.273269:0:22618:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4585855c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41310026-2b0a-472c-80e6-fbabf81d5070+17:23356:x1875636324116224:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788746756.273376:0:22618:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4585855c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41310026-2b0a-472c-80e6-fbabf81d5070+17:23356:x1875636324116224:12345-0@lo:502:mount.lustre.0 Request processed in 107us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746756.273383:0:22618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788746756.273455:0:23356:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a45bca90700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41310026-2b0a-472c-80e6-fbabf81d5070:23356:1875636324116224:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788746756.273490:0:23356:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10464 00000040:00080000:3.0:1788746756.273499:0:23356:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:3.0:1788746756.274255:0:23369:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788746756.274264:0:23369:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788746756.274266:0:23369:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788746756.274273:0:23369:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8a4582bdb800 00000020:00000080:3.0:1788746756.274276:0:23369:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788746756.274284:0:23369:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788746756.274303:0:23369:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788746756.274305:0:23369:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1788746756.274308:0:23369:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788746756.274311:0:23369:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788746756.274312:0:23369:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788746756.274315:0:23369:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8a4582bdb800 00000020:00000080:3.0:1788746756.274317:0:23369:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788746756.274381:0:23369:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788746756.274384:0:23369:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788746756.274386:0:23369:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1788746756.274388:0:23369:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788746756.274390:0:23369:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788746756.274392:0:23369:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788746756.274395:0:23369:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8a4582bdb800 00000020:00000080:3.0:1788746756.274397:0:23369:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788746756.274414:0:23369:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788746756.274422:0:23369:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788746756.274424:0:23369:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788746756.274426:0:23369:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788746756.274429:0:23369:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788746756.274430:0:23369:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1788746756.274434:0:23369:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8a4582bdb800 00000020:00000080:3.0:1788746756.274436:0:23369:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788746756.274461:0:23369:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788746756.274464:0:23369:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788746756.274466:0:23369:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1788746756.274468:0:23369:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 13 count 13 00000020:01000000:2.0:1788746756.283889:0:23356:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:2.0:1788746756.283960:0:23356:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.139@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788746756.283986:0:23356:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff8a4581527200/0xfac36e89154146b2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfac36e89154146b9 expref: -99 pid: 23356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746756.284000:0:23356:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.139@tcp lock: ffff8a4581527200/0xfac36e89154146b2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfac36e89154146b9 expref: -99 pid: 23356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788746756.284068:0:23356:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788746756.284071:0:23356:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8a4582bdb800 10000000:01000000:2.0:1788746756.284075:0:23356:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8a4582bdb800 10000000:01000000:2.0:1788746756.284078:0:23356:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788746756.284085:0:23356:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8a4582bdb800 from 1 10000000:01000000:2.0:1788746756.284088:0:23356:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788746756.284127:0:23356:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.139@tcp lock: ffff8a4581527e00/0xfac36e89154146c0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746756.284136:0:23356:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.139@tcp lock: ffff8a4581527e00/0xfac36e89154146c0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746756.284155:0:23356:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.139@tcp lock: ffff8a4581527e00/0xfac36e89154146c0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788746756.284181:0:23356:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a4482713800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41310026-2b0a-472c-80e6-fbabf81d5070:23356:1875636324116352:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788746756.284250:0:23356:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788746756.284321:0:22617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324116352 00000100:00100000:2.0:1788746756.284329:0:22617:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324116352 00000100:00100000:2.0:1788746756.284372:0:22617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788746756.284380:0:22617:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4585856850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41310026-2b0a-472c-80e6-fbabf81d5070+17:23356:x1875636324116352:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788746756.284397:0:22617:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788746756.284409:0:22617:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a4581526e00/0xfac36e89154146c7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xfac36e89154146c0 expref: -99 pid: 22617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746756.284434:0:22617:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a4581526e00/0xfac36e89154146c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfac36e89154146c0 expref: 18 pid: 22617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746756.284445:0:22617:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a4581526e00/0xfac36e89154146c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfac36e89154146c0 expref: 18 pid: 22617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746756.284453:0:22617:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a4581526e00, rc 0) 00000100:00100000:2.0:1788746756.284488:0:22617:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4585856850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41310026-2b0a-472c-80e6-fbabf81d5070+18:23356:x1875636324116352:12345-0@lo:101:mount.lustre.0 Request processed in 108us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746756.284495:0:22617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788746756.284542:0:23356:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a45bc98e780 going to sleep for 11 seconds 00000100:00100000:2.0:1788746756.284565:0:23356:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a4482713800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41310026-2b0a-472c-80e6-fbabf81d5070:23356:1875636324116352:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788746756.284578:0:23356:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.139@tcp lock: ffff8a4581527e00/0xfac36e89154146c0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xfac36e89154146c7 expref: -99 pid: 23356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746756.284594:0:23356:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.139@tcp lock: ffff8a4581527e00/0xfac36e89154146c0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xfac36e89154146c7 expref: -99 pid: 23356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788746756.291184:0:23356:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 52 count 51 00000040:00080000:2.0:1788746756.292471:0:23356:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788746756.295966:0:23356:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].1, 224 off8416 00000040:00080000:2.0:1788746756.296014:0:23356:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].2, 120 off8536 00000040:00080000:2.0:1788746756.296028:0:23356:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].3, 168 off8704 00000040:00080000:2.0:1788746756.296039:0:23356:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].4, 224 off8928 00000040:00080000:2.0:1788746756.296051:0:23356:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].5, 224 off9152 00000040:00080000:2.0:1788746756.296064:0:23356:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].6, 120 off9272 00000040:00080000:2.0:1788746756.296076:0:23356:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].7, 168 off9440 00000040:00080000:2.0:1788746756.296088:0:23356:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].8, 224 off9664 00000040:00080000:2.0:1788746756.296100:0:23356:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].9, 224 off9888 00000040:00080000:2.0:1788746756.296111:0:23356:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].10, 120 off10008 00000040:00080000:2.0:1788746756.296122:0:23356:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].11, 224 off10232 00000040:00080000:2.0:1788746756.296151:0:23356:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].12, 224 off10456 00000040:00080000:2.0:1788746756.296166:0:23356:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].13, 88 off10544 00000040:00080000:2.0:1788746756.296180:0:23356:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].14, 128 off10672 00000040:00080000:2.0:1788746756.296193:0:23356:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].15, 144 off10816 00000040:00080000:2.0:1788746756.296207:0:23356:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].16, 160 off10976 00000040:00080000:2.0:1788746756.296228:0:23356:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].17, 224 off11200 00000040:00080000:2.0:1788746756.296243:0:23356:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].18, 224 off11424 00000040:00080000:2.0:1788746756.296257:0:23356:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].19, 80 off11504 00000040:00080000:2.0:1788746756.296272:0:23356:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].20, 224 off11728 00000040:00080000:2.0:1788746756.296308:0:23356:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].21, 224 off11952 00000040:00080000:2.0:1788746756.296325:0:23356:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].22, 88 off12040 00000040:00080000:2.0:1788746756.296339:0:23356:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].23, 128 off12168 00000040:00080000:2.0:1788746756.296352:0:23356:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].24, 144 off12312 00000040:00080000:2.0:1788746756.296364:0:23356:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].25, 160 off12472 00000040:00080000:2.0:1788746756.296389:0:23356:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].26, 224 off12696 00000040:00080000:2.0:1788746756.296405:0:23356:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].27, 224 off12920 00000040:00080000:2.0:1788746756.296435:0:23356:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].28, 80 off13000 00000040:00080000:2.0:1788746756.296452:0:23356:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].29, 224 off13224 00000040:00080000:2.0:1788746756.296467:0:23356:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].30, 224 off13448 00000040:00080000:2.0:1788746756.296481:0:23356:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].31, 88 off13536 00000040:00080000:2.0:1788746756.296495:0:23356:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].32, 128 off13664 00000040:00080000:2.0:1788746756.296508:0:23356:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].33, 144 off13808 00000040:00080000:2.0:1788746756.296520:0:23356:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].34, 128 off13936 00000040:00080000:2.0:1788746756.296531:0:23356:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].35, 224 off14160 00000040:00080000:2.0:1788746756.296727:0:23356:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].36, 224 off14384 00000040:00080000:2.0:1788746756.296750:0:23356:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].37, 80 off14464 00000040:00080000:2.0:1788746756.296765:0:23356:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].38, 224 off14688 00000040:00080000:2.0:1788746756.296779:0:23356:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].39, 224 off14912 00000040:00080000:2.0:1788746756.296792:0:23356:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].40, 88 off15000 00000040:00080000:2.0:1788746756.296806:0:23356:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].41, 128 off15128 00000040:00080000:2.0:1788746756.296819:0:23356:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].42, 144 off15272 00000040:00080000:2.0:1788746756.296832:0:23356:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].43, 128 off15400 00000040:00080000:2.0:1788746756.296859:0:23356:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].44, 224 off15624 00000040:00080000:2.0:1788746756.296875:0:23356:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].45, 224 off15848 00000040:00080000:2.0:1788746756.297002:0:23356:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].46, 80 off15928 00000040:00080000:2.0:1788746756.297018:0:23356:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].47, 224 off16152 00000040:00080000:2.0:1788746756.297031:0:23356:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].48, 232 off16384 00000040:00080000:2.0:1788746756.297159:0:23356:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].49, 224 off16608 00000040:00080000:2.0:1788746756.297178:0:23356:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].50, 120 off16728 00000040:00080000:2.0:1788746756.297196:0:23356:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].51, 224 off16952 00000040:00080000:2.0:1788746756.297201:0:23356:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 51 count 51 00000100:00100000:2.0:1788746756.297337:0:23356:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a4482713800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41310026-2b0a-472c-80e6-fbabf81d5070:23356:1875636324116480:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788746756.297415:0:23356:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788746756.297474:0:23356:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a45bc98e6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788746756.300204:0:22615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324116480 00000100:00100000:1.0:1788746756.300216:0:22615:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324116480 00000100:00100000:1.0:1788746756.300273:0:22615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788746756.300320:0:22615:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4585855450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41310026-2b0a-472c-80e6-fbabf81d5070+18:23356:x1875636324116480:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788746756.300480:0:22615:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4585855450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41310026-2b0a-472c-80e6-fbabf81d5070+18:23356:x1875636324116480:12345-0@lo:501:mount.lustre.0 Request processed in 198us (3065us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746756.300488:0:22615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788746756.300681:0:23356:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a4482713800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41310026-2b0a-472c-80e6-fbabf81d5070:23356:1875636324116480:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788746756.300746:0:23356:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a4482713800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41310026-2b0a-472c-80e6-fbabf81d5070:23356:1875636324116608:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788746756.300791:0:23356:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788746756.300819:0:23356:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a45bc98e6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788746756.300871:0:22618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324116608 00000100:00100000:1.0:1788746756.300876:0:22618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324116608 00000100:00100000:1.0:1788746756.302704:0:22618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788746756.302719:0:22618:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4585854c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41310026-2b0a-472c-80e6-fbabf81d5070+18:23356:x1875636324116608:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788746756.302876:0:22618:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4585854c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41310026-2b0a-472c-80e6-fbabf81d5070+18:23356:x1875636324116608:12345-0@lo:503:mount.lustre.0 Request processed in 160us (2082us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746756.302896:0:22618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788746756.303189:0:23356:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a4482713800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41310026-2b0a-472c-80e6-fbabf81d5070:23356:1875636324116608:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788746756.303750:0:23356:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788746756.303838:0:23356:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a4482713800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41310026-2b0a-472c-80e6-fbabf81d5070:23356:1875636324116736:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788746756.304254:0:23356:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788746756.304327:0:23356:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a45bc98e780 going to sleep for 11 seconds 00000100:00100000:0.0:1788746756.304386:0:22617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324116736 00000100:00100000:0.0:1788746756.304395:0:22617:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324116736 00000100:00100000:0.0:1788746756.304435:0:22617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788746756.304444:0:22617:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4585856c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41310026-2b0a-472c-80e6-fbabf81d5070+18:23356:x1875636324116736:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788746756.304651:0:22617:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4585856c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41310026-2b0a-472c-80e6-fbabf81d5070+18:23356:x1875636324116736:12345-0@lo:502:mount.lustre.0 Request processed in 208us (398us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746756.304659:0:22617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788746756.304774:0:23356:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a4482713800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41310026-2b0a-472c-80e6-fbabf81d5070:23356:1875636324116736:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788746756.305124:0:23356:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].1, 224 off8416 00000040:00080000:2.0:1788746756.305163:0:23356:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].2, 120 off8536 00000040:00080000:2.0:1788746756.305180:0:23356:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].3, 168 off8704 00000040:00080000:2.0:1788746756.305195:0:23356:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].4, 224 off8928 00000040:00080000:2.0:1788746756.305224:0:23356:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].5, 224 off9152 00000040:00080000:2.0:1788746756.305241:0:23356:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].6, 120 off9272 00000040:00080000:2.0:1788746756.305255:0:23356:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].7, 168 off9440 00000040:00080000:2.0:1788746756.305270:0:23356:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].8, 224 off9664 00000040:00080000:2.0:1788746756.305282:0:23356:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].9, 224 off9888 00000040:00080000:2.0:1788746756.305326:0:23356:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].10, 120 off10008 00000040:00080000:2.0:1788746756.305343:0:23356:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].11, 224 off10232 00000040:00080000:2.0:1788746756.305357:0:23356:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].12, 224 off10456 00000040:00080000:2.0:1788746756.305372:0:23356:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].13, 88 off10544 00000040:00080000:2.0:1788746756.305387:0:23356:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].14, 128 off10672 00000040:00080000:2.0:1788746756.305401:0:23356:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].15, 144 off10816 00000040:00080000:2.0:1788746756.305415:0:23356:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].16, 160 off10976 00000040:00080000:2.0:1788746756.305428:0:23356:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].17, 224 off11200 00000040:00080000:2.0:1788746756.305442:0:23356:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].18, 224 off11424 00000040:00080000:2.0:1788746756.305456:0:23356:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].19, 80 off11504 00000040:00080000:2.0:1788746756.305479:0:23356:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].20, 224 off11728 00000040:00080000:2.0:1788746756.305507:0:23356:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].21, 224 off11952 00000040:00080000:2.0:1788746756.305524:0:23356:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].22, 88 off12040 00000040:00080000:2.0:1788746756.305538:0:23356:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].23, 128 off12168 00000040:00080000:2.0:1788746756.305687:0:23356:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].24, 144 off12312 00000040:00080000:2.0:1788746756.305705:0:23356:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].25, 160 off12472 00000040:00080000:2.0:1788746756.305720:0:23356:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].26, 224 off12696 00000040:00080000:2.0:1788746756.305736:0:23356:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].27, 224 off12920 00000040:00080000:2.0:1788746756.305751:0:23356:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].28, 80 off13000 00000040:00080000:2.0:1788746756.305766:0:23356:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].29, 224 off13224 00000040:00080000:2.0:1788746756.305781:0:23356:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].30, 224 off13448 00000040:00080000:2.0:1788746756.305796:0:23356:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].31, 88 off13536 00000040:00080000:2.0:1788746756.305812:0:23356:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].32, 128 off13664 00000040:00080000:2.0:1788746756.305827:0:23356:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].33, 144 off13808 00000040:00080000:2.0:1788746756.305843:0:23356:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].34, 128 off13936 00000040:00080000:2.0:1788746756.305858:0:23356:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].35, 224 off14160 00000040:00080000:2.0:1788746756.305874:0:23356:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].36, 224 off14384 00000040:00080000:2.0:1788746756.306068:0:23356:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].37, 80 off14464 00000040:00080000:2.0:1788746756.306088:0:23356:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].38, 224 off14688 00000040:00080000:2.0:1788746756.306103:0:23356:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].39, 224 off14912 00000040:00080000:2.0:1788746756.306118:0:23356:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].40, 88 off15000 00000040:00080000:2.0:1788746756.306134:0:23356:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].41, 128 off15128 00000040:00080000:2.0:1788746756.306148:0:23356:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].42, 144 off15272 00000040:00080000:2.0:1788746756.306163:0:23356:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].43, 128 off15400 00000040:00080000:2.0:1788746756.306177:0:23356:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].44, 224 off15624 00000040:00080000:2.0:1788746756.306189:0:23356:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].45, 224 off15848 00000040:00080000:2.0:1788746756.306202:0:23356:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].46, 80 off15928 00000040:00080000:2.0:1788746756.306217:0:23356:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].47, 224 off16152 00000040:00080000:2.0:1788746756.306231:0:23356:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].48, 232 off16384 00000100:00100000:2.0:1788746756.306450:0:23356:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a4482713800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41310026-2b0a-472c-80e6-fbabf81d5070:23356:1875636324116864:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788746756.306531:0:23356:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788746756.306690:0:23356:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a45bc98e780 going to sleep for 11 seconds 00000100:00100000:1.0:1788746756.306741:0:22615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324116864 00000100:00100000:1.0:1788746756.306750:0:22615:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324116864 00000100:00100000:1.0:1788746756.306857:0:22615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788746756.306868:0:22615:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4585855850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41310026-2b0a-472c-80e6-fbabf81d5070+18:23356:x1875636324116864:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788746756.307046:0:22615:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4585855850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41310026-2b0a-472c-80e6-fbabf81d5070+18:23356:x1875636324116864:12345-0@lo:502:mount.lustre.0 Request processed in 179us (515us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746756.307054:0:22615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788746756.307211:0:23356:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a4482713800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41310026-2b0a-472c-80e6-fbabf81d5070:23356:1875636324116864:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788746756.307455:0:23356:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].49, 224 off16608 00000040:00080000:2.0:1788746756.307483:0:23356:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].50, 120 off16728 00000100:00100000:2.0:1788746756.307509:0:23356:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a4482713800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41310026-2b0a-472c-80e6-fbabf81d5070:23356:1875636324116992:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788746756.307557:0:23356:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788746756.307835:0:23356:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a45bc98e780 going to sleep for 11 seconds 00000100:00100000:0.0:1788746756.307993:0:22617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324116992 00000100:00100000:0.0:1788746756.308000:0:22617:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324116992 00000100:00100000:0.0:1788746756.308032:0:22617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788746756.308040:0:22617:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4585857850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41310026-2b0a-472c-80e6-fbabf81d5070+18:23356:x1875636324116992:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788746756.308149:0:22617:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4585857850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41310026-2b0a-472c-80e6-fbabf81d5070+18:23356:x1875636324116992:12345-0@lo:502:mount.lustre.0 Request processed in 108us (589us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746756.308155:0:22617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788746756.308253:0:23356:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a4482713800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41310026-2b0a-472c-80e6-fbabf81d5070:23356:1875636324116992:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788746756.308328:0:23356:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].51, 224 off16952 00000040:00080000:2.0:1788746756.308337:0:23356:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:2.0:1788746756.309426:0:23374:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:2.0:1788746756.309442:0:23374:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (ffff8a458729cd40) 00000020:00000080:2.0:1788746756.309468:0:23374:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:2.0:1788746756.309625:0:23374:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8a4582bdb800 from lustre-MDT0001, refs=3 00000020:01000004:2.0:1788746756.309629:0:23374:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8a4582bdb800 from lustre-MDT0001, refs=3 00000020:01000004:2.0:1788746756.309632:0:23374:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8a4582bdb800 3 00010000:00080000:2.0:1788746756.309660:0:23374:0:(ldlm_lib.c:103:import_set_conn()) imp ffff8a45b0c1e800@lustre-MDT0000-lwp-MDT0001: add connection 192.168.204.139@tcp at head 00010000:00010000:2.0:1788746756.311829:0:23374:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-8 is initialized 00000020:00000080:2.0:1788746756.312236:0:23374:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:2.0:1788746756.312279:0:23374:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788746756.312309:0:23374:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0xfac36e89154146d5 00000100:00080000:2.0:1788746756.312321:0:23374:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788746756.312333:0:23374:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8a45b0c1e800 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:2.0:1788746756.312367:0:23374:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a4482713800 x1875636324117120/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788746756.312405:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a4482713800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875636324117120:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788746756.312472:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788746756.312539:0:22625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324117120 00000100:00100000:2.0:1788746756.312628:0:22625:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324117120 00000100:00100000:2.0:1788746756.312660:0:22625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788746756.312667:0:22625:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4482710e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3642:x1875636324117120:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1788746756.312689:0:22625:0:(ldlm_lib.c:1456:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 686 last 0 00000020:00000080:2.0:1788746756.312731:0:22625:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0xfac36e89154146dc 00000004:00100000:2.0:1788746756.312746:0:22625:0:(mdt_handler.c:7495:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788746756.312775:0:22625:0:(import.c:65:import_set_state_nolock()) ffff8a45b0c19000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788746756.313075:0:22625:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4482710e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875636324117120:12345-0@lo:38:llog_process_th.0 Request processed in 406us (601us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746756.313083:0:22625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1788746756.313126:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8a4482713800 x1875636324117120/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788746766 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788746756.313137:0:3642:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788746756.313145:0:3642:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 3 00000100:00080000:2.0:1788746756.313152:0:3642:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1788746756.313158:0:3642:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788746756.313160:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8a45b0c1e800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788746756.313166:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a4482713800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875636324117120:0@lo:38:llog_process_th.0 00000100:00080000:2.0:1788746756.313185:0:23374:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788746756.313481:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788746756.313486:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788746756.313489:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788746756.313493:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788746756.313496:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788746756.313499:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:1.0:1788746756.314528:0:23374:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x12:0x0] index 52 count 51 00000020:01000000:0.0:1788746756.314746:0:23356:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1788746756.314778:0:23356:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.139@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788746756.314797:0:23356:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff8a4581527e00/0xfac36e89154146c0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xfac36e89154146c7 expref: -99 pid: 23356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746756.314808:0:23356:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.139@tcp lock: ffff8a4581527e00/0xfac36e89154146c0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xfac36e89154146c7 expref: -99 pid: 23356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788746756.314863:0:23356:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788746756.314865:0:23356:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1788746756.314867:0:23356:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788746756.314868:0:23356:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788746756.314869:0:23356:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788746756.314871:0:23356:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788746756.314872:0:23356:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788746756.314874:0:23356:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788746756.314875:0:23356:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788746756.314878:0:23356:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020001 00000020:01000004:0.0:1788746756.314881:0:23356:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788746756.314894:0:23356:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1788746756.314895:0:23356:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788746756.314896:0:23356:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788746756.314897:0:23356:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788746756.314898:0:23356:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788746756.314899:0:23356:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788746756.314900:0:23356:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788746756.314901:0:23356:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788746756.314947:0:23356:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:0.0:1788746756.314972:0:23356:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a4483cbe680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41310026-2b0a-472c-80e6-fbabf81d5070:23356:1875636324117248:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788746756.315044:0:23356:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746756.315089:0:23356:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a45bd667f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788746756.315401:0:22617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324117248 00000100:00100000:1.0:1788746756.315409:0:22617:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324117248 00000100:00100000:1.0:1788746756.315459:0:22617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788746756.315468:0:22617:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4585856050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41310026-2b0a-472c-80e6-fbabf81d5070+18:23356:x1875636324117248:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788746756.315499:0:22617:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1788746756.315514:0:22617:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000001:00100000:1.0:1788746756.318308:0:22603:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:0.0:1788746756.318412:0:22617:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788746756.318433:0:22617:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:0.0:1788746756.318690:0:22617:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4585856050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41310026-2b0a-472c-80e6-fbabf81d5070+18:23356:x1875636324117248:12345-0@lo:253:mount.lustre.0 Request processed in 3219us (3641us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746756.318721:0:22617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788746756.318797:0:23356:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a4483cbe680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41310026-2b0a-472c-80e6-fbabf81d5070:23356:1875636324117248:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788746756.318811:0:23356:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:0.0:1788746756.318814:0:23356:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788746756.318817:0:23356:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1788746756.318818:0:23356:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788746756.318819:0:23356:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788746756.318821:0:23356:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788746756.318823:0:23356:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788746756.318824:0:23356:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788746756.318825:0:23356:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788746756.318827:0:23356:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788746756.318845:0:23356:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:1.0:1788746756.319033:0:22639:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788746756.319038:0:22639:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788746756.319058:0:22639:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a45ae45fe00/0xfac36e89154146e3 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746756.319075:0:22639:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a44825c3c00/0xfac36e89154145e7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfac36e89154145e0 expref: 17 pid: 22617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746756.319083:0:22639:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a45c216c200/0xfac36e89154146ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfac36e89154146a4 expref: 17 pid: 22617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746756.319097:0:22639:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a45ae45fe00/0xfac36e89154146e3 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746756.319130:0:22639:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a45c216c200/0xfac36e89154146ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xfac36e89154146a4 expref: 17 pid: 22617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746756.319146:0:22639:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a45c216c200/0xfac36e89154146ab lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xfac36e89154146a4 expref: 17 pid: 22617 timeout: 786 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788746756.319159:0:22639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a4483590e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22639:1875636324117376:0@lo:104: 00000100:00100000:1.0:1788746756.319195:0:22639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788746756.319238:0:22639:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a44825c3c00/0xfac36e89154145e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xfac36e89154145e0 expref: 17 pid: 22617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746756.319246:0:22639:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a44825c3c00/0xfac36e89154145e7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xfac36e89154145e0 expref: 17 pid: 22617 timeout: 786 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788746756.319254:0:22639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a4483591880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22639:1875636324117504:0@lo:104: 00000100:00100000:1.0:1788746756.319276:0:22639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746756.319325:0:22639:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a45839486c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788746756.319358:0:22607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324117376 00000100:00100000:1.0:1788746756.319365:0:22607:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324117376 00000100:00100000:1.0:1788746756.319391:0:22607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324117504 00000100:00100000:1.0:1788746756.319394:0:22607:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324117504 00000100:00100000:1.0:1788746756.319406:0:22607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788746756.319414:0:22607:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4483593b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:41310026-2b0a-472c-80e6-fbabf81d5070+4:22639:x1875636324117376:12345-0@lo:104: 00010000:00010000:1.0:1788746756.319426:0:22607:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.139@tcp lock: ffff8a4581527800/0xfac36e89154146a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xfac36e89154146ab expref: -99 pid: 23356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746756.319486:0:22607:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788746756.319492:0:22607:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4483593b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:41310026-2b0a-472c-80e6-fbabf81d5070+4:22639:x1875636324117376:12345-0@lo:104: Request processed in 79us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746756.319498:0:22607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788746756.319511:0:22607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788746756.319517:0:22607:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4483590a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:41310026-2b0a-472c-80e6-fbabf81d5070+3:22639:x1875636324117504:12345-0@lo:104: 00010000:00010000:1.0:1788746756.319525:0:22607:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.139@tcp lock: ffff8a45ae45ee00/0xfac36e89154145e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xfac36e89154145e7 expref: -99 pid: 22620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746756.320332:0:22607:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788746756.320341:0:22607:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4483590a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:41310026-2b0a-472c-80e6-fbabf81d5070+3:22639:x1875636324117504:12345-0@lo:104: Request processed in 823us (1063us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746756.320348:0:22607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:1.0:1788746756.320389:0:22612:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788746756.320397:0:22612:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.139@tcp lock: ffff8a4581527800/0xfac36e89154146a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xfac36e89154146ab expref: -99 pid: 23356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746756.320406:0:22612:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a4581527800 already unused, calling callback (ffffffffc1180c20) 10000000:00010000:1.0:1788746756.320410:0:22612:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.139@tcp lock: ffff8a4581527800/0xfac36e89154146a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xfac36e89154146ab expref: -99 pid: 23356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746756.320420:0:22612:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.139@tcp lock: ffff8a4581527800/0xfac36e89154146a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xfac36e89154146ab expref: -99 pid: 23356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788746756.320426:0:22612:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.139@tcp lock: ffff8a4581527800/0xfac36e89154146a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xfac36e89154146ab expref: -99 pid: 23356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788746756.320432:0:22612:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788746756.320471:0:22612:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.139@tcp lock: ffff8a4581527800/0xfac36e89154146a4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfac36e89154146ab expref: -99 pid: 23356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746756.320479:0:22612:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788746756.320504:0:22612:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.139@tcp lock: ffff8a4581527800/0xfac36e89154146a4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfac36e89154146ab expref: -99 pid: 23356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746756.320511:0:22612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.139@tcp lock: ffff8a4581527800/0xfac36e89154146a4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfac36e89154146ab expref: -99 pid: 23356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746756.320523:0:22612:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788746756.320526:0:22612:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.139@tcp lock: ffff8a45ae45ee00/0xfac36e89154145e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xfac36e89154145e7 expref: -99 pid: 22620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746756.320532:0:22612:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a45ae45ee00 already unused, calling callback (ffffffffc1180c20) 10000000:00010000:1.0:1788746756.320535:0:22612:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.139@tcp lock: ffff8a45ae45ee00/0xfac36e89154145e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xfac36e89154145e7 expref: -99 pid: 22620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746756.320541:0:22612:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.139@tcp lock: ffff8a45ae45ee00/0xfac36e89154145e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xfac36e89154145e7 expref: -99 pid: 22620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788746756.322128:0:22612:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.139@tcp lock: ffff8a45ae45ee00/0xfac36e89154145e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xfac36e89154145e7 expref: -99 pid: 22620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788746756.322134:0:22612:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788746756.322168:0:22612:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.139@tcp lock: ffff8a45ae45ee00/0xfac36e89154145e0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfac36e89154145e7 expref: -99 pid: 22620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746756.322173:0:22612:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788746756.322202:0:22612:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.139@tcp lock: ffff8a45ae45ee00/0xfac36e89154145e0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfac36e89154145e7 expref: -99 pid: 22620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746756.322223:0:22612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.139@tcp lock: ffff8a45ae45ee00/0xfac36e89154145e0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfac36e89154145e7 expref: -99 pid: 22620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746756.322241:0:22612:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788746756.322242:0:22612:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788746756.322244:0:22612:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788746756.322270:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a4483590380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:41310026-2b0a-472c-80e6-fbabf81d5070:3646:1875636324117632:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788746756.322342:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788746756.322442:0:22611:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788746756.323694:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a4483591c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:41310026-2b0a-472c-80e6-fbabf81d5070:3643:1875636324117760:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788746756.323747:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746756.323797:0:22608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324117632 00000100:00100000:1.0:1788746756.323804:0:22608:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324117632 00010000:00010000:1.0:1788746756.323835:0:22608:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a45c216c200/0xfac36e89154146ab lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfac36e89154146a4 expref: 18 pid: 22617 timeout: 786 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788746756.323864:0:22608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324117760 00000100:00100000:1.0:1788746756.323867:0:22608:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324117760 00010000:00010000:1.0:1788746756.323879:0:22608:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a44825c3c00/0xfac36e89154145e7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfac36e89154145e0 expref: 19 pid: 22617 timeout: 786 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788746756.323918:0:22608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788746756.323927:0:22608:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4483591500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41310026-2b0a-472c-80e6-fbabf81d5070+19:3646:x1875636324117632:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788746756.325332:0:22608:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788746756.325351:0:22608:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a45c216c200/0xfac36e89154146ab lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfac36e89154146a4 expref: 19 pid: 22617 timeout: 786 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746756.325370:0:22608:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a45c216c200/0xfac36e89154146ab lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xfac36e89154146a4 expref: 19 pid: 22617 timeout: 786 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746756.325403:0:22608:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788746756.325487:0:22608:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4483591500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41310026-2b0a-472c-80e6-fbabf81d5070+19:3646:x1875636324117632:12345-0@lo:103:ldlm_bl.0 Request processed in 1560us (3143us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746756.325499:0:22608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788746756.325555:0:22608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788746756.325566:0:22608:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4483593100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41310026-2b0a-472c-80e6-fbabf81d5070+18:3643:x1875636324117760:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788746756.325575:0:22608:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788746756.325579:0:22608:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a44825c3c00/0xfac36e89154145e7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfac36e89154145e0 expref: 18 pid: 22617 timeout: 786 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746756.325588:0:22608:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a44825c3c00/0xfac36e89154145e7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xfac36e89154145e0 expref: 18 pid: 22617 timeout: 786 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746756.325600:0:22608:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a45ae45fe00/0xfac36e89154146e3 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746756.325608:0:22608:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a45ae45fe00/0xfac36e89154146e3 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788746756.325625:0:22608:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.006588047s 00010000:00010000:1.0:1788746756.325630:0:22608:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a45ae45fe00/0xfac36e89154146e3 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746756.325638:0:22608:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a45ae45fe00/0xfac36e89154146e3 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746756.325645:0:22608:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a45ae45fe00/0xfac36e89154146e3 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746756.325662:0:22608:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a45ae45fe00/0xfac36e89154146e3 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746756.325668:0:22608:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a45ae45fe00 already unused, calling callback (ffffffffc0b5a8d0) 00010000:00010000:1.0:1788746756.325672:0:22608:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a45ae45fe00/0xfac36e89154146e3 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746756.325680:0:22608:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a45ae45fe00/0xfac36e89154146e3 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746756.325689:0:22608:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a45ae45fe00/0xfac36e89154146e3 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746756.325700:0:22608:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788746756.325733:0:22608:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4483593100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41310026-2b0a-472c-80e6-fbabf81d5070+18:3643:x1875636324117760:12345-0@lo:103:ldlm_bl.0 Request processed in 170us (1985us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746756.325739:0:22608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788746756.325781:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a4483591c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:41310026-2b0a-472c-80e6-fbabf81d5070:3643:1875636324117760:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788746756.325820:0:22639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a45c216c200/0xfac36e89154146ab lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xfac36e89154146a4 expref: 17 pid: 22617 timeout: 786 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788746756.325837:0:22639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a4483590e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22639:1875636324117376:0@lo:104: 00010000:00010000:1.0:1788746756.325848:0:22639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a44825c3c00/0xfac36e89154145e7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xfac36e89154145e0 expref: 16 pid: 22617 timeout: 786 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788746756.325855:0:22639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a4483591880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22639:1875636324117504:0@lo:104: 00010000:00010000:1.0:1788746756.325869:0:22639:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a45ae45fe00/0xfac36e89154146e3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746756.325897:0:22639:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a45ae45fe00/0xfac36e89154146e3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746756.325914:0:22639:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a45ae45fe00/0xfac36e89154146e3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746756.325920:0:22639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a45ae45fe00/0xfac36e89154146e3 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788746756.327773:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a4483590380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:41310026-2b0a-472c-80e6-fbabf81d5070:3646:1875636324117632:0@lo:103:ldlm_bl.0 00000040:01000000:0.0:1788746756.336025:0:23356:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000040:01000000:1.0:1788746756.336309:0:23380:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:00080000:1.0:1788746756.336725:0:23380:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:0.0:1788746756.337675:0:23356:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000020:00080000:2.0:1788746756.338021:0:23378:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:2.0:1788746756.338026:0:23378:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:00080000:1.0:1788746756.339798:0:23380:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1788746756.339872:0:23380:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000100:00100000:2.0:1788746756.340614:0:23381:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a4482713800 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23381:1875636324117888:0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1788746756.340684:0:23381:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788746756.340720:0:23381:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a45bc98e900 going to sleep for 11 seconds 00000100:00100000:1.0:1788746756.340769:0:22629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324117888 00000100:00100000:1.0:1788746756.340777:0:22629:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324117888 00000100:00100000:1.0:1788746756.340825:0:22629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788746756.340834:0:22629:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4482710000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:23381:x1875636324117888:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1788746756.341057:0:22629:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4482710000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:23381:x1875636324117888:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 223us (372us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746756.341066:0:22629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788746756.341203:0:23381:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a4482713800 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23381:1875636324117888:0@lo:1000:lod0001_rec0000.0 00000040:01000000:2.0:1788746756.341241:0:23381:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:2.0:1788746756.341267:0:23381:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a4482713800 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23381:1875636324118016:0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1788746756.341325:0:23381:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788746756.341340:0:23381:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a45bc98e900 going to sleep for 11 seconds 00000100:00100000:1.0:1788746756.341407:0:22629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324118016 00000100:00100000:1.0:1788746756.341411:0:22629:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324118016 00000100:00100000:1.0:1788746756.341432:0:22629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788746756.341437:0:22629:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4482710380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:23381:x1875636324118016:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1788746756.341558:0:22629:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4482710380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:23381:x1875636324118016:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 119us (230us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746756.341564:0:22629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788746756.341672:0:23381:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a4482713800 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23381:1875636324118016:0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1788746756.341724:0:23381:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a4482713800 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:23381:1875636324118144:0@lo:900:lod0001_rec0000.0 00000100:00100000:2.0:1788746756.341751:0:23381:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788746756.341801:0:23381:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a45bc98e180 going to sleep for 11 seconds 00000100:00100000:1.0:1788746756.341866:0:22634:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324118144 00000100:00100000:1.0:1788746756.341871:0:22634:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324118144 00000100:00100000:1.0:1788746756.342032:0:22634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788746756.342040:0:22634:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4482711880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23381:x1875636324118144:12345-0@lo:900:lod0001_rec0000.0 00000100:00100000:1.0:1788746756.342125:0:22634:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4482711880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23381:x1875636324118144:12345-0@lo:900:lod0001_rec0000.0 Request processed in 85us (372us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746756.342131:0:22634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000040:01000000:0.0:1788746756.342333:0:23356:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:0.0:1788746756.342375:0:23356:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1788746756.342807:0:23356:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1788746756.342814:0:23356:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:0.0:1788746756.342850:0:23356:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788746756.344366:0:23356:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1788746756.344965:0:23356:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1788746756.344998:0:23356:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:0.0:1788746756.345204:0:23356:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00010000:00080000:2.0:1788746756.345626:0:23381:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8a4482713800 x1875636324118144/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788746772 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788746756.345644:0:23381:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a4482713800 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:23381:1875636324118144:0@lo:900:lod0001_rec0000.0 00000100:00100000:3.0:1788746756.345843:0:23381:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a45bca90700 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23381:1875636324118272:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1788746756.345922:0:23381:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00080000:10000000:0.0:1788746756.346865:0:23356:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x30:0x0] (8/32) registered 00000100:00100000:3.0:1788746756.347355:0:23381:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a45bcbcab40 going to sleep for 11 seconds 00000100:00100000:1.0:1788746756.347667:0:22629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324118272 00000100:00100000:1.0:1788746756.347677:0:22629:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324118272 00000100:00100000:1.0:1788746756.347726:0:22629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788746756.347735:0:22629:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a45bca93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:23381:x1875636324118272:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1788746756.347840:0:22629:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a45bca93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:23381:x1875636324118272:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 105us (1917us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746756.347848:0:22629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788746756.347872:0:23381:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a45bca90700 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23381:1875636324118272:0@lo:1000:lod0001_rec0000.0 00000040:00080000:3.0:1788746756.347940:0:23381:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788746756.350352:0:23381:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1788746756.350435:0:23381:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1788746756.350441:0:23381:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00000001:00000004:1.0:1788746756.351806:0:23356:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 12884901888 00000001:00080000:1.0:1788746756.365220:0:23356:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1788746756.365262:0:23356:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffff9fe241d97988 00100000:10000000:1.0:1788746756.365271:0:23356:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:1.0:1788746756.366507:0:23356:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788746756.366548:0:23356:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.139@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788746756.366569:0:23356:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=48 00000080:00000004:1.0:1788746756.366593:0:23356:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:2.0:1788746756.384545:0:23356:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788746756.385018:0:23356:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1788746756.500348:0:22664:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a45914310c0 going to sleep for 0 seconds 00010000:00010000:3.0:1788746757.012631:0:22612:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788746757.398990:0:23382:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788746757.524562:0:22664:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a45914310c0 going to sleep for 0 seconds 00010000:00010000:3.0:1788746758.034596:0:22611:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788746758.166377:0:22620:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788746758.166388:0:22620:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8a4582bdb800 from 12 10000000:01000000:0.0:1788746758.166394:0:22620:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788746758.166565:0:22620:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.139@tcp lock: ffff8a44825c2400/0xfac36e89154146ea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746758.166589:0:22620:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.139@tcp lock: ffff8a44825c2400/0xfac36e89154146ea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746758.170266:0:22620:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.139@tcp lock: ffff8a44825c2400/0xfac36e89154146ea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788746758.170307:0:22620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a4483cbe680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:41310026-2b0a-472c-80e6-fbabf81d5070:22620:1875636324118400:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788746758.170377:0:22620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746758.170417:0:22618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324118400 00000100:00100000:1.0:1788746758.170426:0:22618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324118400 00000100:00100000:1.0:1788746758.170484:0:22618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788746758.170493:0:22618:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4585855050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41310026-2b0a-472c-80e6-fbabf81d5070+16:22620:x1875636324118400:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788746758.170506:0:22618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788746758.170534:0:22618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a45ae45e000/0xfac36e89154146f1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xfac36e89154146ea expref: -99 pid: 22618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746758.170565:0:22618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a45ae45e000/0xfac36e89154146f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfac36e89154146ea expref: 17 pid: 22618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746758.170576:0:22618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a45ae45e000/0xfac36e89154146f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfac36e89154146ea expref: 17 pid: 22618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746758.170585:0:22618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a45ae45e000, rc 0) 00000100:00100000:1.0:1788746758.170618:0:22618:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4585855050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41310026-2b0a-472c-80e6-fbabf81d5070+17:22620:x1875636324118400:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 127us (241us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746758.170624:0:22618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788746758.170852:0:22620:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a45881380c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788746758.170883:0:22620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a4483cbe680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:41310026-2b0a-472c-80e6-fbabf81d5070:22620:1875636324118400:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788746758.170897:0:22620:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.139@tcp lock: ffff8a44825c2400/0xfac36e89154146ea lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfac36e89154146f1 expref: -99 pid: 22620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746758.170905:0:22620:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.139@tcp lock: ffff8a44825c2400/0xfac36e89154146ea lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xfac36e89154146f1 expref: -99 pid: 22620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788746758.170958:0:22620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a4483cbe680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:41310026-2b0a-472c-80e6-fbabf81d5070:22620:1875636324118528:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788746758.170987:0:22620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746758.171011:0:22620:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a45881380c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788746758.171156:0:22617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324118528 00000100:00100000:1.0:1788746758.171161:0:22617:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324118528 00000100:00100000:1.0:1788746758.171192:0:22617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788746758.171198:0:22617:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4585857050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41310026-2b0a-472c-80e6-fbabf81d5070+17:22620:x1875636324118528:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1788746758.171212:0:22617:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788746758.171227:0:22617:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788746758.171230:0:22617:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 12 00000100:00100000:1.0:1788746758.171329:0:22617:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4585857050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41310026-2b0a-472c-80e6-fbabf81d5070+17:22620:x1875636324118528:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 130us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746758.171334:0:22620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a4483cbe680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:41310026-2b0a-472c-80e6-fbabf81d5070:22620:1875636324118528:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788746758.171336:0:22617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 10000000:01000000:2.0:1788746758.171381:0:22620:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.139@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788746758.171388:0:22620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff8a44825c2400/0xfac36e89154146ea lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfac36e89154146f1 expref: -99 pid: 22620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746758.171397:0:22620:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.139@tcp lock: ffff8a44825c2400/0xfac36e89154146ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfac36e89154146f1 expref: -99 pid: 22620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788746758.171407:0:22620:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788746758.171409:0:22620:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8a45847a0000 from 12 10000000:01000000:2.0:1788746758.171412:0:22620:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788746758.171431:0:22620:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.139@tcp lock: ffff8a4581527c00/0xfac36e89154146f8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746758.171444:0:22620:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.139@tcp lock: ffff8a4581527c00/0xfac36e89154146f8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746758.171453:0:22620:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.139@tcp lock: ffff8a4581527c00/0xfac36e89154146f8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788746758.171466:0:22620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a4482713800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:41310026-2b0a-472c-80e6-fbabf81d5070:22620:1875636324118656:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788746758.171492:0:22620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788746758.171518:0:22620:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a45bc98e900 going to sleep for 11 seconds 00000100:00100000:1.0:1788746758.171573:0:22615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324118656 00000100:00100000:1.0:1788746758.171578:0:22615:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324118656 00000100:00100000:1.0:1788746758.171819:0:22615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788746758.171828:0:22615:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4585854050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41310026-2b0a-472c-80e6-fbabf81d5070+17:22620:x1875636324118656:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788746758.171836:0:22615:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788746758.172113:0:22615:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a45ae45f200/0xfac36e89154146ff lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xfac36e89154146f8 expref: -99 pid: 22615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746758.172141:0:22615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a45ae45f200/0xfac36e89154146ff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfac36e89154146f8 expref: 18 pid: 22615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746758.172151:0:22615:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a45ae45f200/0xfac36e89154146ff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfac36e89154146f8 expref: 18 pid: 22615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746758.172159:0:22615:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a45ae45f200, rc 0) 00000100:00100000:1.0:1788746758.172246:0:22615:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4585854050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41310026-2b0a-472c-80e6-fbabf81d5070+18:22620:x1875636324118656:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 420us (753us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746758.172252:0:22615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788746758.172326:0:22620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a4482713800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:41310026-2b0a-472c-80e6-fbabf81d5070:22620:1875636324118656:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788746758.172341:0:22620:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.139@tcp lock: ffff8a4581527c00/0xfac36e89154146f8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfac36e89154146ff expref: -99 pid: 22620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746758.172348:0:22620:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.139@tcp lock: ffff8a4581527c00/0xfac36e89154146f8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xfac36e89154146ff expref: -99 pid: 22620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788746758.172554:0:22620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a4483cbed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:41310026-2b0a-472c-80e6-fbabf81d5070:22620:1875636324118784:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788746758.172587:0:22620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788746758.180863:0:22617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324118784 00000100:00100000:2.0:1788746758.180890:0:22617:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324118784 00000100:00100000:2.0:1788746758.180951:0:22617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788746758.180960:0:22617:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4585854850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41310026-2b0a-472c-80e6-fbabf81d5070+18:22620:x1875636324118784:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788746758.180984:0:22617:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788746758.181174:0:22617:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788746758.181178:0:22617:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 12 00000100:00100000:2.0:1788746758.181317:0:22617:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4585854850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41310026-2b0a-472c-80e6-fbabf81d5070+18:22620:x1875636324118784:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 357us (8728us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746758.181325:0:22617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788746758.186372:0:22620:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a4588138840 going to sleep for 11 seconds 00000100:00100000:1.0:1788746758.186528:0:22620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a4483cbed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:41310026-2b0a-472c-80e6-fbabf81d5070:22620:1875636324118784:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788746758.186599:0:22620:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.139@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788746758.186611:0:22620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff8a4581527c00/0xfac36e89154146f8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfac36e89154146ff expref: -99 pid: 22620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746758.186623:0:22620:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.139@tcp lock: ffff8a4581527c00/0xfac36e89154146f8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfac36e89154146ff expref: -99 pid: 22620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788746758.420911:0:23382:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788746758.546404:0:22664:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a45914310c0 going to sleep for 0 seconds 00010000:00010000:0.0:1788746759.058771:0:22612:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788746759.573758:0:22664:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a45914310c0 going to sleep for 0 seconds 00010000:00010000:2.0:1788746760.088136:0:22611:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788746760.599556:0:22664:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a45914310c0 going to sleep for 0 seconds 00000001:02000400:2.0:1788746760.743182:0:23625:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg439-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1788746761.107343:0:22612:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788746761.427435:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788746761.427442:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1788746761.427446:0:36:0:(import.c:65:import_set_state_nolock()) ffff8a4583263800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788746761.427476:0:36:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8a4583263800 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:1.0:1788746761.427499:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a4483590e00 x1875636324119040/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788746761.427543:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788746761.427547:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788746761.427550:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788746761.427553:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788746761.427594:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788746761.427597:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788746761.427600:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788746761.427603:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788746761.427644:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a4483591880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:41310026-2b0a-472c-80e6-fbabf81d5070:3644:1875636324118912:0@lo:400:kworker.0 00000100:00100000:1.0:1788746761.427713:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746761.427760:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788746761.427767:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a4483591f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875636324119424:0@lo:400:kworker.0 00000100:00100000:1.0:1788746761.427825:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746761.428250:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a4483590e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1875636324119040:0@lo:38:kworker.0 00000100:00100000:1.0:1788746761.428309:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746761.428345:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a4483591c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875636324119168:0@lo:400:kworker.0 00000100:00100000:1.0:1788746761.428371:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746761.428517:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788746761.428525:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a4483590000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875636324119296:0@lo:400:kworker.0 00000100:00100000:1.0:1788746761.428611:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746761.428648:0:22629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324119040 00000100:00100000:1.0:1788746761.428654:0:22629:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324119040 00000100:00100000:1.0:1788746761.428697:0:22629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324119296 00000100:00100000:1.0:1788746761.428699:0:22629:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324119296 00000100:00100000:1.0:1788746761.428723:0:22629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788746761.428729:0:22629:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4483592d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3642:x1875636324119040:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1788746761.428761:0:22629:0:(ldlm_lib.c:1456:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 691 last 0 00000020:00000080:1.0:1788746761.429009:0:22629:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xfac36e8915414706 00000004:00100000:1.0:1788746761.429023:0:22629:0:(mdt_handler.c:7495:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:1.0:1788746761.429030:0:22629:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 12884901888 00000100:00100000:1.0:1788746761.429098:0:22624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324119424 00000100:00100000:1.0:1788746761.429102:0:22624:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324119424 00000100:00100000:1.0:1788746761.429141:0:22624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324119168 00000100:00100000:1.0:1788746761.429144:0:22624:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324119168 00000100:00100000:1.0:1788746761.429161:0:22624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788746761.429167:0:22624:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4483590380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875636324119424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788746761.429220:0:22624:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4483590380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875636324119424:12345-0@lo:400:kworker.0 Request processed in 52us (1394us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746761.429227:0:22624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788746761.429248:0:22624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788746761.429255:0:22624:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a45b7ef1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875636324119168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788746761.429309:0:22624:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a45b7ef1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875636324119168:12345-0@lo:400:kworker.0 Request processed in 55us (937us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746761.429315:0:22624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1788746761.429358:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8a4483591c00 x1875636324119168/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788746777 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788746761.429371:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a4483591c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875636324119168:0@lo:400:kworker.0 00000100:00100000:2.0:1788746761.430000:0:22617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324118912 00000100:00100000:2.0:1788746761.430006:0:22617:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324118912 00000100:00100000:2.0:1788746761.430093:0:22617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788746761.430101:0:22617:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4585854450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41310026-2b0a-472c-80e6-fbabf81d5070+18:3644:x1875636324118912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788746761.430147:0:22617:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4585854450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41310026-2b0a-472c-80e6-fbabf81d5070+18:3644:x1875636324118912:12345-0@lo:400:kworker.0 Request processed in 48us (2433us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746761.430169:0:22617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788746761.430236:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788746761.430256:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a4483cbd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875636324119552:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788746761.430472:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1788746761.430523:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8a4483591f80 x1875636324119424/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788746777 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788746761.430535:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a4483591f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875636324119424:0@lo:400:kworker.0 00000100:00100000:1.0:1788746761.430544:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a4483591880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:41310026-2b0a-472c-80e6-fbabf81d5070:3644:1875636324118912:0@lo:400:kworker.0 00000100:00100000:3.0:1788746761.430891:0:22628:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:3.0:1788746761.430901:0:22628:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:3.0:1788746761.431359:0:22628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324119552 00000100:00100000:3.0:1788746761.431367:0:22628:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324119552 00000100:00100000:1.0:1788746761.431655:0:23652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788746761.431664:0:23652:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a45b7ef1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3645:x1875636324119296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788746761.431740:0:23652:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a45b7ef1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3645:x1875636324119296:12345-0@lo:400:kworker.0 Request processed in 77us (3187us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746761.431746:0:23652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788746761.431945:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a4483590000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875636324119296:0@lo:400:kworker.0 00000100:00100000:3.0:1788746761.432079:0:22628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788746761.432087:0:22628:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a45b7ef0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875636324119552:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788746761.432121:0:22628:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1788746761.432175:0:22628:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a45b7ef0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875636324119552:12345-0@lo:41:osp-pre-0-1.0 Request processed in 89us (1703us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746761.432181:0:22628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788746761.432249:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a4483cbd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875636324119552:0@lo:41:osp-pre-0-1.0 00000100:00080000:1.0:1788746761.472896:0:22629:0:(import.c:65:import_set_state_nolock()) ffff8a45bd635800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788746761.473125:0:22629:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4483592d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3642:x1875636324119040:12345-0@lo:38:kworker.0 Request processed in 44392us (44836us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746761.473135:0:22629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:0.0:1788746761.474534:0:3642:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 3 00000100:00080000:0.0:1788746761.474546:0:3642:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:0.0:1788746761.474565:0:3642:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1788746761.474568:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8a4583263800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:0.0:1788746761.474588:0:3642:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 000000007ce40d71): req@ffff8a45bca91880 x1875636324111616/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788746761.474607:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a4483590e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1875636324119040:0@lo:38:kworker.0 00000100:00100000:0.0:1788746761.474690:0:22664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746761.474718:0:22664:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a45914310c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788746761.479321:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a45bca90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875636324119680:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788746761.479526:0:22628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324111616 00000100:00100000:0.0:1788746761.479535:0:22628:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324111616 00000100:00100000:0.0:1788746761.479586:0:22628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788746761.479596:0:22628:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4483cbd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:22664:x1875636324111616:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1788746761.479697:0:22628:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4483cbd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:22664:x1875636324111616:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 102us (5006us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746761.479705:0:22628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788746761.479747:0:22664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a45bca91880 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22664:1875636324111616:0@lo:1000:lod0000_rec0001.0 00000040:01000000:0.0:1788746761.479801:0:22664:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:0.0:1788746761.479851:0:22664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a4483cbca80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22664:1875636324119808:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1788746761.479884:0:22664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746761.479913:0:22664:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a45881380c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788746761.479995:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746761.480040:0:22628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324119808 00000100:00100000:3.0:1788746761.480043:0:22628:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324119808 00000100:00100000:3.0:1788746761.480059:0:22628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324119680 00000100:00100000:3.0:1788746761.480061:0:22628:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324119680 00000100:00100000:3.0:1788746761.480071:0:22628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788746761.480076:0:22628:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4483cbc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:22664:x1875636324119808:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1788746761.480181:0:22628:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4483cbc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:22664:x1875636324119808:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 105us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746761.480188:0:22628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788746761.480201:0:22628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788746761.480207:0:22628:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a45bca90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3645:x1875636324119680:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788746761.480229:0:22628:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788746761.480267:0:22628:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a45bca90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3645:x1875636324119680:12345-0@lo:41:osp-pre-1-0.0 Request processed in 60us (271us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746761.480275:0:22628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788746761.480326:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a45bca90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875636324119680:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788746761.481236:0:22664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a4483cbca80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22664:1875636324119808:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1788746761.481340:0:22664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a4483cbca80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22664:1875636324119936:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1788746761.481378:0:22664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746761.481466:0:22664:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a45881380c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788746761.481650:0:22629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324119936 00000100:00100000:1.0:1788746761.481657:0:22629:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324119936 00000100:00100000:1.0:1788746761.481686:0:22629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788746761.481693:0:22629:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4483cbe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22664:x1875636324119936:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1788746761.481752:0:22629:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4483cbe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22664:x1875636324119936:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 59us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746761.481758:0:22629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788746761.481865:0:22664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a4483cbca80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22664:1875636324119936:0@lo:1000:lod0000_rec0001.0 00000040:00080000:1.0:1788746761.481912:0:22664:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788746761.488633:0:22664:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1788746761.488735:0:22664:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 19, retries 0 00000004:00080000:1.0:1788746761.488739:0:22664:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000020:00000004:0.0:1788746761.848809:0:23678:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788746761.849046:0:23678:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788746762.134350:0:22611:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788746762.861487:0:23728:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788746762.861727:0:23728:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788746763.154607:0:22612:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788746764.104977:0:23777:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffcd69d21d0 20000000:00000080:3.0:1788746764.104996:0:23777:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8a45875f0400 uarg=0000000000000000 20000000:01000000:3.0:1788746764.105038:0:23777:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:3.0:1788746764.105045:0:23777:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:3.0:1788746764.105058:0:23777:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:0.0:1788746764.105861:0:23778:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 13 20000000:00000400:3.0:1788746764.106107:0:23777:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:3.0:1788746764.113565:0:23777:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788746764.113713:0:23777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a4581526600/0xfac36e891541470d lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746764.113733:0:23777:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a45ae45e600/0xfac36e89154145b6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfac36e89154145af expref: 17 pid: 22618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746764.113741:0:23777:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a45ae45ea00/0xfac36e89154146b9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfac36e89154146b2 expref: 17 pid: 22618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746764.113749:0:23777:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a4581526600/0xfac36e891541470d lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 23777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746764.113809:0:23777:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a45ae45ea00/0xfac36e89154146b9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xfac36e89154146b2 expref: 17 pid: 22618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746764.113824:0:23777:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a45ae45ea00/0xfac36e89154146b9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xfac36e89154146b2 expref: 17 pid: 22618 timeout: 793 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788746764.113838:0:23777:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a4482711500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23777:1875636324120064:0@lo:104: 00000100:00100000:2.0:1788746764.113975:0:23777:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788746764.114071:0:23777:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a45ae45e600/0xfac36e89154145b6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xfac36e89154145af expref: 17 pid: 22618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746764.114079:0:23777:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a45ae45e600/0xfac36e89154145b6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xfac36e89154145af expref: 17 pid: 22618 timeout: 793 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788746764.114087:0:23777:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a4482712680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23777:1875636324120192:0@lo:104: 00000100:00100000:2.0:1788746764.114111:0:23777:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788746764.114386:0:23777:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a4483c4d900 going to sleep for 11 seconds 00000100:00100000:1.0:1788746764.114765:0:22606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324120064 00000100:00100000:1.0:1788746764.114776:0:22606:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324120064 00000100:00100000:3.0:1788746764.114844:0:22607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324120192 00000100:00100000:3.0:1788746764.114848:0:22607:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324120192 00000100:00100000:3.0:1788746764.114887:0:22607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788746764.114898:0:22607:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4482712a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:41310026-2b0a-472c-80e6-fbabf81d5070+4:23777:x1875636324120064:12345-0@lo:104: 00010000:00010000:3.0:1788746764.114914:0:22607:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.139@tcp lock: ffff8a4581527200/0xfac36e89154146b2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xfac36e89154146b9 expref: -99 pid: 23356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746764.114988:0:22607:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788746764.114994:0:22607:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4482712a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:41310026-2b0a-472c-80e6-fbabf81d5070+4:23777:x1875636324120064:12345-0@lo:104: Request processed in 98us (1019us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746764.115000:0:22607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788746764.115019:0:22607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788746764.115025:0:22607:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4482713100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:41310026-2b0a-472c-80e6-fbabf81d5070+3:23777:x1875636324120192:12345-0@lo:104: 00010000:00010000:3.0:1788746764.115032:0:22607:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.139@tcp lock: ffff8a45c216c400/0xfac36e89154145af lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xfac36e89154145b6 expref: -99 pid: 22602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746764.115064:0:22607:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788746764.115069:0:22607:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4482713100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:41310026-2b0a-472c-80e6-fbabf81d5070+3:23777:x1875636324120192:12345-0@lo:104: Request processed in 46us (958us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746764.115074:0:22607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:3.0:1788746764.115090:0:22612:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788746764.115095:0:22612:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.139@tcp lock: ffff8a4581527200/0xfac36e89154146b2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xfac36e89154146b9 expref: -99 pid: 23356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746764.115102:0:22612:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a4581527200 already unused, calling callback (ffffffffc1180c20) 10000000:00010000:3.0:1788746764.115106:0:22612:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.139@tcp lock: ffff8a4581527200/0xfac36e89154146b2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xfac36e89154146b9 expref: -99 pid: 23356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746764.115126:0:22612:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.139@tcp lock: ffff8a4581527200/0xfac36e89154146b2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xfac36e89154146b9 expref: -99 pid: 23356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788746764.115144:0:22612:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.139@tcp lock: ffff8a4581527200/0xfac36e89154146b2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xfac36e89154146b9 expref: -99 pid: 23356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788746764.115150:0:22612:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788746764.115181:0:22612:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.139@tcp lock: ffff8a4581527200/0xfac36e89154146b2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfac36e89154146b9 expref: -99 pid: 23356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746764.115187:0:22612:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788746764.115205:0:22612:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.139@tcp lock: ffff8a4581527200/0xfac36e89154146b2 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfac36e89154146b9 expref: -99 pid: 23356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746764.115211:0:22612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.139@tcp lock: ffff8a4581527200/0xfac36e89154146b2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfac36e89154146b9 expref: -99 pid: 23356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746764.115224:0:22612:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788746764.115227:0:22612:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.139@tcp lock: ffff8a45c216c400/0xfac36e89154145af lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xfac36e89154145b6 expref: -99 pid: 22602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746764.115232:0:22612:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a45c216c400 already unused, calling callback (ffffffffc1180c20) 10000000:00010000:3.0:1788746764.115234:0:22612:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.139@tcp lock: ffff8a45c216c400/0xfac36e89154145af lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xfac36e89154145b6 expref: -99 pid: 22602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746764.115240:0:22612:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.139@tcp lock: ffff8a45c216c400/0xfac36e89154145af lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xfac36e89154145b6 expref: -99 pid: 22602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788746764.115246:0:22612:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.139@tcp lock: ffff8a45c216c400/0xfac36e89154145af lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xfac36e89154145b6 expref: -99 pid: 22602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788746764.115256:0:22612:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788746764.115269:0:22612:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.139@tcp lock: ffff8a45c216c400/0xfac36e89154145af lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfac36e89154145b6 expref: -99 pid: 22602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746764.115275:0:22612:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788746764.115316:0:22612:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.139@tcp lock: ffff8a45c216c400/0xfac36e89154145af lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfac36e89154145b6 expref: -99 pid: 22602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746764.115323:0:22612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.139@tcp lock: ffff8a45c216c400/0xfac36e89154145af lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfac36e89154145b6 expref: -99 pid: 22602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746764.115336:0:22612:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788746764.115338:0:22612:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788746764.115339:0:22612:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788746764.115354:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a45bca90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:41310026-2b0a-472c-80e6-fbabf81d5070:3646:1875636324120320:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788746764.115389:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746764.115562:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a45bca92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:41310026-2b0a-472c-80e6-fbabf81d5070:3643:1875636324120448:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788746764.115584:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746764.115628:0:22609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324120320 00000100:00100000:3.0:1788746764.115633:0:22609:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324120320 00010000:00010000:3.0:1788746764.115653:0:22609:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a45ae45ea00/0xfac36e89154146b9 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfac36e89154146b2 expref: 18 pid: 22618 timeout: 793 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788746764.115674:0:22609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324120448 00000100:00100000:3.0:1788746764.115676:0:22609:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324120448 00010000:00010000:3.0:1788746764.115685:0:22609:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a45ae45e600/0xfac36e89154145b6 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfac36e89154145af expref: 19 pid: 22618 timeout: 793 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788746764.115695:0:22609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788746764.115708:0:22609:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a45bca90000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41310026-2b0a-472c-80e6-fbabf81d5070+19:3646:x1875636324120320:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788746764.115721:0:22609:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788746764.115728:0:22609:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a45ae45ea00/0xfac36e89154146b9 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfac36e89154146b2 expref: 19 pid: 22618 timeout: 793 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746764.115741:0:22609:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a45ae45ea00/0xfac36e89154146b9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xfac36e89154146b2 expref: 19 pid: 22618 timeout: 793 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746764.115769:0:22609:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788746764.115798:0:22609:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a45bca90000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41310026-2b0a-472c-80e6-fbabf81d5070+19:3646:x1875636324120320:12345-0@lo:103:ldlm_bl.0 Request processed in 90us (408us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746764.115804:0:22609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788746764.115818:0:22609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788746764.115823:0:22609:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a45bca92680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41310026-2b0a-472c-80e6-fbabf81d5070+18:3643:x1875636324120448:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788746764.115831:0:22609:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788746764.115835:0:22609:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a45ae45e600/0xfac36e89154145b6 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfac36e89154145af expref: 18 pid: 22618 timeout: 793 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746764.115842:0:22609:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a45ae45e600/0xfac36e89154145b6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xfac36e89154145af expref: 18 pid: 22618 timeout: 793 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746764.115852:0:22609:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a4581526600/0xfac36e891541470d lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 23777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746764.115860:0:22609:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a4581526600/0xfac36e891541470d lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 23777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746764.115873:0:22609:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a4581526600/0xfac36e891541470d lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 23777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746764.115889:0:22609:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a4581526600/0xfac36e891541470d lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 23777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746764.115896:0:22609:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a4581526600/0xfac36e891541470d lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 23777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746764.115903:0:22609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a4581526600/0xfac36e891541470d lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 23777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746764.115909:0:22609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a4581526600 already unused, calling callback (ffffffffc0b5a8d0) 00010000:00010000:3.0:1788746764.115913:0:22609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a4581526600/0xfac36e891541470d lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 23777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746764.115921:0:22609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a4581526600/0xfac36e891541470d lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 23777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746764.115931:0:22609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a4581526600/0xfac36e891541470d lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746764.115940:0:22609:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788746764.115970:0:22609:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a45bca92680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41310026-2b0a-472c-80e6-fbabf81d5070+18:3643:x1875636324120448:12345-0@lo:103:ldlm_bl.0 Request processed in 146us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746764.115977:0:22609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788746764.116016:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a45bca92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:41310026-2b0a-472c-80e6-fbabf81d5070:3643:1875636324120448:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788746764.116043:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a45bca90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:41310026-2b0a-472c-80e6-fbabf81d5070:3646:1875636324120320:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788746764.116211:0:22611:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788746764.119117:0:23777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a45ae45ea00/0xfac36e89154146b9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xfac36e89154146b2 expref: 17 pid: 22618 timeout: 793 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788746764.119158:0:23777:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a4482711500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23777:1875636324120064:0@lo:104: 00010000:00010000:2.0:1788746764.119171:0:23777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a45ae45e600/0xfac36e89154145b6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xfac36e89154145af expref: 16 pid: 22618 timeout: 793 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788746764.119178:0:23777:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a4482712680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23777:1875636324120192:0@lo:104: 00010000:00010000:2.0:1788746764.119218:0:23777:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a4581526600/0xfac36e891541470d lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746764.119229:0:23777:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a4581526600/0xfac36e891541470d lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746764.119235:0:23777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a4581526600/0xfac36e891541470d lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746764.119240:0:23777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a4581526600/0xfac36e891541470d lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746764.199216:0:22612:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788746764.628709:0:22657:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788746765.204039:0:22611:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788746766.098471:0:22620:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788746766.098480:0:22620:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8a4582bdb800 from 13 10000000:01000000:1.0:1788746766.098485:0:22620:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788746766.098537:0:22620:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.139@tcp lock: ffff8a45ae45fe00/0xfac36e8915414714 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746766.098549:0:22620:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.139@tcp lock: ffff8a45ae45fe00/0xfac36e8915414714 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746766.098560:0:22620:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.139@tcp lock: ffff8a45ae45fe00/0xfac36e8915414714 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788746766.098587:0:22620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a45b7ef3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:41310026-2b0a-472c-80e6-fbabf81d5070:22620:1875636324120576:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788746766.098656:0:22620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746766.098756:0:22620:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a45872d00c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788746766.105962:0:22618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324120576 00000100:00100000:2.0:1788746766.105979:0:22618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324120576 00000100:00100000:2.0:1788746766.106044:0:22618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788746766.106055:0:22618:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4585856450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41310026-2b0a-472c-80e6-fbabf81d5070+16:22620:x1875636324120576:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788746766.106072:0:22618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788746766.106092:0:22618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a4581526200/0xfac36e891541471b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xfac36e8915414714 expref: -99 pid: 22618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746766.106121:0:22618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a4581526200/0xfac36e891541471b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfac36e8915414714 expref: 17 pid: 22618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746766.106140:0:22618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a4581526200/0xfac36e891541471b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfac36e8915414714 expref: 17 pid: 22618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746766.106150:0:22618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a4581526200, rc 0) 00000100:00100000:2.0:1788746766.106549:0:22618:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4585856450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41310026-2b0a-472c-80e6-fbabf81d5070+17:22620:x1875636324120576:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 494us (7892us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746766.106555:0:22618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788746766.114013:0:22620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a45b7ef3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:41310026-2b0a-472c-80e6-fbabf81d5070:22620:1875636324120576:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788746766.114050:0:22620:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.139@tcp lock: ffff8a45ae45fe00/0xfac36e8915414714 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfac36e891541471b expref: -99 pid: 22620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746766.114066:0:22620:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.139@tcp lock: ffff8a45ae45fe00/0xfac36e8915414714 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xfac36e891541471b expref: -99 pid: 22620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788746766.114163:0:22620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a45b7ef3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:41310026-2b0a-472c-80e6-fbabf81d5070:22620:1875636324120704:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788746766.114685:0:22620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746766.114733:0:22620:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a45872d00c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788746766.115443:0:22617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324120704 00000100:00100000:2.0:1788746766.115453:0:22617:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324120704 00000100:00100000:2.0:1788746766.115504:0:22617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788746766.115513:0:22617:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4585857c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41310026-2b0a-472c-80e6-fbabf81d5070+17:22620:x1875636324120704:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788746766.115984:0:22617:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4585857c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41310026-2b0a-472c-80e6-fbabf81d5070+17:22620:x1875636324120704:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 471us (1300us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746766.115993:0:22617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788746766.122529:0:22620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a45b7ef3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:41310026-2b0a-472c-80e6-fbabf81d5070:22620:1875636324120704:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788746766.124758:0:22620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a4482712680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:41310026-2b0a-472c-80e6-fbabf81d5070:22620:1875636324120832:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788746766.124844:0:22620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788746766.124918:0:22620:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a45912ff9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788746766.124954:0:22618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324120832 00000100:00100000:3.0:1788746766.124962:0:22618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324120832 00000100:00100000:3.0:1788746766.125036:0:22618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788746766.125045:0:22618:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4585857450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41310026-2b0a-472c-80e6-fbabf81d5070+17:22620:x1875636324120832:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788746766.125150:0:22618:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4585857450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41310026-2b0a-472c-80e6-fbabf81d5070+17:22620:x1875636324120832:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 106us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746766.125158:0:22618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788746766.125233:0:22620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a4482712680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:41310026-2b0a-472c-80e6-fbabf81d5070:22620:1875636324120832:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788746766.125924:0:23845:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1788746766.125989:0:22620:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1788746766.126007:0:22620:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.139@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788746766.126016:0:22620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff8a45ae45fe00/0xfac36e8915414714 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfac36e891541471b expref: -99 pid: 22620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746766.126027:0:22620:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.139@tcp lock: ffff8a45ae45fe00/0xfac36e8915414714 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfac36e891541471b expref: -99 pid: 22620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788746766.126038:0:22620:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788746766.126040:0:22620:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8a45847a0000 from 13 10000000:01000000:1.0:1788746766.126044:0:22620:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788746766.126072:0:22620:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.139@tcp lock: ffff8a45ae45ee00/0xfac36e8915414722 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746766.126080:0:22620:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.139@tcp lock: ffff8a45ae45ee00/0xfac36e8915414722 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746766.126089:0:22620:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.139@tcp lock: ffff8a45ae45ee00/0xfac36e8915414722 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788746766.126106:0:22620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a45b7ef3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:41310026-2b0a-472c-80e6-fbabf81d5070:22620:1875636324120960:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788746766.126143:0:22620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746766.126617:0:22620:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a45872d0f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788746766.126658:0:22617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324120960 00000100:00100000:2.0:1788746766.126666:0:22617:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324120960 00000100:00100000:2.0:1788746766.126701:0:22617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788746766.126708:0:22617:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4584203850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41310026-2b0a-472c-80e6-fbabf81d5070+17:22620:x1875636324120960:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788746766.126731:0:22617:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788746766.126745:0:22617:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a4581526800/0xfac36e8915414729 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xfac36e8915414722 expref: -99 pid: 22617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746766.126768:0:22617:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a4581526800/0xfac36e8915414729 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfac36e8915414722 expref: 18 pid: 22617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746766.126791:0:22617:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a4581526800/0xfac36e8915414729 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfac36e8915414722 expref: 18 pid: 22617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746766.126800:0:22617:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a4581526800, rc 0) 00000100:00100000:2.0:1788746766.126837:0:22617:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4584203850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41310026-2b0a-472c-80e6-fbabf81d5070+18:22620:x1875636324120960:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 130us (694us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746766.126844:0:22617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788746766.126882:0:22620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a45b7ef3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:41310026-2b0a-472c-80e6-fbabf81d5070:22620:1875636324120960:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788746766.126895:0:22620:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.139@tcp lock: ffff8a45ae45ee00/0xfac36e8915414722 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfac36e8915414729 expref: -99 pid: 22620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746766.126904:0:22620:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.139@tcp lock: ffff8a45ae45ee00/0xfac36e8915414722 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xfac36e8915414729 expref: -99 pid: 22620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788746766.126955:0:22620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a4482711500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:41310026-2b0a-472c-80e6-fbabf81d5070:22620:1875636324121088:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788746766.126977:0:22620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788746766.126989:0:22620:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a459a00c540 going to sleep for 11 seconds 00000100:00100000:2.0:1788746766.126998:0:22617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324121088 00000100:00100000:2.0:1788746766.127001:0:22617:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324121088 00000100:00100000:2.0:1788746766.127015:0:22617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788746766.127020:0:22617:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4584202050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41310026-2b0a-472c-80e6-fbabf81d5070+18:22620:x1875636324121088:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788746766.127104:0:22617:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4584202050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41310026-2b0a-472c-80e6-fbabf81d5070+18:22620:x1875636324121088:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 83us (126us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746766.127111:0:22617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788746766.127134:0:22620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a4482711500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:41310026-2b0a-472c-80e6-fbabf81d5070:22620:1875636324121088:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788746766.127164:0:22620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a4482711500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:41310026-2b0a-472c-80e6-fbabf81d5070:22620:1875636324121216:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788746766.127271:0:22620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788746766.127282:0:22620:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a448274b480 going to sleep for 11 seconds 00000100:00100000:2.0:1788746766.127310:0:22617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324121216 00000100:00100000:2.0:1788746766.127314:0:22617:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324121216 00000100:00100000:2.0:1788746766.127331:0:22617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788746766.127337:0:22617:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4584201050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41310026-2b0a-472c-80e6-fbabf81d5070+18:22620:x1875636324121216:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788746766.127481:0:22617:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4584201050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41310026-2b0a-472c-80e6-fbabf81d5070+18:22620:x1875636324121216:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 143us (209us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746766.127489:0:22617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788746766.127526:0:22620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a4482711500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:41310026-2b0a-472c-80e6-fbabf81d5070:22620:1875636324121216:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788746766.128349:0:23846:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1788746766.128728:0:22620:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1788746766.128751:0:22620:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.139@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788746766.128759:0:22620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff8a45ae45ee00/0xfac36e8915414722 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfac36e8915414729 expref: -99 pid: 22620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746766.128769:0:22620:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.139@tcp lock: ffff8a45ae45ee00/0xfac36e8915414722 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfac36e8915414729 expref: -99 pid: 22620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746766.228375:0:22612:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788746766.552548:0:3642:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788746756/real 1788746756] req@ffff8a45bca90380 x1875636324114816/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788746766 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788746766.552586:0:3642:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8a45bca90380 x1875636324114816/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788746766 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788746766.552598:0:3642:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788746756/real 1788746756] req@ffff8a45bca91f80 x1875636324114688/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788746766 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788746766.552611:0:3642:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8a45bca91f80 x1875636324114688/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788746766 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788746766.552631:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8a45b7f9f000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788746766.552644:0:3642:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788746766.552648:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a45bca90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1875636324114816:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1788746766.552676:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8a45bfe8f000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788746766.552684:0:3642:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788746766.552687:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a45bca91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1875636324114688:0@lo:8:llog_process_th.0 00000100:00100000:3.0:1788746766.554632:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a4482711500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875636324121600:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788746766.554702:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746766.554754:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788746766.554761:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a4483cbca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875636324121472:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788746766.554782:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746766.554816:0:22629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324121600 00000100:00100000:3.0:1788746766.554824:0:22629:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324121600 00000100:00100000:3.0:1788746766.554871:0:22629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324121472 00000100:00100000:3.0:1788746766.554874:0:22629:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324121472 00000100:00100000:3.0:1788746766.554891:0:22629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788746766.554900:0:22629:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a45bca90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3646:x1875636324121600:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788746766.554953:0:22629:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788746766.555001:0:22629:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a45bca90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3646:x1875636324121600:12345-0@lo:41:osp-pre-1-0.0 Request processed in 101us (298us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746766.555008:0:22629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788746766.555025:0:22629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788746766.555031:0:22629:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a45bca92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875636324121472:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788746766.555048:0:22629:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1788746766.555074:0:22629:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a45bca92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875636324121472:12345-0@lo:41:osp-pre-0-1.0 Request processed in 43us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746766.555080:0:22629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788746766.555124:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a4483cbca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875636324121472:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788746766.555137:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a4482711500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875636324121600:0@lo:41:osp-pre-1-0.0 00000100:00080000:1.0:1788746766.559227:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788746766.559238:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788746766.559241:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788746766.559268:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788746766.559512:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a45b7ef3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:41310026-2b0a-472c-80e6-fbabf81d5070:3644:1875636324121344:0@lo:400:kworker.0 00000100:00100000:3.0:1788746766.559595:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746766.559683:0:22617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324121344 00000100:00100000:3.0:1788746766.559692:0:22617:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324121344 00000100:00100000:3.0:1788746766.559752:0:22617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788746766.559763:0:22617:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4584203050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41310026-2b0a-472c-80e6-fbabf81d5070+18:3644:x1875636324121344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788746766.559818:0:22617:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4584203050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41310026-2b0a-472c-80e6-fbabf81d5070+18:3644:x1875636324121344:12345-0@lo:400:kworker.0 Request processed in 56us (223us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746766.559826:0:22617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788746766.559877:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a45b7ef3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:41310026-2b0a-472c-80e6-fbabf81d5070:3644:1875636324121344:0@lo:400:kworker.0 00000100:00080000:1.0:1788746766.560010:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788746766.560014:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1788746766.560018:0:36:0:(import.c:65:import_set_state_nolock()) ffff8a45bfe8f000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788746766.560023:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 685 00000100:00080000:1.0:1788746766.560027:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788746766.560036:0:36:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8a45bfe8f000 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:1.0:1788746766.560060:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a45b7ef0a80 x1875636324121856/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788746766.560077:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788746766.560080:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788746766.560082:0:36:0:(import.c:65:import_set_state_nolock()) ffff8a45b7f9f000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788746766.560085:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 686 00000100:00080000:1.0:1788746766.560088:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788746766.560093:0:36:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8a45b7f9f000 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:1.0:1788746766.560104:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a45b7ef0000 x1875636324121984/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788746766.560130:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788746766.560133:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788746766.560136:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788746766.560138:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788746766.563351:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a45b7ef2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875636324121728:0@lo:400:kworker.0 00000100:00100000:3.0:1788746766.563433:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746766.563495:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788746766.563503:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a45b7ef0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875636324122112:0@lo:400:kworker.0 00000100:00100000:3.0:1788746766.563532:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746766.563580:0:22624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324121728 00000100:00100000:3.0:1788746766.563587:0:22624:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324121728 00000100:00100000:3.0:1788746766.563636:0:22624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324122112 00000100:00100000:3.0:1788746766.563640:0:22624:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324122112 00000100:00100000:3.0:1788746766.563654:0:22624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788746766.563663:0:22624:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a45bca93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875636324121728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788746766.563731:0:22624:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a45bca93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875636324121728:12345-0@lo:400:kworker.0 Request processed in 68us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746766.563739:0:22624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788746766.563757:0:22624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788746766.563764:0:22624:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a45bca93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875636324122112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788746766.563797:0:22624:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a45bca93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875636324122112:12345-0@lo:400:kworker.0 Request processed in 34us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746766.563803:0:22624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1788746766.563847:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8a45b7ef0e00 x1875636324122112/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788746782 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788746766.563862:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a45b7ef0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875636324122112:0@lo:400:kworker.0 00010000:00080000:3.0:1788746766.563873:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8a45b7ef2a00 x1875636324121728/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788746782 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788746766.563880:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a45b7ef2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875636324121728:0@lo:400:kworker.0 00000100:00100000:3.0:1788746766.567458:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a45b7ef0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1875636324121856:0@lo:8:kworker.0 00000400:00000100:3.0:1788746766.567532:0:3642:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875636324121856 offset 0 length 520: 4 00000100:00100000:3.0:1788746766.567587:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a45b7ef0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1875636324121984:0@lo:8:kworker.0 00000400:00000100:3.0:1788746766.567611:0:3642:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875636324121984 offset 0 length 520: 4 00000001:00100000:0.0:1788746767.060753:0:23357:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:0.0:1788746767.253463:0:22611:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788746767.571684:0:3642:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788746752/real 1788746752] req@ffff8a45bca91500 x1875636324112768/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788746767 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788746767.571725:0:3642:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8a45bca91500 x1875636324112768/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788746767 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788746767.571735:0:3642:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788746752/real 1788746752] req@ffff8a45bca91c00 x1875636324112896/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788746767 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788746767.571756:0:3642:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8a45bca91c00 x1875636324112896/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788746767 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788746767.571777:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8a45b7e60000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788746767.571787:0:3642:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788746767.571791:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a45bca91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1875636324112768:0@lo:8:kworker.0 00000100:00080000:2.0:1788746767.571796:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8a45bfe8d800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788746767.571800:0:3642:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788746767.571803:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a45bca91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1875636324112896:0@lo:8:kworker.0 00000100:00080000:0.0:1788746767.574712:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788746767.574719:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1788746767.574722:0:36:0:(import.c:65:import_set_state_nolock()) ffff8a45b7e60000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788746767.574730:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 682 00000100:00080000:0.0:1788746767.574736:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1788746767.574757:0:36:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8a45b7e60000 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:0.0:1788746767.574783:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a4483cbea00 x1875636324122496/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788746767.574801:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788746767.574814:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788746767.574815:0:36:0:(import.c:65:import_set_state_nolock()) ffff8a45bfe8d800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788746767.574819:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 682 00000100:00080000:0.0:1788746767.574822:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1788746767.574828:0:36:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8a45bfe8d800 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:0.0:1788746767.574840:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a4483cbdc00 x1875636324122624/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788746767.574873:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788746767.574877:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788746767.574879:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788746767.574882:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788746767.574911:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a4483cbf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875636324122752:0@lo:400:kworker.0 00000100:00100000:0.0:1788746767.574973:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746767.575010:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788746767.575016:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a4483cbc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875636324122880:0@lo:400:kworker.0 00000100:00100000:0.0:1788746767.575039:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746767.575071:0:22624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324122752 00000100:00100000:0.0:1788746767.575078:0:22624:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324122752 00000100:00100000:0.0:1788746767.575125:0:22624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788746767.575135:0:22624:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4483cbf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875636324122752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788746767.575187:0:22624:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4483cbf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875636324122752:12345-0@lo:400:kworker.0 Request processed in 53us (213us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746767.575194:0:22624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788746767.575216:0:22629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324122880 00000100:00100000:0.0:1788746767.575219:0:22629:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324122880 00000100:00100000:0.0:1788746767.575247:0:22629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788746767.575253:0:22629:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4483cbdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875636324122880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788746767.575306:0:22629:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4483cbdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875636324122880:12345-0@lo:400:kworker.0 Request processed in 31us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746767.575313:0:22629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788746767.575350:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a4483cbc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875636324122880:0@lo:400:kworker.0 00010000:00080000:0.0:1788746767.575361:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8a4483cbf100 x1875636324122752/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788746783 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788746767.575370:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a4483cbf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875636324122752:0@lo:400:kworker.0 00000100:00100000:0.0:1788746767.575399:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a4483cbea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1875636324122496:0@lo:8:kworker.0 00000400:00000100:0.0:1788746767.575418:0:3642:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875636324122496 offset 0 length 520: 4 00000100:00100000:0.0:1788746767.575439:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a4483cbdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1875636324122624:0@lo:8:kworker.0 00000400:00000100:0.0:1788746767.575451:0:3642:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875636324122624 offset 0 length 520: 4 00000100:00100000:3.0:1788746767.575555:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a4483cbed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:41310026-2b0a-472c-80e6-fbabf81d5070:3645:1875636324122240:0@lo:400:kworker.0 00000100:00100000:3.0:1788746767.575588:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746767.575607:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a4483cbd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875636324123008:0@lo:400:kworker.0 00000100:00100000:3.0:1788746767.575628:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746767.575645:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788746767.575650:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a4483cbe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875636324122368:0@lo:400:kworker.0 00000100:00100000:3.0:1788746767.575669:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746767.575704:0:22628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324122368 00000100:00100000:3.0:1788746767.575708:0:22628:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324122368 00000100:00100000:3.0:1788746767.575733:0:22628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788746767.575739:0:22628:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a45bca90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875636324122368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788746767.575787:0:22628:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a45bca90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875636324122368:12345-0@lo:400:kworker.0 Request processed in 48us (117us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746767.575793:0:22628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788746767.575810:0:22615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324122240 00000100:00100000:3.0:1788746767.575813:0:22615:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324122240 00000100:00100000:3.0:1788746767.575834:0:22615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788746767.575840:0:22615:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4483d5fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41310026-2b0a-472c-80e6-fbabf81d5070+18:3645:x1875636324122240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788746767.575866:0:22615:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4483d5fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41310026-2b0a-472c-80e6-fbabf81d5070+18:3645:x1875636324122240:12345-0@lo:400:kworker.0 Request processed in 27us (278us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746767.575872:0:22615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788746767.575896:0:22623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324123008 00000100:00100000:3.0:1788746767.575900:0:22623:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324123008 00000100:00100000:3.0:1788746767.575919:0:22623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788746767.575934:0:22623:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a45bca93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875636324123008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788746767.575963:0:22623:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a45bca93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875636324123008:12345-0@lo:400:kworker.0 Request processed in 30us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746767.575969:0:22623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788746767.575997:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a4483cbe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875636324122368:0@lo:400:kworker.0 00000100:00100000:3.0:1788746767.576005:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a4483cbed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:41310026-2b0a-472c-80e6-fbabf81d5070:3645:1875636324122240:0@lo:400:kworker.0 00010000:00080000:3.0:1788746767.576013:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8a4483cbd880 x1875636324123008/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788746783 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788746767.576021:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a4483cbd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875636324123008:0@lo:400:kworker.0 00010000:00010000:0.0:1788746768.280242:0:22612:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788746768.667586:0:23382:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788746769.304274:0:22611:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788746770.322419:0:22612:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788746771.105257:0:24124:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1788746771.105261:0:24124:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:0.0:1788746771.105262:0:24124:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:0.0:1788746771.105703:0:24124:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8a45bc9b7000 00000020:01000004:0.0:1788746771.105718:0:24124:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:0.0:1788746771.105731:0:24124:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1788746771.105743:0:24124:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff8a45bdd7cd40) 00000020:00000080:0.0:1788746771.105757:0:24124:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1788746771.174963:0:24124:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1788746771.177258:0:24124:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:2.0:1788746771.177719:0:24124:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1788746771.178121:0:24124:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1788746771.178951:0:24124:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:2.0:1788746771.179780:0:24124:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:2.0:1788746771.180137:0:24124:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:01000000:2.0:1788746771.186754:0:24124:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1788746771.187210:0:24124:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1788746771.187227:0:24124:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788746771.187242:0:24124:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xfac36e8915414737 00000020:01000004:2.0:1788746771.187249:0:24124:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:2.0:1788746771.187377:0:24124:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.139@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788746771.187382:0:24124:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.139@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788746771.187387:0:24124:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1788746771.187392:0:24124:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1788746771.187547:0:24124:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff8a45872999c0) 00000020:00000080:2.0:1788746771.187562:0:24124:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type ost with refcount 2 00000100:00100000:2.0:1788746771.189012:0:24124:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788746771.189181:0:24124:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1788746771.189187:0:24124:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:2.0:1788746771.191223:0:24124:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:2.0:1788746771.191236:0:24124:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:2.0:1788746771.191945:0:24124:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:2.0:1788746771.191952:0:24124:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:3.0:1788746771.198979:0:24124:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788746771.199194:0:24124:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:3.0:1788746771.199202:0:24124:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:1.0:1788746771.204171:0:24124:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:1.0:1788746771.204190:0:24124:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:1.0:1788746771.247107:0:24124:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788746771.247546:0:24124:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1788746771.247554:0:24124:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:3.0:1788746771.249810:0:24124:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1788746771.249823:0:24124:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1788746771.251552:0:24124:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1788746771.251566:0:24124:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:3.0:1788746771.253910:0:24124:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788746771.254118:0:24124:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:3.0:1788746771.254124:0:24124:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:3.0:1788746771.261489:0:24124:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:2.0:1788746771.261607:0:24124:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00010000:00010000:3.0:1788746771.346562:0:22611:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788746771.346910:0:24124:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788746771.347111:0:24124:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:0.0:1788746771.347118:0:24124:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:1.0:1788746771.354661:0:24124:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:1.0:1788746771.354682:0:24124:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:2.0:1788746771.360454:0:24124:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:2.0:1788746771.360489:0:24124:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:2.0:1788746771.360495:0:24124:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.139@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:3.0:1788746771.387019:0:24124:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.139@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788746771.387484:0:24124:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.204.139@tcp, index=0000, flags=0x20002 00000020:01000004:3.0:1788746771.387490:0:24124:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788746771.387491:0:24124:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788746771.387493:0:24124:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788746771.387494:0:24124:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788746771.387502:0:24124:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788746771.387503:0:24124:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788746771.387504:0:24124:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788746771.387506:0:24124:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788746771.387507:0:24124:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788746771.387511:0:24124:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:3.0:1788746771.387513:0:24124:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788746771.387514:0:24124:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788746771.387515:0:24124:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788746771.387516:0:24124:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788746771.387516:0:24124:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788746771.387517:0:24124:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788746771.387518:0:24124:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788746771.387519:0:24124:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788746771.387519:0:24124:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788746771.387561:0:24124:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1788746771.387582:0:24124:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a45bca91c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41310026-2b0a-472c-80e6-fbabf81d5070:24124:1875636324123136:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788746771.387667:0:24124:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746771.387719:0:24124:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a45bc98ec00 going to sleep for 11 seconds 00000100:00100000:0.0:1788746771.387793:0:22618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324123136 00000100:00100000:0.0:1788746771.387803:0:22618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324123136 00000100:00100000:0.0:1788746771.387885:0:22618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788746771.387897:0:22618:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4483d5c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41310026-2b0a-472c-80e6-fbabf81d5070+18:24124:x1875636324123136:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788746771.387940:0:22618:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1788746771.387943:0:22618:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:0.0:1788746771.387948:0:22618:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1788746771.388609:0:22618:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4483d5c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41310026-2b0a-472c-80e6-fbabf81d5070+18:24124:x1875636324123136:12345-0@lo:253:mount.lustre.0 Request processed in 713us (939us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746771.388631:0:22618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788746771.388719:0:24124:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a45bca91c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41310026-2b0a-472c-80e6-fbabf81d5070:24124:1875636324123136:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788746771.388729:0:24124:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1788746771.388732:0:24124:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788746771.388733:0:24124:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788746771.388734:0:24124:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788746771.388735:0:24124:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788746771.388736:0:24124:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788746771.388738:0:24124:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788746771.388739:0:24124:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788746771.388740:0:24124:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788746771.388741:0:24124:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788746771.388760:0:24124:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8a45bc9b7000 from lustre-OST0000 10000000:01000000:3.0:1788746771.388788:0:24124:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:3.0:1788746771.388790:0:24124:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1788746771.388798:0:24124:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8a4483138000 local copy 00010000:00010000:3.0:1788746771.388808:0:24124:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.139@tcp lock: ffff8a44825c3400/0xfac36e89154144f2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xfac36e89154144f9 expref: -99 pid: 22602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788746771.389172:0:24124:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a45bca91c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41310026-2b0a-472c-80e6-fbabf81d5070:24124:1875636324123264:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788746771.389207:0:24124:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746771.389244:0:24124:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a45bc98e000 going to sleep for 11 seconds 00000100:00100000:0.0:1788746771.389314:0:22617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324123264 00000100:00100000:0.0:1788746771.389319:0:22617:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324123264 00000100:00100000:0.0:1788746771.389352:0:22617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788746771.389360:0:22617:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4483cddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41310026-2b0a-472c-80e6-fbabf81d5070+18:24124:x1875636324123264:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788746771.389436:0:22617:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4483cddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41310026-2b0a-472c-80e6-fbabf81d5070+18:24124:x1875636324123264:12345-0@lo:501:mount.lustre.0 Request processed in 76us (228us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788746771.389443:0:22617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788746771.389601:0:24124:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a45bca91c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41310026-2b0a-472c-80e6-fbabf81d5070:24124:1875636324123264:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1788746771.389626:0:24124:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.139@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1788746771.389647:0:24124:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.139@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1788746771.389653:0:24124:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff8a44825c3400/0xfac36e89154144f2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xfac36e89154144f9 expref: -99 pid: 22602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746771.389663:0:24124:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.139@tcp lock: ffff8a44825c3400/0xfac36e89154144f2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xfac36e89154144f9 expref: -99 pid: 22602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788746771.389689:0:24124:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8a45bc9b7000 10000000:01000000:1.0:1788746771.389694:0:24124:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788746771.389699:0:24124:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1788746771.389702:0:24124:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788746771.389705:0:24124:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:1.0:1788746771.389708:0:24124:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1788746771.389740:0:24124:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.139@tcp lock: ffff8a45ae45ea00/0xfac36e8915414745 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746771.389747:0:24124:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.139@tcp lock: ffff8a45ae45ea00/0xfac36e8915414745 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746771.389756:0:24124:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.139@tcp lock: ffff8a45ae45ea00/0xfac36e8915414745 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788746771.389768:0:24124:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a45b7ef1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41310026-2b0a-472c-80e6-fbabf81d5070:24124:1875636324123392:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788746771.389806:0:24124:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746771.389834:0:24124:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a4483c4d0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788746771.391343:0:22618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324123392 00000100:00100000:0.0:1788746771.391358:0:22618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324123392 00000100:00100000:0.0:1788746771.391419:0:22618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788746771.391427:0:22618:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4483cdcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41310026-2b0a-472c-80e6-fbabf81d5070+18:24124:x1875636324123392:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788746771.391443:0:22618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788746771.391461:0:22618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a44825c3c00/0xfac36e891541474c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xfac36e8915414745 expref: -99 pid: 22618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746771.391486:0:22618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a44825c3c00/0xfac36e891541474c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfac36e8915414745 expref: 19 pid: 22618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746771.391497:0:22618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a44825c3c00/0xfac36e891541474c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfac36e8915414745 expref: 19 pid: 22618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746771.391525:0:22618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a44825c3c00, rc 0) 00000100:00100000:0.0:1788746771.391590:0:22618:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4483cdcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41310026-2b0a-472c-80e6-fbabf81d5070+19:24124:x1875636324123392:12345-0@lo:101:mount.lustre.0 Request processed in 163us (1783us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746771.391595:0:22618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788746771.391823:0:24124:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a45b7ef1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41310026-2b0a-472c-80e6-fbabf81d5070:24124:1875636324123392:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788746771.391840:0:24124:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.139@tcp lock: ffff8a45ae45ea00/0xfac36e8915414745 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xfac36e891541474c expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746771.391848:0:24124:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.139@tcp lock: ffff8a45ae45ea00/0xfac36e8915414745 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xfac36e891541474c expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788746771.394057:0:24124:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000040:00080000:1.0:1788746771.394908:0:24124:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788746771.397220:0:24124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:1.0:1788746771.397456:0:24124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 128 off8544 00000040:00080000:1.0:1788746771.397476:0:24124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 112 off8656 00000040:00080000:1.0:1788746771.397489:0:24124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8880 00000040:00080000:1.0:1788746771.397501:0:24124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9104 00000040:00080000:1.0:1788746771.397515:0:24124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 80 off9184 00000040:00080000:1.0:1788746771.397530:0:24124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 224 off9408 00000040:00080000:1.0:1788746771.397544:0:24124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9632 00000040:00080000:1.0:1788746771.397557:0:24124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 80 off9712 00000040:00080000:1.0:1788746771.397573:0:24124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 224 off9936 00000040:00080000:1.0:1788746771.397585:0:24124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].11, 224 off10160 00000040:00080000:1.0:1788746771.397601:0:24124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].12, 120 off10280 00000040:00080000:1.0:1788746771.397641:0:24124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].13, 224 off10504 00000040:00080000:1.0:1788746771.397647:0:24124:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 13 count 14 00000100:00100000:1.0:1788746771.397750:0:24124:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a45b7ef1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41310026-2b0a-472c-80e6-fbabf81d5070:24124:1875636324123520:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788746771.397821:0:24124:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746771.397926:0:24124:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a4483c4d600 going to sleep for 11 seconds 00000100:00100000:3.0:1788746771.399558:0:22615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324123520 00000100:00100000:3.0:1788746771.399571:0:22615:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324123520 00000100:00100000:2.0:1788746771.399792:0:22615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788746771.399804:0:22615:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4483cde850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41310026-2b0a-472c-80e6-fbabf81d5070+19:24124:x1875636324123520:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788746771.400046:0:22615:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4483cde850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41310026-2b0a-472c-80e6-fbabf81d5070+19:24124:x1875636324123520:12345-0@lo:501:mount.lustre.0 Request processed in 244us (2225us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746771.400054:0:22615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788746771.400142:0:24124:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a45b7ef1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41310026-2b0a-472c-80e6-fbabf81d5070:24124:1875636324123520:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788746771.400206:0:24124:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a45b7ef1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41310026-2b0a-472c-80e6-fbabf81d5070:24124:1875636324123648:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788746771.400249:0:24124:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746771.400581:0:24124:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a4483c4d600 going to sleep for 11 seconds 00000100:00100000:0.0:1788746771.400658:0:22618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324123648 00000100:00100000:0.0:1788746771.400664:0:22618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324123648 00000100:00100000:0.0:1788746771.400690:0:22618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788746771.400698:0:22618:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4483cdc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41310026-2b0a-472c-80e6-fbabf81d5070+19:24124:x1875636324123648:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788746771.401673:0:22618:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4483cdc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41310026-2b0a-472c-80e6-fbabf81d5070+19:24124:x1875636324123648:12345-0@lo:503:mount.lustre.0 Request processed in 972us (1419us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746771.401681:0:22618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788746771.401771:0:24124:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a45b7ef1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41310026-2b0a-472c-80e6-fbabf81d5070:24124:1875636324123648:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788746771.402373:0:24124:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788746771.402454:0:24124:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a45b7ef1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41310026-2b0a-472c-80e6-fbabf81d5070:24124:1875636324123776:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788746771.402507:0:24124:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746771.402594:0:24124:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a4483c4d0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788746771.402761:0:22617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324123776 00000100:00100000:3.0:1788746771.402769:0:22617:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324123776 00000100:00100000:2.0:1788746771.402858:0:22615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788746771.402876:0:22615:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4483cdf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41310026-2b0a-472c-80e6-fbabf81d5070+19:24124:x1875636324123776:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788746771.403457:0:22615:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4483cdf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41310026-2b0a-472c-80e6-fbabf81d5070+19:24124:x1875636324123776:12345-0@lo:502:mount.lustre.0 Request processed in 583us (949us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746771.403466:0:22615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788746771.403584:0:24124:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a45b7ef1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41310026-2b0a-472c-80e6-fbabf81d5070:24124:1875636324123776:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788746771.403788:0:24124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:1.0:1788746771.403818:0:24124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 128 off8544 00000040:00080000:1.0:1788746771.403831:0:24124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 112 off8656 00000040:00080000:1.0:1788746771.403842:0:24124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8880 00000040:00080000:1.0:1788746771.403852:0:24124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9104 00000040:00080000:1.0:1788746771.403865:0:24124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 80 off9184 00000040:00080000:1.0:1788746771.403878:0:24124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 224 off9408 00000040:00080000:1.0:1788746771.403906:0:24124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9632 00000040:00080000:1.0:1788746771.403920:0:24124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 80 off9712 00000040:00080000:1.0:1788746771.403932:0:24124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 224 off9936 00000040:00080000:1.0:1788746771.403945:0:24124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10160 00000040:00080000:1.0:1788746771.403958:0:24124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 120 off10280 00000100:00100000:1.0:1788746771.403986:0:24124:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a45b7ef1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41310026-2b0a-472c-80e6-fbabf81d5070:24124:1875636324123904:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788746771.404029:0:24124:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746771.404109:0:24124:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a4483c4d0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788746771.404221:0:22617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324123904 00000100:00100000:3.0:1788746771.404227:0:22617:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324123904 00000100:00100000:3.0:1788746771.404263:0:22617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788746771.404272:0:22617:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4483cdd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41310026-2b0a-472c-80e6-fbabf81d5070+19:24124:x1875636324123904:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788746771.404388:0:22617:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4483cdd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41310026-2b0a-472c-80e6-fbabf81d5070+19:24124:x1875636324123904:12345-0@lo:502:mount.lustre.0 Request processed in 118us (359us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746771.404396:0:22617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788746771.404529:0:24124:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a45b7ef1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41310026-2b0a-472c-80e6-fbabf81d5070:24124:1875636324123904:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788746771.404576:0:24124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 224 off10504 00000040:00080000:0.0:1788746771.404584:0:24124:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 00000020:01000000:1.0:1788746771.407678:0:24142:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788746771.407692:0:24142:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:1.0:1788746771.407700:0:24142:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788746771.407717:0:24142:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:1.0:1788746771.407727:0:24142:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788746771.407745:0:24142:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff8a45c0ee19c0) 00000020:00000080:1.0:1788746771.407777:0:24142:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type obdfilter with refcount 2 00000020:00000080:1.0:1788746771.407785:0:24142:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788746771.408016:0:24142:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8a45bc9b7000 from lustre-OST0000, refs=2 00080000:01000000:1.0:1788746771.408026:0:24142:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788746771.408036:0:24142:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xfac36e891541475a 00010000:00010000:1.0:1788746771.412631:0:24142:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:00000004:1.0:1788746771.413062:0:24142:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 8589934594 00080000:10000000:1.0:1788746771.414967:0:24142:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/32) registered 00000020:00000080:1.0:1788746771.416363:0:24142:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:1.0:1788746771.416377:0:24142:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788746771.416383:0:24142:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788746771.416385:0:24142:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:1.0:1788746771.416389:0:24142:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788746771.416391:0:24142:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #27 00000020:01000000:1.0:1788746771.416393:0:24142:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788746771.416394:0:24142:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788746771.416396:0:24142:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788746771.416399:0:24142:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788746771.416400:0:24142:0:(obd_config.c:1563:class_process_config()) marker 27 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788746771.416403:0:24142:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788746771.416406:0:24142:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788746771.416408:0:24142:0:(obd_config.c:1563:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788746771.416411:0:24142:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788746771.416413:0:24142:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788746771.416415:0:24142:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788746771.416417:0:24142:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788746771.416419:0:24142:0:(obd_config.c:1563:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000020:01000000:1.0:1788746771.416421:0:24142:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788746771.416423:0:24142:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788746771.416424:0:24142:0:(obd_config.c:1563:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788746771.416428:0:24142:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1788746771.416459:0:24142:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788746771.416462:0:24142:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788746771.416463:0:24142:0:(obd_config.c:1563:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788746771.416466:0:24142:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 14 count 14 00000020:01000000:2.0:1788746771.418708:0:24124:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:2.0:1788746771.418754:0:24124:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.139@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1788746771.418780:0:24124:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff8a45ae45ea00/0xfac36e8915414745 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xfac36e891541474c expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746771.418793:0:24124:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.139@tcp lock: ffff8a45ae45ea00/0xfac36e8915414745 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xfac36e891541474c expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788746771.418801:0:24124:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8a45bc9b7000 from 1 10000000:01000000:2.0:1788746771.418827:0:24124:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788746771.418876:0:24124:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.139@tcp lock: ffff8a4581527200/0xfac36e8915414761 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746771.418884:0:24124:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.139@tcp lock: ffff8a4581527200/0xfac36e8915414761 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746771.418894:0:24124:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.139@tcp lock: ffff8a4581527200/0xfac36e8915414761 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788746771.418920:0:24124:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a4482711500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41310026-2b0a-472c-80e6-fbabf81d5070:24124:1875636324124032:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788746771.418985:0:24124:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788746771.419022:0:24124:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a4590777cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788746771.420395:0:22617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324124032 00000100:00100000:3.0:1788746771.420407:0:22617:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324124032 00000100:00100000:3.0:1788746771.420461:0:22617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788746771.420470:0:22617:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4483cdd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41310026-2b0a-472c-80e6-fbabf81d5070+19:24124:x1875636324124032:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788746771.420485:0:22617:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788746771.420499:0:22617:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a45c216c000/0xfac36e8915414768 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xfac36e8915414761 expref: -99 pid: 22617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746771.420524:0:22617:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a45c216c000/0xfac36e8915414768 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfac36e8915414761 expref: 20 pid: 22617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746771.420536:0:22617:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a45c216c000/0xfac36e8915414768 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfac36e8915414761 expref: 20 pid: 22617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746771.420566:0:22617:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a45c216c000, rc 0) 00000100:00100000:3.0:1788746771.420635:0:22617:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4483cdd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41310026-2b0a-472c-80e6-fbabf81d5070+20:24124:x1875636324124032:12345-0@lo:101:mount.lustre.0 Request processed in 166us (1648us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746771.420641:0:22617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788746771.423826:0:24124:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a4482711500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41310026-2b0a-472c-80e6-fbabf81d5070:24124:1875636324124032:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788746771.423855:0:24124:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.139@tcp lock: ffff8a4581527200/0xfac36e8915414761 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xfac36e8915414768 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746771.423883:0:24124:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.139@tcp lock: ffff8a4581527200/0xfac36e8915414761 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xfac36e8915414768 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788746771.424918:0:24124:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000040:00080000:2.0:1788746771.425190:0:24124:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788746771.425508:0:24124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:2.0:1788746771.425536:0:24124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:2.0:1788746771.425552:0:24124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:2.0:1788746771.425566:0:24124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8976 00000040:00080000:2.0:1788746771.425579:0:24124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 112 off9088 00000040:00080000:2.0:1788746771.425606:0:24124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 224 off9312 00000040:00080000:2.0:1788746771.425638:0:24124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 224 off9536 00000040:00080000:2.0:1788746771.425654:0:24124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 128 off9664 00000040:00080000:2.0:1788746771.425668:0:24124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9888 00000040:00080000:2.0:1788746771.425682:0:24124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10112 00000040:00080000:2.0:1788746771.425696:0:24124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 128 off10240 00000040:00080000:2.0:1788746771.425715:0:24124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 224 off10464 00000040:00080000:2.0:1788746771.425720:0:24124:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 12 count 13 00000100:00100000:2.0:1788746771.425794:0:24124:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a4482711500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41310026-2b0a-472c-80e6-fbabf81d5070:24124:1875636324124160:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788746771.425861:0:24124:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788746771.425917:0:22618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324124160 00000100:00100000:2.0:1788746771.425925:0:22618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324124160 00000100:00100000:2.0:1788746771.425977:0:22618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788746771.425987:0:22618:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4483cdf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41310026-2b0a-472c-80e6-fbabf81d5070+20:24124:x1875636324124160:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788746771.426082:0:22618:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4483cdf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41310026-2b0a-472c-80e6-fbabf81d5070+20:24124:x1875636324124160:12345-0@lo:501:mount.lustre.0 Request processed in 97us (220us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746771.426090:0:22618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788746771.426136:0:24124:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a4590777840 going to sleep for 11 seconds 00000100:00100000:2.0:1788746771.426163:0:24124:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a4482711500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41310026-2b0a-472c-80e6-fbabf81d5070:24124:1875636324124160:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788746771.426190:0:24124:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a4482711500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41310026-2b0a-472c-80e6-fbabf81d5070:24124:1875636324124288:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788746771.426225:0:24124:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788746771.427225:0:22615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324124288 00000100:00100000:2.0:1788746771.427233:0:22615:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324124288 00000100:00100000:2.0:1788746771.427310:0:22615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788746771.427319:0:22615:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4483cde450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41310026-2b0a-472c-80e6-fbabf81d5070+20:24124:x1875636324124288:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788746771.427432:0:22615:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4483cde450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41310026-2b0a-472c-80e6-fbabf81d5070+20:24124:x1875636324124288:12345-0@lo:503:mount.lustre.0 Request processed in 114us (1205us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746771.427438:0:22615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788746771.427481:0:24124:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a4590777840 going to sleep for 11 seconds 00000100:00100000:2.0:1788746771.427500:0:24124:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a4482711500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41310026-2b0a-472c-80e6-fbabf81d5070:24124:1875636324124288:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788746771.427949:0:24124:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788746771.428015:0:24124:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a4482711500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41310026-2b0a-472c-80e6-fbabf81d5070:24124:1875636324124416:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788746771.428059:0:24124:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788746771.428083:0:24124:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a4590777cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788746771.428183:0:22617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324124416 00000100:00100000:1.0:1788746771.428189:0:22617:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324124416 00000100:00100000:1.0:1788746771.428217:0:22617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788746771.428225:0:22617:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4483cdc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41310026-2b0a-472c-80e6-fbabf81d5070+20:24124:x1875636324124416:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788746771.428340:0:22617:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4483cdc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41310026-2b0a-472c-80e6-fbabf81d5070+20:24124:x1875636324124416:12345-0@lo:502:mount.lustre.0 Request processed in 116us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746771.428347:0:22617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788746771.430644:0:24124:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a4482711500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41310026-2b0a-472c-80e6-fbabf81d5070:24124:1875636324124416:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788746771.430888:0:24124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:2.0:1788746771.430919:0:24124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:2.0:1788746771.430933:0:24124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:2.0:1788746771.430945:0:24124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:2.0:1788746771.430957:0:24124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000040:00080000:2.0:1788746771.430971:0:24124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:2.0:1788746771.430984:0:24124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 224 off9536 00000040:00080000:2.0:1788746771.431014:0:24124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 128 off9664 00000040:00080000:2.0:1788746771.431029:0:24124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9888 00000040:00080000:2.0:1788746771.431052:0:24124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10112 00000040:00080000:2.0:1788746771.431067:0:24124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 128 off10240 00000100:00100000:2.0:1788746771.431105:0:24124:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a4482711500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41310026-2b0a-472c-80e6-fbabf81d5070:24124:1875636324124544:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788746771.434556:0:24124:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788746771.434636:0:24124:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a4590777cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788746771.434967:0:22617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324124544 00000100:00100000:1.0:1788746771.434978:0:22617:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324124544 00000100:00100000:1.0:1788746771.435045:0:22617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788746771.435055:0:22617:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4483cdec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41310026-2b0a-472c-80e6-fbabf81d5070+20:24124:x1875636324124544:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788746771.435231:0:22617:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4483cdec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41310026-2b0a-472c-80e6-fbabf81d5070+20:24124:x1875636324124544:12345-0@lo:502:mount.lustre.0 Request processed in 177us (686us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746771.435239:0:22617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788746771.435499:0:24124:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a4482711500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41310026-2b0a-472c-80e6-fbabf81d5070:24124:1875636324124544:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788746771.435600:0:24124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 224 off10464 00000040:00080000:3.0:1788746771.435627:0:24124:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:2.0:1788746771.442855:0:24146:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788746771.442868:0:24146:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788746771.442881:0:24146:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788746771.442890:0:24146:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8a45bc9b7000 00000020:00000080:2.0:1788746771.442893:0:24146:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788746771.442899:0:24146:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788746771.442902:0:24146:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788746771.442903:0:24146:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1788746771.442905:0:24146:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788746771.442907:0:24146:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788746771.442909:0:24146:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788746771.442912:0:24146:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8a45bc9b7000 00000020:00000080:2.0:1788746771.442914:0:24146:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788746771.443412:0:24146:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788746771.443419:0:24146:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788746771.443421:0:24146:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1788746771.443423:0:24146:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788746771.443426:0:24146:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788746771.443427:0:24146:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788746771.443431:0:24146:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8a45bc9b7000 00000020:00000080:2.0:1788746771.443432:0:24146:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788746771.448490:0:24146:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788746771.448534:0:24146:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788746771.448561:0:24146:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788746771.448567:0:24146:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788746771.448572:0:24146:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788746771.448574:0:24146:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1788746771.448587:0:24146:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8a45bc9b7000 00000020:00000080:2.0:1788746771.448598:0:24146:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788746771.448695:0:24146:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788746771.448699:0:24146:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788746771.448700:0:24146:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1788746771.448709:0:24146:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 13 count 13 00000020:01000000:0.0:1788746771.451124:0:24124:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:0.0:1788746771.451175:0:24124:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.139@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788746771.451453:0:24124:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff8a4581527200/0xfac36e8915414761 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xfac36e8915414768 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746771.451468:0:24124:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.139@tcp lock: ffff8a4581527200/0xfac36e8915414761 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xfac36e8915414768 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788746771.451529:0:24124:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788746771.451532:0:24124:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8a45bc9b7000 10000000:01000000:0.0:1788746771.451534:0:24124:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8a45bc9b7000 10000000:01000000:0.0:1788746771.451538:0:24124:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788746771.451559:0:24124:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8a45bc9b7000 from 1 10000000:01000000:0.0:1788746771.451561:0:24124:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788746771.451597:0:24124:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.139@tcp lock: ffff8a44825c2e00/0xfac36e891541476f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746771.451605:0:24124:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.139@tcp lock: ffff8a44825c2e00/0xfac36e891541476f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746771.451630:0:24124:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.139@tcp lock: ffff8a44825c2e00/0xfac36e891541476f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788746771.451652:0:24124:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a4483cbf100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41310026-2b0a-472c-80e6-fbabf81d5070:24124:1875636324124672:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788746771.451715:0:24124:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746771.451762:0:24124:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a45bc98ec00 going to sleep for 11 seconds 00000100:00100000:3.0:1788746771.453639:0:22618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324124672 00000100:00100000:3.0:1788746771.453653:0:22618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324124672 00000100:00100000:1.0:1788746771.453768:0:22617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788746771.453782:0:22617:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4483cde050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41310026-2b0a-472c-80e6-fbabf81d5070+20:24124:x1875636324124672:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788746771.453798:0:22617:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788746771.453816:0:22617:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a45ae45e600/0xfac36e8915414776 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xfac36e891541476f expref: -99 pid: 22617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746771.453844:0:22617:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a45ae45e600/0xfac36e8915414776 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfac36e891541476f expref: 21 pid: 22617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746771.453854:0:22617:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a45ae45e600/0xfac36e8915414776 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfac36e891541476f expref: 21 pid: 22617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746771.453939:0:22617:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a45ae45e600, rc 0) 00000100:00100000:1.0:1788746771.454006:0:22617:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4483cde050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41310026-2b0a-472c-80e6-fbabf81d5070+21:24124:x1875636324124672:12345-0@lo:101:mount.lustre.0 Request processed in 228us (2289us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746771.454013:0:22617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788746771.456648:0:24124:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a4483cbf100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41310026-2b0a-472c-80e6-fbabf81d5070:24124:1875636324124672:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788746771.456679:0:24124:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.139@tcp lock: ffff8a44825c2e00/0xfac36e891541476f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xfac36e8915414776 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746771.456694:0:24124:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.139@tcp lock: ffff8a44825c2e00/0xfac36e891541476f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xfac36e8915414776 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788746771.464861:0:24124:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000040:00080000:0.0:1788746771.465225:0:24124:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788746771.483169:0:24124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:0.0:1788746771.483215:0:24124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 120 off8536 00000040:00080000:0.0:1788746771.483231:0:24124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 168 off8704 00000040:00080000:0.0:1788746771.483246:0:24124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8928 00000040:00080000:0.0:1788746771.483260:0:24124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 224 off9152 00000040:00080000:0.0:1788746771.483274:0:24124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 120 off9272 00000040:00080000:0.0:1788746771.483362:0:24124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 168 off9440 00000040:00080000:0.0:1788746771.483391:0:24124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 224 off9664 00000040:00080000:0.0:1788746771.483405:0:24124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:0.0:1788746771.483418:0:24124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 120 off10008 00000040:00080000:0.0:1788746771.483431:0:24124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 224 off10232 00000040:00080000:0.0:1788746771.483445:0:24124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10456 00000040:00080000:0.0:1788746771.483475:0:24124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].13, 88 off10544 00000040:00080000:0.0:1788746771.483490:0:24124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].14, 128 off10672 00000040:00080000:0.0:1788746771.483503:0:24124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].15, 144 off10816 00000040:00080000:0.0:1788746771.483517:0:24124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].16, 160 off10976 00000040:00080000:0.0:1788746771.483530:0:24124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].17, 224 off11200 00000040:00080000:0.0:1788746771.483884:0:24124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].18, 224 off11424 00000040:00080000:0.0:1788746771.483908:0:24124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].19, 80 off11504 00000040:00080000:0.0:1788746771.483924:0:24124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].20, 224 off11728 00000040:00080000:0.0:1788746771.483940:0:24124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].21, 224 off11952 00000040:00080000:0.0:1788746771.483955:0:24124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].22, 88 off12040 00000040:00080000:0.0:1788746771.483967:0:24124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].23, 128 off12168 00000040:00080000:0.0:1788746771.483981:0:24124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].24, 144 off12312 00000040:00080000:0.0:1788746771.483994:0:24124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].25, 160 off12472 00000040:00080000:0.0:1788746771.484007:0:24124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].26, 224 off12696 00000040:00080000:0.0:1788746771.484020:0:24124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].27, 224 off12920 00000040:00080000:0.0:1788746771.484749:0:24124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].28, 80 off13000 00000040:00080000:0.0:1788746771.484792:0:24124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].29, 224 off13224 00000040:00080000:0.0:1788746771.484810:0:24124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].30, 224 off13448 00000040:00080000:0.0:1788746771.484822:0:24124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].31, 88 off13536 00000040:00080000:0.0:1788746771.484834:0:24124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].32, 128 off13664 00000040:00080000:0.0:1788746771.484847:0:24124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].33, 144 off13808 00000040:00080000:0.0:1788746771.484860:0:24124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].34, 128 off13936 00000040:00080000:0.0:1788746771.484874:0:24124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].35, 224 off14160 00000040:00080000:0.0:1788746771.484887:0:24124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].36, 224 off14384 00000040:00080000:0.0:1788746771.484901:0:24124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].37, 80 off14464 00000040:00080000:0.0:1788746771.484912:0:24124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].38, 224 off14688 00000040:00080000:0.0:1788746771.484925:0:24124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].39, 224 off14912 00000040:00080000:0.0:1788746771.484940:0:24124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].40, 88 off15000 00000040:00080000:0.0:1788746771.484965:0:24124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].41, 128 off15128 00000040:00080000:0.0:1788746771.484980:0:24124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].42, 144 off15272 00000040:00080000:0.0:1788746771.484993:0:24124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].43, 128 off15400 00000040:00080000:0.0:1788746771.485023:0:24124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].44, 224 off15624 00000040:00080000:0.0:1788746771.485053:0:24124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].45, 224 off15848 00000040:00080000:0.0:1788746771.485138:0:24124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].46, 80 off15928 00000040:00080000:0.0:1788746771.485150:0:24124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].47, 224 off16152 00000040:00080000:0.0:1788746771.485161:0:24124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].48, 232 off16384 00000040:00080000:0.0:1788746771.485315:0:24124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].49, 224 off16608 00000040:00080000:0.0:1788746771.485335:0:24124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].50, 120 off16728 00000040:00080000:0.0:1788746771.485349:0:24124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].51, 224 off16952 00000040:00080000:0.0:1788746771.485354:0:24124:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 51 count 51 00000100:00100000:0.0:1788746771.485889:0:24124:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a4483cbf100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41310026-2b0a-472c-80e6-fbabf81d5070:24124:1875636324124800:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788746771.485958:0:24124:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746771.486049:0:24124:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a4583ddcf00 going to sleep for 11 seconds 00000100:00100000:2.0:1788746771.488954:0:22615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324124800 00000100:00100000:2.0:1788746771.488968:0:22615:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324124800 00000100:00100000:2.0:1788746771.489029:0:22615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788746771.489180:0:22615:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4483cdf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41310026-2b0a-472c-80e6-fbabf81d5070+21:24124:x1875636324124800:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788746771.489516:0:22615:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4483cdf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41310026-2b0a-472c-80e6-fbabf81d5070+21:24124:x1875636324124800:12345-0@lo:501:mount.lustre.0 Request processed in 478us (3558us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746771.489524:0:22615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788746771.491524:0:24124:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a4483cbf100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41310026-2b0a-472c-80e6-fbabf81d5070:24124:1875636324124800:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788746771.495006:0:24124:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a4483cbf100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41310026-2b0a-472c-80e6-fbabf81d5070:24124:1875636324124928:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788746771.495692:0:24124:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746771.495743:0:24124:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a4583ddcf00 going to sleep for 11 seconds 00000100:00100000:2.0:1788746771.495795:0:22617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324124928 00000100:00100000:2.0:1788746771.495805:0:22617:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324124928 00000100:00100000:2.0:1788746771.495860:0:22617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788746771.495870:0:22617:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4483cdc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41310026-2b0a-472c-80e6-fbabf81d5070+21:24124:x1875636324124928:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788746771.495989:0:22617:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4483cdc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41310026-2b0a-472c-80e6-fbabf81d5070+21:24124:x1875636324124928:12345-0@lo:503:mount.lustre.0 Request processed in 119us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746771.495997:0:22617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788746771.496390:0:24124:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a4483cbf100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41310026-2b0a-472c-80e6-fbabf81d5070:24124:1875636324124928:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788746771.496859:0:24124:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788746771.496940:0:24124:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a4483cbf100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41310026-2b0a-472c-80e6-fbabf81d5070:24124:1875636324125056:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788746771.496989:0:24124:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746771.497012:0:24124:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a4583ddcf00 going to sleep for 11 seconds 00000100:00100000:2.0:1788746771.497182:0:22618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324125056 00000100:00100000:2.0:1788746771.497188:0:22618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324125056 00000100:00100000:2.0:1788746771.497216:0:22618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788746771.497222:0:22618:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4585541850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41310026-2b0a-472c-80e6-fbabf81d5070+21:24124:x1875636324125056:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788746771.497336:0:22618:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4585541850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41310026-2b0a-472c-80e6-fbabf81d5070+21:24124:x1875636324125056:12345-0@lo:502:mount.lustre.0 Request processed in 112us (345us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746771.497343:0:22618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1788746771.497443:0:24124:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a4483cbf100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41310026-2b0a-472c-80e6-fbabf81d5070:24124:1875636324125056:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788746771.497942:0:24124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:0.0:1788746771.497968:0:24124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 120 off8536 00000040:00080000:0.0:1788746771.497992:0:24124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 168 off8704 00000040:00080000:0.0:1788746771.498007:0:24124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8928 00000040:00080000:0.0:1788746771.498019:0:24124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 224 off9152 00000040:00080000:0.0:1788746771.498031:0:24124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 120 off9272 00000040:00080000:0.0:1788746771.498318:0:24124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 168 off9440 00000040:00080000:0.0:1788746771.498340:0:24124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 224 off9664 00000040:00080000:0.0:1788746771.498355:0:24124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:0.0:1788746771.498369:0:24124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 120 off10008 00000040:00080000:0.0:1788746771.498383:0:24124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 224 off10232 00000040:00080000:0.0:1788746771.498397:0:24124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10456 00000040:00080000:0.0:1788746771.498410:0:24124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].13, 88 off10544 00000040:00080000:0.0:1788746771.498426:0:24124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].14, 128 off10672 00000040:00080000:0.0:1788746771.498440:0:24124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].15, 144 off10816 00000040:00080000:0.0:1788746771.498455:0:24124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].16, 160 off10976 00000040:00080000:0.0:1788746771.498468:0:24124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].17, 224 off11200 00000040:00080000:0.0:1788746771.498481:0:24124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].18, 224 off11424 00000040:00080000:0.0:1788746771.498495:0:24124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].19, 80 off11504 00000040:00080000:0.0:1788746771.498510:0:24124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].20, 224 off11728 00000040:00080000:0.0:1788746771.498524:0:24124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].21, 224 off11952 00000040:00080000:0.0:1788746771.498550:0:24124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].22, 88 off12040 00000040:00080000:0.0:1788746771.498582:0:24124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].23, 128 off12168 00000040:00080000:0.0:1788746771.498599:0:24124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].24, 144 off12312 00000040:00080000:0.0:1788746771.498624:0:24124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].25, 160 off12472 00000040:00080000:0.0:1788746771.498642:0:24124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].26, 224 off12696 00000040:00080000:0.0:1788746771.498656:0:24124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].27, 224 off12920 00000040:00080000:0.0:1788746771.498671:0:24124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].28, 80 off13000 00000040:00080000:0.0:1788746771.498685:0:24124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].29, 224 off13224 00000040:00080000:0.0:1788746771.498700:0:24124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].30, 224 off13448 00000040:00080000:0.0:1788746771.498714:0:24124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].31, 88 off13536 00000040:00080000:0.0:1788746771.498727:0:24124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].32, 128 off13664 00000040:00080000:0.0:1788746771.498741:0:24124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].33, 144 off13808 00000040:00080000:0.0:1788746771.498755:0:24124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].34, 128 off13936 00000040:00080000:0.0:1788746771.498767:0:24124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].35, 224 off14160 00000040:00080000:0.0:1788746771.498792:0:24124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].36, 224 off14384 00000040:00080000:0.0:1788746771.498807:0:24124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].37, 80 off14464 00000040:00080000:0.0:1788746771.498821:0:24124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].38, 224 off14688 00000040:00080000:0.0:1788746771.498849:0:24124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].39, 224 off14912 00000040:00080000:0.0:1788746771.498865:0:24124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].40, 88 off15000 00000040:00080000:0.0:1788746771.498878:0:24124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].41, 128 off15128 00000040:00080000:0.0:1788746771.498892:0:24124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].42, 144 off15272 00000040:00080000:0.0:1788746771.498907:0:24124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].43, 128 off15400 00000040:00080000:0.0:1788746771.498922:0:24124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].44, 224 off15624 00000040:00080000:0.0:1788746771.498935:0:24124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].45, 224 off15848 00000040:00080000:0.0:1788746771.498946:0:24124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].46, 80 off15928 00000040:00080000:0.0:1788746771.498960:0:24124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].47, 224 off16152 00000040:00080000:0.0:1788746771.498972:0:24124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].48, 232 off16384 00000100:00100000:0.0:1788746771.499022:0:24124:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a4483cbf100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41310026-2b0a-472c-80e6-fbabf81d5070:24124:1875636324125184:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788746771.499213:0:24124:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746771.499259:0:24124:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a4583ddcf00 going to sleep for 11 seconds 00000100:00100000:1.0:1788746771.501147:0:22615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324125184 00000100:00100000:1.0:1788746771.501161:0:22615:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324125184 00000100:00100000:1.0:1788746771.501226:0:22615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788746771.501236:0:22615:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4585543450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41310026-2b0a-472c-80e6-fbabf81d5070+21:24124:x1875636324125184:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788746771.501446:0:22615:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4585543450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41310026-2b0a-472c-80e6-fbabf81d5070+21:24124:x1875636324125184:12345-0@lo:502:mount.lustre.0 Request processed in 211us (2232us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746771.501454:0:22615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788746771.501667:0:24124:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a4483cbf100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41310026-2b0a-472c-80e6-fbabf81d5070:24124:1875636324125184:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788746771.501879:0:24124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].49, 224 off16608 00000040:00080000:0.0:1788746771.501906:0:24124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].50, 120 off16728 00000100:00100000:0.0:1788746771.501940:0:24124:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a4483cbf100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41310026-2b0a-472c-80e6-fbabf81d5070:24124:1875636324125312:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788746771.501982:0:24124:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746771.502023:0:24124:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a4583ddcf00 going to sleep for 11 seconds 00000100:00100000:3.0:1788746771.502565:0:22617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324125312 00000100:00100000:3.0:1788746771.502573:0:22617:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324125312 00000100:00100000:3.0:1788746771.502608:0:22617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788746771.502626:0:22617:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4585542050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41310026-2b0a-472c-80e6-fbabf81d5070+21:24124:x1875636324125312:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788746771.502741:0:22617:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4585542050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41310026-2b0a-472c-80e6-fbabf81d5070+21:24124:x1875636324125312:12345-0@lo:502:mount.lustre.0 Request processed in 126us (757us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746771.502748:0:22617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788746771.502780:0:24124:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a4483cbf100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41310026-2b0a-472c-80e6-fbabf81d5070:24124:1875636324125312:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788746771.502827:0:24124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].51, 224 off16952 00000040:00080000:0.0:1788746771.502835:0:24124:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:3.0:1788746771.504935:0:24152:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1788746771.504955:0:24152:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff8a45c0d98000) 00000020:00000080:3.0:1788746771.504983:0:24152:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type lwp with refcount 2 00000020:01000004:3.0:1788746771.505076:0:24152:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8a45bc9b7000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788746771.505081:0:24152:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8a45bc9b7000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788746771.505083:0:24152:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8a45bc9b7000 3 00010000:00080000:3.0:1788746771.505114:0:24152:0:(ldlm_lib.c:103:import_set_conn()) imp ffff8a4483122800@lustre-MDT0000-lwp-OST0000: add connection 192.168.204.139@tcp at head 00010000:00010000:3.0:1788746771.509178:0:24152:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-9 is initialized 00000020:00000080:3.0:1788746771.510642:0:24152:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:3.0:1788746771.510981:0:24152:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788746771.511003:0:24152:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xfac36e8915414784 00000100:00080000:3.0:1788746771.511014:0:24152:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788746771.511024:0:24152:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8a4483122800 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:3.0:1788746771.511060:0:24152:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a45bca91500 x1875636324125440/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788746771.511089:0:24152:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788746771.511131:0:14946:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788746771.511135:0:14946:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788746771.511138:0:14946:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788746771.511141:0:14946:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788746771.511164:0:14946:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788746771.511166:0:14946:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788746771.511169:0:14946:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788746771.511172:0:14946:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788746771.511202:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a45bca92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875636324125952:0@lo:400:kworker.0 00000100:00100000:1.0:1788746771.511984:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a45bca91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3642:1875636324125440:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788746771.513756:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a45bca90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875636324125696:0@lo:400:kworker.0 00000100:00100000:1.0:1788746771.513946:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746771.514025:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a45bca91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875636324125568:0@lo:400:kworker.0 00000100:00100000:1.0:1788746771.514055:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746771.514096:0:22625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324125440 00000100:00100000:1.0:1788746771.514105:0:22625:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324125440 00000100:00100000:1.0:1788746771.514147:0:22625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788746771.514156:0:22625:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a45b7ef2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3642:x1875636324125440:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1788746771.514188:0:22625:0:(ldlm_lib.c:1456:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 701 last 0 00000020:00000080:1.0:1788746771.514227:0:22625:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xfac36e891541478b 00000004:00100000:1.0:1788746771.514243:0:22625:0:(mdt_handler.c:7495:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788746771.515684:0:22625:0:(import.c:65:import_set_state_nolock()) ffff8a45a0cd5800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788746771.515798:0:22625:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a45b7ef2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1875636324125440:12345-0@lo:38:llog_process_th.0 Request processed in 1638us (1849us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746771.515818:0:22625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1788746771.515829:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8a45bca91500 x1875636324125440/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788746781 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788746771.515851:0:3642:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00100000:1.0:1788746771.515855:0:22628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324125568 00000100:00080000:2.0:1788746771.515859:0:3642:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 3 00000100:00080000:2.0:1788746771.515867:0:3642:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1788746771.515872:0:3642:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788746771.515874:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8a4483122800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788746771.515881:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a45bca91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3642:1875636324125440:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788746771.516087:0:22628:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324125568 00000100:00100000:1.0:1788746771.516134:0:22628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788746771.516142:0:22628:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a45b7ef1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875636324125568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788746771.516189:0:22628:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a45b7ef1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875636324125568:12345-0@lo:400:kworker.0 Request processed in 48us (2132us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746771.516195:0:22628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788746771.516229:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a45bca91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875636324125568:0@lo:400:kworker.0 00000100:00100000:1.0:1788746771.517004:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a45bca91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875636324125824:0@lo:400:kworker.0 00000100:00100000:1.0:1788746771.517049:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788746771.517124:0:22629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324125824 00000100:00100000:2.0:1788746771.517130:0:22629:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324125824 00000100:00100000:2.0:1788746771.517167:0:22629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788746771.517176:0:22629:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a45b7ef2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875636324125824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788746771.517219:0:22629:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a45b7ef2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875636324125824:12345-0@lo:400:kworker.0 Request processed in 45us (170us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746771.517226:0:22629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788746771.517714:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a45bca91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875636324125824:0@lo:400:kworker.0 00000100:00100000:3.0:1788746771.518069:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788746771.518160:0:22624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324125952 00000100:00100000:2.0:1788746771.518166:0:22624:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324125952 00000100:00100000:2.0:1788746771.518204:0:22624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788746771.518211:0:22624:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a45bca92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875636324125952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788746771.518257:0:22624:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a45bca92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875636324125952:12345-0@lo:400:kworker.0 Request processed in 46us (188us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746771.518263:0:22624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:2.0:1788746771.518332:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8a45bca92300 x1875636324125952/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788746787 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788746771.518344:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a45bca92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875636324125952:0@lo:400:kworker.0 00000020:01000004:3.0:1788746771.519230:0:24152:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1788746771.519247:0:24152:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff8a45c0d999c0) 00000020:00000080:3.0:1788746771.519729:0:24152:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type lwp with refcount 2 00000020:01000004:3.0:1788746771.519835:0:24152:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8a45bc9b7000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788746771.519839:0:24152:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8a45bc9b7000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788746771.519842:0:24152:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8a45bc9b7000 3 00000100:00100000:0.0:1788746771.520023:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746771.520361:0:22623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324125696 00000100:00100000:1.0:1788746771.520369:0:22623:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324125696 00000100:00100000:1.0:1788746771.520579:0:22623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788746771.520590:0:22623:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4483cbf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875636324125696:12345-0@lo:400:kworker.0 00010000:00080000:2.0:1788746771.520610:0:24152:0:(ldlm_lib.c:103:import_set_conn()) imp ffff8a45b49b2000@lustre-MDT0001-lwp-OST0000: add connection 192.168.204.139@tcp at head 00000100:00100000:1.0:1788746771.520659:0:22623:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4483cbf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875636324125696:12345-0@lo:400:kworker.0 Request processed in 71us (637us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746771.520666:0:22623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:1.0:1788746771.520701:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8a45bca90380 x1875636324125696/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788746787 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788746771.520714:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a45bca90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875636324125696:0@lo:400:kworker.0 00010000:00010000:2.0:1788746771.524161:0:24152:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-10 is initialized 00000020:00000080:0.0:1788746771.527213:0:24152:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:0.0:1788746771.527274:0:24152:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788746771.527312:0:24152:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0xfac36e8915414799 00000100:00080000:0.0:1788746771.527325:0:24152:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788746771.527338:0:24152:0:(import.c:666:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff8a45b49b2000 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:2.0:1788746771.529366:0:24152:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a4483cbc380 x1875636324126080/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788746771.529398:0:24152:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00100000:1.0:1788746771.529517:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a4483cbc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3642:1875636324126080:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788746771.529596:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788746771.529787:0:14946:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788746771.529792:0:14946:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788746771.529800:0:14946:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788746771.529803:0:14946:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788746771.529806:0:14946:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788746771.529810:0:14946:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788746771.529812:0:14946:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788746771.529815:0:14946:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788746771.529938:0:22625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324126080 00000100:00100000:2.0:1788746771.529947:0:22625:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324126080 00000100:00100000:2.0:1788746771.529984:0:22625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788746771.529992:0:22625:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a45b7ef3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3642:x1875636324126080:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1788746771.530023:0:22625:0:(ldlm_lib.c:1456:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 701 last 0 00000020:00000080:2.0:1788746771.530562:0:22625:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0xfac36e89154147a0 00000004:00100000:2.0:1788746771.530581:0:22625:0:(mdt_handler.c:7495:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788746771.530633:0:22625:0:(import.c:65:import_set_state_nolock()) ffff8a45b0c99000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788746771.530703:0:22625:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a45b7ef3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1875636324126080:12345-0@lo:38:llog_process_th.0 Request processed in 710us (1106us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746771.530711:0:22625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1788746771.530835:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8a4483cbc380 x1875636324126080/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788746781 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788746771.530846:0:3642:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788746771.530854:0:3642:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 3 00000100:00080000:3.0:1788746771.530861:0:3642:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1788746771.530866:0:3642:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1788746771.530869:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8a45b49b2000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788746771.530875:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a4483cbc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3642:1875636324126080:0@lo:38:llog_process_th.0 00000040:00080000:3.0:1788746771.531866:0:24152:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 52 count 51 00000020:01000000:1.0:1788746771.532362:0:24124:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:1.0:1788746771.532405:0:24124:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.139@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788746771.532424:0:24124:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff8a44825c2e00/0xfac36e891541476f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xfac36e8915414776 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746771.532436:0:24124:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.139@tcp lock: ffff8a44825c2e00/0xfac36e891541476f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xfac36e8915414776 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788746771.532488:0:24124:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788746771.532490:0:24124:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788746771.532491:0:24124:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788746771.532492:0:24124:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788746771.532493:0:24124:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788746771.532495:0:24124:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788746771.532496:0:24124:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788746771.532498:0:24124:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788746771.532499:0:24124:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788746771.532503:0:24124:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:1.0:1788746771.532505:0:24124:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788746771.532506:0:24124:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788746771.532507:0:24124:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788746771.532508:0:24124:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788746771.532509:0:24124:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788746771.532511:0:24124:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788746771.532511:0:24124:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788746771.532512:0:24124:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788746771.532513:0:24124:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788746771.532535:0:24124:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1788746771.532552:0:24124:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a45b7ef2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41310026-2b0a-472c-80e6-fbabf81d5070:24124:1875636324126208:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788746771.532624:0:24124:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746771.532656:0:24124:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a45bcbca000 going to sleep for 11 seconds 00000100:00100000:3.0:1788746771.532963:0:22618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324126208 00000100:00100000:3.0:1788746771.532970:0:22618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324126208 00000100:00100000:3.0:1788746771.533018:0:22618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788746771.533027:0:22618:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4585543850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41310026-2b0a-472c-80e6-fbabf81d5070+21:24124:x1875636324126208:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788746771.533052:0:22618:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1788746771.533067:0:22618:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1788746771.537953:0:22618:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788746771.537975:0:22618:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:1.0:1788746771.538079:0:22639:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788746771.538085:0:22639:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788746771.538109:0:22639:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a45ae45e200/0xfac36e89154147a7 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746771.538138:0:22639:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a45ae45e000/0xfac36e89154146f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfac36e89154146ea expref: 21 pid: 22618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746771.538145:0:22639:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a45ae45f200/0xfac36e89154146ff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfac36e89154146f8 expref: 21 pid: 22615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746771.538151:0:22639:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a45ae45e200/0xfac36e89154147a7 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746771.538193:0:22639:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a45ae45f200/0xfac36e89154146ff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xfac36e89154146f8 expref: 21 pid: 22615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746771.538209:0:22639:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a45ae45f200/0xfac36e89154146ff lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xfac36e89154146f8 expref: 21 pid: 22615 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788746771.538225:0:22639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a45b7ef0700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22639:1875636324126336:0@lo:104: 00000100:00100000:3.0:1788746771.538785:0:22618:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4585543850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41310026-2b0a-472c-80e6-fbabf81d5070+21:24124:x1875636324126208:12345-0@lo:253:mount.lustre.0 Request processed in 5756us (6166us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746771.538803:0:22618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1788746771.539066:0:22639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746771.539132:0:24124:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a45b7ef2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41310026-2b0a-472c-80e6-fbabf81d5070:24124:1875636324126208:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788746771.539147:0:24124:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1788746771.539150:0:24124:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788746771.539152:0:24124:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788746771.539154:0:24124:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788746771.539155:0:24124:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788746771.539156:0:24124:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788746771.539157:0:24124:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788746771.539159:0:24124:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788746771.539161:0:24124:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788746771.539162:0:24124:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788746771.539176:0:24124:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:3.0:1788746771.539506:0:22607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324126336 00000100:00100000:3.0:1788746771.539514:0:22607:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324126336 00000100:00100000:3.0:1788746771.539551:0:22607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788746771.539560:0:22607:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a45b7ef1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:41310026-2b0a-472c-80e6-fbabf81d5070+3:22639:x1875636324126336:12345-0@lo:104: 00010000:00010000:3.0:1788746771.539576:0:22607:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.139@tcp lock: ffff8a4581527c00/0xfac36e89154146f8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xfac36e89154146ff expref: -99 pid: 22620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746771.539641:0:22607:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788746771.539646:0:22607:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a45b7ef1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:41310026-2b0a-472c-80e6-fbabf81d5070+3:22639:x1875636324126336:12345-0@lo:104: Request processed in 89us (582us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746771.539654:0:22607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:3.0:1788746771.539676:0:22612:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788746771.539682:0:22612:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.139@tcp lock: ffff8a4581527c00/0xfac36e89154146f8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xfac36e89154146ff expref: -99 pid: 22620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746771.539690:0:22612:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a4581527c00 already unused, calling callback (ffffffffc1180c20) 10000000:00010000:3.0:1788746771.539694:0:22612:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.139@tcp lock: ffff8a4581527c00/0xfac36e89154146f8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xfac36e89154146ff expref: -99 pid: 22620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746771.539702:0:22612:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.139@tcp lock: ffff8a4581527c00/0xfac36e89154146f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xfac36e89154146ff expref: -99 pid: 22620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788746771.539709:0:22612:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.139@tcp lock: ffff8a4581527c00/0xfac36e89154146f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xfac36e89154146ff expref: -99 pid: 22620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788746771.539716:0:22612:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788746771.539744:0:22612:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.139@tcp lock: ffff8a4581527c00/0xfac36e89154146f8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfac36e89154146ff expref: -99 pid: 22620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746771.539760:0:22612:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788746771.539782:0:22612:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.139@tcp lock: ffff8a4581527c00/0xfac36e89154146f8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfac36e89154146ff expref: -99 pid: 22620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746771.539789:0:22612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.139@tcp lock: ffff8a4581527c00/0xfac36e89154146f8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfac36e89154146ff expref: -99 pid: 22620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746771.539799:0:22612:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788746771.539801:0:22612:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788746771.539803:0:22612:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788746771.539815:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a45bca90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:41310026-2b0a-472c-80e6-fbabf81d5070:3646:1875636324126464:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788746771.539847:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788746771.540048:0:22639:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a45ae45e000/0xfac36e89154146f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xfac36e89154146ea expref: 20 pid: 22618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746771.540060:0:22639:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a45ae45e000/0xfac36e89154146f1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xfac36e89154146ea expref: 20 pid: 22618 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788746771.540070:0:22639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a45b7ef2680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22639:1875636324126592:0@lo:104: 00000100:00100000:1.0:1788746771.540099:0:22639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746771.540115:0:22639:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a45bcbca300 going to sleep for 11 seconds 00000100:00100000:1.0:1788746771.540127:0:22639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a45b7ef0700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22639:1875636324126336:0@lo:104: 00000100:00100000:3.0:1788746771.540827:0:22610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324126464 00000100:00100000:3.0:1788746771.540832:0:22610:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324126464 00010000:00010000:3.0:1788746771.540854:0:22610:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a45ae45f200/0xfac36e89154146ff lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfac36e89154146f8 expref: 21 pid: 22615 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788746771.540886:0:22610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788746771.540893:0:22610:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a45bca92300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41310026-2b0a-472c-80e6-fbabf81d5070+21:3646:x1875636324126464:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788746771.540905:0:22610:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788746771.540910:0:22610:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a45ae45f200/0xfac36e89154146ff lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfac36e89154146f8 expref: 21 pid: 22615 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746771.540920:0:22610:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a45ae45f200/0xfac36e89154146ff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xfac36e89154146f8 expref: 21 pid: 22615 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746771.540934:0:22610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a45ae45f200/0xfac36e89154146ff lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xfac36e89154146f8 expref: 21 pid: 22615 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746771.540955:0:22610:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788746771.540995:0:22610:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a45bca92300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41310026-2b0a-472c-80e6-fbabf81d5070+20:3646:x1875636324126464:12345-0@lo:103:ldlm_bl.0 Request processed in 103us (1148us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746771.541002:0:22610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788746771.541426:0:22607:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1788746771.541440:0:22607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324126592 00000100:00100000:0.0:1788746771.541444:0:22607:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324126592 00000100:00100000:0.0:1788746771.541476:0:22607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788746771.541483:0:22607:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a45bdc6f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:41310026-2b0a-472c-80e6-fbabf81d5070+3:22639:x1875636324126592:12345-0@lo:104: 00010000:00010000:0.0:1788746771.541495:0:22607:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.139@tcp lock: ffff8a44825c2400/0xfac36e89154146ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xfac36e89154146f1 expref: -99 pid: 22620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746771.541542:0:22607:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788746771.541547:0:22607:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a45bdc6f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:41310026-2b0a-472c-80e6-fbabf81d5070+3:22639:x1875636324126592:12345-0@lo:104: Request processed in 65us (1448us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746771.541553:0:22607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788746771.541762:0:22639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a45b7ef2680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22639:1875636324126592:0@lo:104: 00010000:00010000:1.0:1788746771.541791:0:22639:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a45ae45e200/0xfac36e89154147a7 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746771.543575:0:22611:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788746771.543586:0:22611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.139@tcp lock: ffff8a44825c2400/0xfac36e89154146ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xfac36e89154146f1 expref: -99 pid: 22620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746771.543596:0:22611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a44825c2400 already unused, calling callback (ffffffffc1180c20) 10000000:00010000:3.0:1788746771.543600:0:22611:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.139@tcp lock: ffff8a44825c2400/0xfac36e89154146ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xfac36e89154146f1 expref: -99 pid: 22620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746771.543609:0:22611:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.139@tcp lock: ffff8a44825c2400/0xfac36e89154146ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xfac36e89154146f1 expref: -99 pid: 22620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788746771.543626:0:22611:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.139@tcp lock: ffff8a44825c2400/0xfac36e89154146ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xfac36e89154146f1 expref: -99 pid: 22620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788746771.543632:0:22611:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788746771.543716:0:22611:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.139@tcp lock: ffff8a44825c2400/0xfac36e89154146ea lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfac36e89154146f1 expref: -99 pid: 22620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746771.543723:0:22611:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788746771.543756:0:22611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.139@tcp lock: ffff8a44825c2400/0xfac36e89154146ea lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfac36e89154146f1 expref: -99 pid: 22620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746771.543763:0:22611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.139@tcp lock: ffff8a44825c2400/0xfac36e89154146ea lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfac36e89154146f1 expref: -99 pid: 22620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746771.543798:0:22611:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788746771.543800:0:22611:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788746771.543801:0:22611:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788746771.543820:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788746771.543838:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a45bca91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:41310026-2b0a-472c-80e6-fbabf81d5070:3644:1875636324126720:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788746771.543913:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746771.543973:0:22609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324126720 00000100:00100000:3.0:1788746771.543980:0:22609:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324126720 00010000:00010000:3.0:1788746771.544004:0:22609:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a45ae45e000/0xfac36e89154146f1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfac36e89154146ea expref: 20 pid: 22618 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788746771.544031:0:22609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788746771.544038:0:22609:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4584200450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41310026-2b0a-472c-80e6-fbabf81d5070+20:3644:x1875636324126720:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788746771.544052:0:22609:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788746771.544057:0:22609:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a45ae45e000/0xfac36e89154146f1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfac36e89154146ea expref: 20 pid: 22618 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746771.544067:0:22609:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a45ae45e000/0xfac36e89154146f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xfac36e89154146ea expref: 20 pid: 22618 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746771.544081:0:22609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a45ae45e000/0xfac36e89154146f1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xfac36e89154146ea expref: 20 pid: 22618 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746771.544098:0:22609:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a45ae45e200/0xfac36e89154147a7 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746771.544107:0:22609:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a45ae45e200/0xfac36e89154147a7 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788746771.544135:0:22609:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.006588047s 00010000:00010000:3.0:1788746771.544140:0:22609:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a45ae45e200/0xfac36e89154147a7 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746771.544146:0:22609:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a45ae45e200/0xfac36e89154147a7 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746771.544152:0:22609:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a45ae45e200/0xfac36e89154147a7 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746771.544158:0:22609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a45ae45e200/0xfac36e89154147a7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746771.544164:0:22609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a45ae45e200 already unused, calling callback (ffffffffc0b5a8d0) 00010000:00010000:3.0:1788746771.544168:0:22609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a45ae45e200/0xfac36e89154147a7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746771.544175:0:22609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a45ae45e200/0xfac36e89154147a7 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746771.544190:0:22609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a45ae45e200/0xfac36e89154147a7 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746771.544200:0:22609:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788746771.544237:0:22609:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4584200450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41310026-2b0a-472c-80e6-fbabf81d5070+19:3644:x1875636324126720:12345-0@lo:103:ldlm_bl.0 Request processed in 199us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746771.544245:0:22609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788746771.544338:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a45bca90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:41310026-2b0a-472c-80e6-fbabf81d5070:3646:1875636324126464:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788746771.544362:0:22639:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a45ae45e200/0xfac36e89154147a7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746771.544376:0:22639:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a45ae45e200/0xfac36e89154147a7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746771.544382:0:22639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a45ae45e200/0xfac36e89154147a7 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788746771.544490:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a45bca91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:41310026-2b0a-472c-80e6-fbabf81d5070:3644:1875636324126720:0@lo:103:ldlm_bl.0 00000001:00000004:2.0:1788746771.549355:0:24124:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 12884901888 00002000:00080000:3.0:1788746771.555068:0:24124:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:3.0:1788746771.555076:0:24124:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:3.0:1788746771.555114:0:24124:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788746771.555169:0:24124:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.139@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788746771.555190:0:24124:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=49 00000080:00000004:3.0:1788746771.555217:0:24124:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:3.0:1788746771.556006:0:24124:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788746771.556200:0:24124:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1788746771.666738:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788746771.666762:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a45bca91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875636324126848:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788746771.666836:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746771.666886:0:23652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324126848 00000100:00100000:3.0:1788746771.666895:0:23652:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324126848 00000100:00100000:3.0:1788746771.666939:0:23652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788746771.666949:0:23652:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a45bca90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875636324126848:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788746771.666989:0:23652:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1788746771.667041:0:23652:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a45bca90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875636324126848:12345-0@lo:41:osp-pre-0-1.0 Request processed in 92us (204us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746771.667048:0:23652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788746771.667111:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a45bca91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875636324126848:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788746771.669236:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a4482712680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875636324126976:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788746771.669323:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746771.669409:0:22628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324126976 00000100:00100000:1.0:1788746771.669417:0:22628:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324126976 00000100:00100000:1.0:1788746771.669478:0:22628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788746771.669487:0:22628:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4483cbc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875636324126976:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788746771.669518:0:22628:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788746771.673343:0:22628:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4483cbc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875636324126976:12345-0@lo:41:osp-pre-1-0.0 Request processed in 3846us (4009us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746771.673358:0:22628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788746771.673648:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a4482712680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875636324126976:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1788746772.371983:0:22612:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788746772.433127:0:24205:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788746772.433587:0:24205:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 10000000:01000000:0.0:1788746773.074779:0:22620:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788746773.074788:0:22620:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8a4582bdb800 from 13 10000000:01000000:0.0:1788746773.074794:0:22620:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788746773.074849:0:22620:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.139@tcp lock: ffff8a44825c2200/0xfac36e89154147ae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746773.074861:0:22620:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.139@tcp lock: ffff8a44825c2200/0xfac36e89154147ae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746773.074872:0:22620:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.139@tcp lock: ffff8a44825c2200/0xfac36e89154147ae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788746773.074900:0:22620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a4483cbd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:41310026-2b0a-472c-80e6-fbabf81d5070:22620:1875636324127104:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788746773.074972:0:22620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746773.075027:0:22620:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a45852f2cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788746773.075040:0:22617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324127104 00000100:00100000:3.0:1788746773.075064:0:22617:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324127104 00000100:00100000:3.0:1788746773.075124:0:22617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788746773.075133:0:22617:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4585543c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41310026-2b0a-472c-80e6-fbabf81d5070+19:22620:x1875636324127104:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788746773.075146:0:22617:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788746773.075161:0:22617:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a45c216d000/0xfac36e89154147b5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xfac36e89154147ae expref: -99 pid: 22617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746773.075185:0:22617:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a45c216d000/0xfac36e89154147b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfac36e89154147ae expref: 20 pid: 22617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746773.075197:0:22617:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a45c216d000/0xfac36e89154147b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfac36e89154147ae expref: 20 pid: 22617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746773.075205:0:22617:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a45c216d000, rc 0) 00000100:00100000:3.0:1788746773.075252:0:22617:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4585543c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41310026-2b0a-472c-80e6-fbabf81d5070+20:22620:x1875636324127104:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 120us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746773.075258:0:22617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788746773.075603:0:22620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a4483cbd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:41310026-2b0a-472c-80e6-fbabf81d5070:22620:1875636324127104:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788746773.075617:0:22620:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.139@tcp lock: ffff8a44825c2200/0xfac36e89154147ae lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfac36e89154147b5 expref: -99 pid: 22620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746773.075626:0:22620:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.139@tcp lock: ffff8a44825c2200/0xfac36e89154147ae lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xfac36e89154147b5 expref: -99 pid: 22620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788746773.075679:0:22620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a4483cbd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:41310026-2b0a-472c-80e6-fbabf81d5070:22620:1875636324127232:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788746773.075714:0:22620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746773.075741:0:22620:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a45852f2cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788746773.075798:0:22618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324127232 00000100:00100000:3.0:1788746773.075803:0:22618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324127232 00000100:00100000:3.0:1788746773.075835:0:22618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788746773.075842:0:22618:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4585540850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41310026-2b0a-472c-80e6-fbabf81d5070+20:22620:x1875636324127232:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788746773.075857:0:22618:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788746773.075872:0:22618:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788746773.075875:0:22618:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 13 00000100:00100000:3.0:1788746773.075958:0:22618:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4585540850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41310026-2b0a-472c-80e6-fbabf81d5070+20:22620:x1875636324127232:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 115us (242us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746773.075965:0:22618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788746773.076066:0:22620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a4483cbd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:41310026-2b0a-472c-80e6-fbabf81d5070:22620:1875636324127232:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788746773.076119:0:22620:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.139@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788746773.076130:0:22620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff8a44825c2200/0xfac36e89154147ae lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfac36e89154147b5 expref: -99 pid: 22620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746773.076137:0:22620:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.139@tcp lock: ffff8a44825c2200/0xfac36e89154147ae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfac36e89154147b5 expref: -99 pid: 22620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788746773.076145:0:22620:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788746773.076147:0:22620:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8a45847a0000 from 13 10000000:01000000:0.0:1788746773.076150:0:22620:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788746773.076166:0:22620:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.139@tcp lock: ffff8a44825c3200/0xfac36e89154147bc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746773.076174:0:22620:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.139@tcp lock: ffff8a44825c3200/0xfac36e89154147bc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746773.076181:0:22620:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.139@tcp lock: ffff8a44825c3200/0xfac36e89154147bc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788746773.076193:0:22620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a4483cbd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:41310026-2b0a-472c-80e6-fbabf81d5070:22620:1875636324127360:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788746773.076231:0:22620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746773.076249:0:22620:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a448253cc00 going to sleep for 11 seconds 00000100:00100000:3.0:1788746773.076346:0:22617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324127360 00000100:00100000:3.0:1788746773.076351:0:22617:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324127360 00000100:00100000:3.0:1788746773.076388:0:22617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788746773.076396:0:22617:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4585542450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41310026-2b0a-472c-80e6-fbabf81d5070+20:22620:x1875636324127360:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788746773.076404:0:22617:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788746773.076413:0:22617:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a45c216d400/0xfac36e89154147c3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xfac36e89154147bc expref: -99 pid: 22617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746773.076430:0:22617:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a45c216d400/0xfac36e89154147c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfac36e89154147bc expref: 21 pid: 22617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746773.076438:0:22617:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a45c216d400/0xfac36e89154147c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfac36e89154147bc expref: 21 pid: 22617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746773.076445:0:22617:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a45c216d400, rc 0) 00000100:00100000:3.0:1788746773.076486:0:22617:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4585542450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41310026-2b0a-472c-80e6-fbabf81d5070+21:22620:x1875636324127360:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 92us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746773.076492:0:22617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788746773.076564:0:22620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a4483cbd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:41310026-2b0a-472c-80e6-fbabf81d5070:22620:1875636324127360:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788746773.076574:0:22620:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.139@tcp lock: ffff8a44825c3200/0xfac36e89154147bc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfac36e89154147c3 expref: -99 pid: 22620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746773.076592:0:22620:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.139@tcp lock: ffff8a44825c3200/0xfac36e89154147bc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xfac36e89154147c3 expref: -99 pid: 22620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788746773.076634:0:22620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a45b7ef2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:41310026-2b0a-472c-80e6-fbabf81d5070:22620:1875636324127488:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788746773.076664:0:22620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746773.076695:0:22620:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a45bcbcab40 going to sleep for 11 seconds 00000100:00100000:2.0:1788746773.076752:0:22615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324127488 00000100:00100000:2.0:1788746773.076756:0:22615:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324127488 00000100:00100000:2.0:1788746773.076789:0:22615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788746773.076796:0:22615:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4585540c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41310026-2b0a-472c-80e6-fbabf81d5070+21:22620:x1875636324127488:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788746773.076808:0:22615:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788746773.076819:0:22615:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788746773.076822:0:22615:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 13 00000100:00100000:2.0:1788746773.076897:0:22615:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4585540c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41310026-2b0a-472c-80e6-fbabf81d5070+21:22620:x1875636324127488:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 101us (230us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746773.076909:0:22615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1788746773.076984:0:22620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a45b7ef2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:41310026-2b0a-472c-80e6-fbabf81d5070:22620:1875636324127488:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788746773.077026:0:22620:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.139@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788746773.077032:0:22620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff8a44825c3200/0xfac36e89154147bc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfac36e89154147c3 expref: -99 pid: 22620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746773.077040:0:22620:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.139@tcp lock: ffff8a44825c3200/0xfac36e89154147bc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfac36e89154147c3 expref: -99 pid: 22620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746773.397709:0:22611:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788746774.419155:0:22612:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788746774.867544:0:22657:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788746775.442680:0:22611:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788746776.467749:0:22612:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788746776.786619:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a4482713800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875636324127616:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788746776.786689:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788746776.786881:0:22629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324127616 00000100:00100000:2.0:1788746776.786890:0:22629:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324127616 00000100:00100000:2.0:1788746776.786949:0:22629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788746776.786960:0:22629:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4483cbed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875636324127616:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788746776.786994:0:22629:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788746776.787045:0:22629:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4483cbed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875636324127616:12345-0@lo:41:osp-pre-1-0.0 Request processed in 86us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746776.787052:0:22629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788746776.787217:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a4482713800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875636324127616:0@lo:41:osp-pre-1-0.0 00000100:00080000:1.0:1788746776.791540:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788746776.791548:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788746776.791552:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788746776.791555:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788746776.791583:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788746776.791587:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788746776.791590:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788746776.791592:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788746776.791640:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a45b7ef0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875636324127872:0@lo:400:kworker.0 00000100:00100000:1.0:1788746776.791717:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746776.791751:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a45b7ef3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3644:1875636324128384:0@lo:400:kworker.0 00000100:00100000:1.0:1788746776.792154:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746776.792252:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1788746776.792260:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a45b7ef2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:41310026-2b0a-472c-80e6-fbabf81d5070:3644:1875636324127744:0@lo:400:kworker.0 00000100:00100000:1.0:1788746776.792321:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746776.792348:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a45b7ef0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3644:1875636324128256:0@lo:400:kworker.0 00000100:00100000:1.0:1788746776.792445:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746776.792477:0:22624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324127872 00000100:00100000:1.0:1788746776.792484:0:22624:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324127872 00000100:00100000:1.0:1788746776.792533:0:22624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324128384 00000100:00100000:1.0:1788746776.792536:0:22624:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324128384 00000100:00100000:1.0:1788746776.792572:0:22624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324128256 00000100:00100000:1.0:1788746776.792575:0:22624:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324128256 00000100:00100000:1.0:1788746776.792590:0:22624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788746776.792599:0:22624:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a45b7ef3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875636324127872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788746776.792654:0:22624:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a45b7ef3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875636324127872:12345-0@lo:400:kworker.0 Request processed in 56us (937us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746776.792661:0:22624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788746776.792678:0:22624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788746776.792684:0:22624:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a45b7ef3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875636324128384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788746776.792711:0:22624:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a45b7ef3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875636324128384:12345-0@lo:400:kworker.0 Request processed in 27us (557us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746776.792717:0:22624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788746776.792728:0:22624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788746776.792734:0:22624:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a45b7ef1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875636324128256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788746776.792760:0:22624:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a45b7ef1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875636324128256:12345-0@lo:400:kworker.0 Request processed in 27us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746776.792765:0:22624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788746776.793169:0:22615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324127744 00000100:00100000:1.0:1788746776.793175:0:22615:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324127744 00000100:00080000:3.0:1788746776.793493:0:22619:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788746776.793498:0:22619:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788746776.793876:0:22615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788746776.793886:0:22615:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4585541c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41310026-2b0a-472c-80e6-fbabf81d5070+21:3644:x1875636324127744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788746776.793939:0:22615:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4585541c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41310026-2b0a-472c-80e6-fbabf81d5070+21:3644:x1875636324127744:12345-0@lo:400:kworker.0 Request processed in 55us (1616us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746776.793945:0:22615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788746776.793987:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a45b7ef1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875636324128000:0@lo:400:kworker.0 00000100:00100000:1.0:1788746776.794017:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746776.794058:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788746776.794064:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a45b7ef2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875636324128128:0@lo:400:kworker.0 00000100:00100000:1.0:1788746776.794687:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746776.794759:0:22628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324128000 00000100:00100000:1.0:1788746776.794766:0:22628:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324128000 00000100:00100000:1.0:1788746776.794815:0:22628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788746776.794822:0:22628:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4483591500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875636324128000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788746776.794867:0:22628:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4483591500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875636324128000:12345-0@lo:400:kworker.0 Request processed in 46us (849us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746776.794873:0:22628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788746776.794910:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a45b7ef1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875636324128000:0@lo:400:kworker.0 00000100:00100000:1.0:1788746776.794942:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a45b7ef2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:41310026-2b0a-472c-80e6-fbabf81d5070:3644:1875636324127744:0@lo:400:kworker.0 00010000:00080000:1.0:1788746776.794956:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a45b7ef0e00 x1875636324128256/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788746792 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788746776.794967:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a45b7ef0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3644:1875636324128256:0@lo:400:kworker.0 00010000:00080000:1.0:1788746776.794979:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a45b7ef0700 x1875636324127872/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788746792 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788746776.794988:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a45b7ef0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875636324127872:0@lo:400:kworker.0 00010000:00080000:1.0:1788746776.794999:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a45b7ef3100 x1875636324128384/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788746792 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788746776.795006:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a45b7ef3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3644:1875636324128384:0@lo:400:kworker.0 00000100:00100000:0.0:1788746776.796563:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788746776.796583:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a4483cbe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875636324128512:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788746776.796648:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746776.796697:0:23652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324128512 00000100:00100000:0.0:1788746776.796705:0:23652:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324128512 00000100:00100000:0.0:1788746776.796764:0:23652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788746776.796784:0:23652:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4483cbca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1875636324128512:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788746776.796818:0:23652:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1788746776.796865:0:23652:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4483cbca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1875636324128512:12345-0@lo:41:osp-pre-0-1.0 Request processed in 95us (218us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746776.796872:0:23652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788746776.797013:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a4483cbe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875636324128512:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788746776.802201:0:22624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324128128 00000100:00100000:3.0:1788746776.802217:0:22624:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324128128 00000100:00100000:3.0:1788746776.802303:0:22624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788746776.802314:0:22624:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4483593100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875636324128128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788746776.802422:0:22624:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4483593100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875636324128128:12345-0@lo:400:kworker.0 Request processed in 110us (7735us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746776.802428:0:22624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:3.0:1788746776.802483:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a45b7ef2a00 x1875636324128128/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788746792 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788746776.802499:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a45b7ef2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875636324128128:0@lo:400:kworker.0 00010000:00010000:3.0:1788746777.490988:0:22611:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788746777.782630:0:24494:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg439-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1788746778.514536:0:22612:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788746778.746025:0:24548:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788746778.746597:0:24548:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000040:00080000:3.0:1788746778.900070:0:23382:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788746779.542784:0:22611:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788746779.854892:0:24598:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788746779.855196:0:24598:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788746780.562502:0:22612:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788746781.586629:0:22611:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788746781.778439:0:3642:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788746766/real 1788746766] req@ffff8a45b7ef0a80 x1875636324121856/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788746781 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788746781.778481:0:3642:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8a45b7ef0a80 x1875636324121856/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788746781 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788746781.778494:0:3642:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788746766/real 1788746766] req@ffff8a45b7ef0000 x1875636324121984/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788746781 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788746781.778508:0:3642:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8a45b7ef0000 x1875636324121984/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788746781 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788746781.778536:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8a45bfe8f000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788746781.778559:0:3642:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788746781.778564:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a45b7ef0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1875636324121856:0@lo:8:kworker.0 00000100:00080000:2.0:1788746781.778580:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8a45b7f9f000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788746781.778586:0:3642:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788746781.778590:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a45b7ef0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1875636324121984:0@lo:8:kworker.0 00000100:00080000:0.0:1788746781.779372:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788746781.779379:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788746781.779382:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788746781.779386:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788746781.779405:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788746781.779408:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1788746781.779411:0:36:0:(import.c:65:import_set_state_nolock()) ffff8a45bfe8f000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788746781.779438:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 696 00000100:00080000:0.0:1788746781.779446:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1788746781.779461:0:36:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8a45bfe8f000 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:0.0:1788746781.779488:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a45c0ea6300 x1875636324129152/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788746781.779504:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788746781.779507:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788746781.779518:0:36:0:(import.c:65:import_set_state_nolock()) ffff8a45b7f9f000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788746781.779522:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 696 00000100:00080000:0.0:1788746781.779524:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1788746781.779530:0:36:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8a45b7f9f000 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:0.0:1788746781.779544:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a45c0ea6680 x1875636324129280/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788746781.779591:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a45c0ea7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875636324129024:0@lo:400:kworker.0 00000100:00100000:0.0:1788746781.779681:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746781.779753:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788746781.779760:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a4483cbe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:41310026-2b0a-472c-80e6-fbabf81d5070:3645:1875636324128640:0@lo:400:kworker.0 00000100:00100000:0.0:1788746781.779792:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746781.779815:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a45c0ea4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875636324129408:0@lo:400:kworker.0 00000100:00100000:0.0:1788746781.779861:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746781.779890:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a4483cbd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875636324128768:0@lo:400:kworker.0 00000100:00100000:0.0:1788746781.779927:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746781.779945:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a45c0ea7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3643:1875636324129536:0@lo:400:kworker.0 00000100:00100000:2.0:1788746781.780213:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a45c0ea6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1875636324129152:0@lo:8:kworker.0 00000100:00100000:2.0:1788746781.780259:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788746781.780308:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a45c0ea6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1875636324129280:0@lo:8:kworker.0 00000100:00100000:2.0:1788746781.780336:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746781.780461:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746781.780496:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788746781.780503:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a45c0ea5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875636324128896:0@lo:400:kworker.0 00000100:00100000:0.0:1788746781.780532:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746781.782126:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a45c0ea4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3643:1875636324129664:0@lo:400:kworker.0 00000100:00100000:0.0:1788746781.782196:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788746781.784317:0:22624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324129408 00000100:00100000:2.0:1788746781.784339:0:22624:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324129408 00000100:00100000:2.0:1788746781.784864:0:22624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324129536 00000100:00100000:2.0:1788746781.784870:0:22624:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324129536 00000100:00080000:2.0:1788746781.784914:0:22619:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788746781.784935:0:22624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324128896 00000100:00100000:2.0:1788746781.784939:0:22624:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324128896 00000100:00100000:2.0:1788746781.784961:0:22624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788746781.784973:0:22624:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a45c0ea4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875636324129408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788746781.785118:0:22624:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a45c0ea4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875636324129408:12345-0@lo:400:kworker.0 Request processed in 147us (5269us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746781.785126:0:22624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788746781.785146:0:22624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788746781.785153:0:22624:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a45c0ea4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875636324129536:12345-0@lo:400:kworker.0 00010000:00080000:3.0:1788746781.787239:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a45c0ea4a80 x1875636324129408/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788746797 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788746781.787265:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a45c0ea4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875636324129408:0@lo:400:kworker.0 00000100:00100000:2.0:1788746781.787799:0:22624:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a45c0ea4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875636324129536:12345-0@lo:400:kworker.0 Request processed in 2641us (7332us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746781.787816:0:22624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788746781.787865:0:22624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788746781.787880:0:22624:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a45c0ea5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875636324128896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788746781.788018:0:22624:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a45c0ea5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875636324128896:12345-0@lo:400:kworker.0 Request processed in 145us (7487us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746781.788025:0:22624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788746781.788349:0:22628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324129024 00000100:00100000:1.0:1788746781.788361:0:22628:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324129024 00000100:00100000:1.0:1788746781.788402:0:22628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324128768 00000100:00100000:1.0:1788746781.788405:0:22628:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324128768 00000100:00100000:1.0:1788746781.788436:0:22628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788746781.788444:0:22628:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a45c0ea7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875636324129024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788746781.788505:0:22628:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a45c0ea7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875636324129024:12345-0@lo:400:kworker.0 Request processed in 63us (8825us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746781.788512:0:22628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788746781.788528:0:22628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788746781.788535:0:22628:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a45c0ea7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1875636324128768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788746781.788564:0:22628:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a45c0ea7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1875636324128768:12345-0@lo:400:kworker.0 Request processed in 30us (8637us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746781.788570:0:22628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788746781.788588:0:22618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324128640 00000100:00100000:1.0:1788746781.788592:0:22618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324128640 00000100:00100000:1.0:1788746781.788639:0:22618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788746781.788648:0:22618:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4585543050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41310026-2b0a-472c-80e6-fbabf81d5070+21:3645:x1875636324128640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788746781.788684:0:22618:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4585543050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41310026-2b0a-472c-80e6-fbabf81d5070+21:3645:x1875636324128640:12345-0@lo:400:kworker.0 Request processed in 37us (8890us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746781.788690:0:22618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788746781.788752:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a4483cbe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:41310026-2b0a-472c-80e6-fbabf81d5070:3645:1875636324128640:0@lo:400:kworker.0 00000100:00100000:1.0:1788746781.788768:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a45c0ea7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875636324129024:0@lo:400:kworker.0 00000100:00100000:1.0:1788746781.788825:0:24130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324129152 00000100:00100000:1.0:1788746781.788829:0:24130:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324129152 00000100:00100000:1.0:1788746781.788844:0:24130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324129280 00000100:00100000:1.0:1788746781.788857:0:24130:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324129280 00000100:00100000:1.0:1788746781.788868:0:24130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788746781.788872:0:24130:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4482713480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3642:x1875636324129152:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1788746781.788918:0:24130:0:(ldlm_lib.c:1456:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 711 last 0 00000020:00000080:1.0:1788746781.788957:0:24130:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xfac36e89154147ca 00002000:00100000:1.0:1788746781.789592:0:24130:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff8a45a0cd1000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:1.0:1788746781.789601:0:24130:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:1.0:1788746781.789605:0:24130:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1788746781.789861:0:24130:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:1.0:1788746781.789913:0:24130:0:(import.c:65:import_set_state_nolock()) ffff8a45a0cd5000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788746781.793678:0:24130:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4482713480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3642:x1875636324129152:12345-0@lo:8:kworker.0 Request processed in 4780us (13394us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746781.793701:0:24130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788746781.793751:0:24130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788746781.793759:0:24130:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4482711f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3642:x1875636324129280:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1788746781.793794:0:24130:0:(ldlm_lib.c:1202:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00080000:3.0:1788746781.797223:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a45c0ea6300 x1875636324129152/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788746801 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788746781.797243:0:3642:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788746781.797257:0:3642:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 3 00000100:00080000:3.0:1788746781.797269:0:3642:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1788746781.797277:0:3642:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1788746781.797280:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8a45bfe8f000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1788746781.797318:0:3642:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1788746781.797327:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a45c0ea6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1875636324129152:0@lo:8:kworker.0 00000004:00080000:3.0:1788746781.797372:0:23365:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1788746781.797520:0:23365:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 711538232659ns, next at 0ns, rc = 0 00080000:00080000:3.0:1788746781.797528:0:23365:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000004:00080000:2.0:1788746781.797897:0:23366:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:2.0:1788746781.797938:0:23366:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a4482711c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23366:1875636324129920:0@lo:7:osp-pre-0-1.0 00000100:00100000:2.0:1788746781.798191:0:23366:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788746781.798231:0:23366:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a4587ee8900 going to sleep for 11 seconds 00000100:00100000:2.0:1788746781.798262:0:24129:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1788746781.798270:0:24129:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:2.0:1788746781.798399:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788746781.798425:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a4482713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875636324129792:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788746781.798457:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788746781.798518:0:24129:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324129920 00000100:00100000:2.0:1788746781.798526:0:24129:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324129920 00000100:00080000:2.0:1788746781.798587:0:22619:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788746781.798681:0:24665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788746781.798692:0:24665:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4482710700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:23366:x1875636324129920:12345-0@lo:7:osp-pre-0-1.0 00000100:00100000:3.0:1788746781.798979:0:24133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324129792 00000100:00100000:3.0:1788746781.798985:0:24133:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324129792 00000100:00100000:3.0:1788746781.799022:0:24133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788746781.799030:0:24133:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4482712300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3646:x1875636324129792:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788746781.799052:0:24133:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788746781.799119:0:24133:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4482712300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3646:x1875636324129792:12345-0@lo:13:osp-pre-0-1.0 Request processed in 90us (661us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746781.799128:0:24133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788746781.799190:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a4482713b80 x1875636324129792/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788746797 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788746781.799211:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a4482713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875636324129792:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788746781.803779:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a4483cbd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875636324128768:0@lo:400:kworker.0 00010000:00080000:0.0:1788746781.803806:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a45c0ea7480 x1875636324129536/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788746797 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788746781.803827:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a45c0ea7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3643:1875636324129536:0@lo:400:kworker.0 00010000:00080000:0.0:1788746781.803869:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a45c0ea5f80 x1875636324128896/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788746797 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788746781.803879:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a45c0ea5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875636324128896:0@lo:400:kworker.0 00000100:00100000:3.0:1788746781.804212:0:22624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324129664 00000100:00100000:3.0:1788746781.804222:0:22624:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324129664 00000100:00100000:3.0:1788746781.804885:0:22624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788746781.804912:0:22624:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a45c0ea6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875636324129664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788746781.805056:0:22624:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a45c0ea6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875636324129664:12345-0@lo:400:kworker.0 Request processed in 160us (22860us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746781.805065:0:22624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:3.0:1788746781.805095:0:22619:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:2.0:1788746781.806034:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a45c0ea4380 x1875636324129664/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788746797 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788746781.806055:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a45c0ea4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3643:1875636324129664:0@lo:400:kworker.0 00000004:00080000:2.0:1788746781.809765:0:23357:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00002000:00080000:2.0:1788746781.812550:0:24665:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:2.0:1788746781.812566:0:24665:0:(ofd_dev.c:1210:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x41:0x0] 00000100:00100000:2.0:1788746781.812719:0:24665:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4482710700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:23366:x1875636324129920:12345-0@lo:7:osp-pre-0-1.0 Request processed in 14022us (14521us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746781.812733:0:24665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1788746781.812819:0:23366:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a4482711c00 x1875636324129920/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788746797 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788746781.814068:0:23366:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a4482711c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23366:1875636324129920:0@lo:7:osp-pre-0-1.0 00000004:00080000:2.0:1788746781.814090:0:23366:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x41:0x0] 00000100:00100000:2.0:1788746781.814146:0:23366:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a4482711c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23366:1875636324130048:0@lo:5:osp-pre-0-1.0 00000100:00100000:2.0:1788746781.814218:0:23366:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788746781.814261:0:23366:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a4587ee8900 going to sleep for 11 seconds 00000100:00100000:2.0:1788746781.814306:0:24665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324130048 00000100:00100000:2.0:1788746781.814315:0:24665:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324130048 00000100:00100000:2.0:1788746781.814380:0:24131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788746781.814391:0:24131:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4482712d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:23366:x1875636324130048:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:2.0:1788746781.814437:0:24131:0:(ofd_dev.c:1642:ofd_create_hdl()) ofd_last_id() = 65 -> diff = 0 00000100:00100000:2.0:1788746781.814482:0:24131:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4482712d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:23366:x1875636324130048:12345-0@lo:5:osp-pre-0-1.0 Request processed in 92us (263us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746781.814489:0:24131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1788746781.814530:0:23366:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a4482711c00 x1875636324130048/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788746797 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788746781.814543:0:23366:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a4482711c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23366:1875636324130048:0@lo:5:osp-pre-0-1.0 00000004:00080000:2.0:1788746781.814552:0:23366:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x41:0x0] from OST, last_created [0x280000400:0x41:0x0]last_used is [0x280000400:0x41:0x0] 00000100:00100000:2.0:1788746781.814581:0:23366:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a4482711c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23366:1875636324130176:0@lo:5:osp-pre-0-1.0 00000100:00100000:2.0:1788746781.814605:0:23366:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788746781.814619:0:23366:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a4587ee8900 going to sleep for 11 seconds 00000100:00100000:2.0:1788746781.814630:0:24131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324130176 00000100:00100000:2.0:1788746781.814633:0:24131:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324130176 00000100:00100000:2.0:1788746781.814650:0:24131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788746781.814656:0:24131:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4482713b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:23366:x1875636324130176:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:2.0:1788746781.814696:0:24131:0:(ofd_dev.c:1749:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 66 00000100:00100000:0.0:1788746781.834105:0:24130:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4482711f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3642:x1875636324129280:12345-0@lo:8:kworker.0 Request processed in 40336us (53758us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788746781.834134:0:24130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:1.0:1788746781.834685:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8a45b7f9f000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788746781.834694:0:3642:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788746781.834699:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a45c0ea6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1875636324129280:0@lo:8:kworker.0 00000001:00080000:2.0:1788746781.870520:0:24125:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901889 is committed 00000001:00100000:2.0:1788746781.870552:0:24125:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00010000:00080000:2.0:1788746781.873179:0:23366:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a4482711c00 x1875636324130176/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788746797 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788746781.873197:0:23366:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 12884901889 gen 2 00000100:00100000:2.0:1788746781.873206:0:23366:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a4482711c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23366:1875636324130176:0@lo:5:osp-pre-0-1.0 00000004:00080000:2.0:1788746781.873226:0:23366:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x41:0x0]-[0x280000400:0x61:0x0] 00000100:00100000:2.0:1788746781.873319:0:23366:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a4482711c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:23366:1875636324130304:0@lo:900:osp-pre-0-1.0 00000100:00100000:2.0:1788746781.873815:0:23366:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746781.874014:0:24131:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4482713b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:23366:x1875636324130176:12345-0@lo:5:osp-pre-0-1.0 Request processed in 59141us (59192us total) trans 12884901889 rc 0/0 00000100:00100000:0.0:1788746781.874028:0:24131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788746781.874081:0:23366:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a4587ee8900 going to sleep for 11 seconds 00000100:00100000:1.0:1788746781.874341:0:22635:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324130304 00000100:00100000:1.0:1788746781.874351:0:22635:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324130304 00000100:00100000:1.0:1788746781.874398:0:22635:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788746781.874408:0:22635:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4482713800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:23366:x1875636324130304:12345-0@lo:900:osp-pre-0-1.0 00000100:00100000:1.0:1788746781.874548:0:22635:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4482713800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:23366:x1875636324130304:12345-0@lo:900:osp-pre-0-1.0 Request processed in 141us (735us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746781.874573:0:22635:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788746781.874703:0:23366:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a4482711c00 x1875636324130304/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788746797 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788746781.874716:0:23366:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a4482711c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:23366:1875636324130304:0@lo:900:osp-pre-0-1.0 00000100:00100000:0.0:1788746781.906570:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a45c0ea5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875636324130432:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788746781.906670:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746781.907449:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a4482711c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875636324130560:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788746781.907496:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788746781.907638:0:23652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324130432 00000100:00100000:2.0:1788746781.907650:0:23652:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324130432 00000100:00100000:2.0:1788746781.907768:0:23652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324130560 00000100:00100000:2.0:1788746781.907773:0:23652:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324130560 00000100:00100000:2.0:1788746781.907792:0:23652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788746781.907802:0:23652:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a45c0ea7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1875636324130432:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788746781.907851:0:23652:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1788746781.907927:0:23652:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a45c0ea7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1875636324130432:12345-0@lo:41:osp-pre-0-1.0 Request processed in 126us (1257us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746781.907936:0:23652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788746781.907957:0:23652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788746781.907989:0:23652:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a45c0ea6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875636324130560:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788746781.908010:0:23652:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788746781.908045:0:23652:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a45c0ea6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875636324130560:12345-0@lo:41:osp-pre-1-0.0 Request processed in 57us (549us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746781.908248:0:23652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788746781.908404:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a4482711c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875636324130560:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788746781.908470:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a45c0ea5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875636324130432:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788746782.612793:0:22612:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788746783.635823:0:22611:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788746784.082932:0:22657:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788746784.659929:0:22612:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788746785.683423:0:22611:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788746786.706637:0:22612:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788746787.026476:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788746787.026497:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a45c0ea5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875636324130816:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788746787.026568:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788746787.026600:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788746787.026604:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788746787.026608:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788746787.026611:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788746787.026623:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788746787.026626:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00100000:2.0:1788746787.026629:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a4482712680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875636324130688:0@lo:41:osp-pre-1-0.0 00000100:00080000:3.0:1788746787.026630:0:36:0:(import.c:65:import_set_state_nolock()) ffff8a45b7f9f000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788746787.026635:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 711 00000100:00080000:3.0:1788746787.026640:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1788746787.026649:0:36:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8a45b7f9f000 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:2.0:1788746787.026660:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746787.026669:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a45bca91f80 x1875636324131456/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788746787.026685:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a45bca92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875636324131200:0@lo:400:kworker.0 00000100:00100000:2.0:1788746787.026708:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788746787.026730:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a448448b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3643:1875636324131840:0@lo:400:kworker.0 00000100:00100000:3.0:1788746787.026731:0:22625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324131200 00000100:00100000:3.0:1788746787.026749:0:22625:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324131200 00000100:00100000:2.0:1788746787.026750:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788746787.026765:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788746787.026770:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a45bca92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875636324131328:0@lo:400:kworker.0 00000100:00100000:3.0:1788746787.026790:0:22625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324131840 00000100:00100000:2.0:1788746787.026790:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746787.026792:0:22625:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324131840 00000100:00100000:2.0:1788746787.026815:0:23652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324130816 00000100:00100000:3.0:1788746787.026817:0:22625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788746787.026819:0:23652:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324130816 00000100:00100000:3.0:1788746787.026825:0:22625:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4482713100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875636324131200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788746787.026852:0:23652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324130688 00000100:00100000:2.0:1788746787.026855:0:23652:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324130688 00000100:00100000:3.0:1788746787.026875:0:22625:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4482713100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875636324131200:12345-0@lo:400:kworker.0 Request processed in 51us (166us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746787.026879:0:23652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788746787.026882:0:22625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788746787.026885:0:23652:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4482711180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875636324130816:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788746787.026898:0:22625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788746787.026902:0:22625:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4482711500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875636324131840:12345-0@lo:400:kworker.0 00000004:00000024:2.0:1788746787.026911:0:23652:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1788746787.026927:0:22625:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4482711500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875636324131840:12345-0@lo:400:kworker.0 Request processed in 25us (177us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746787.026933:0:22625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788746787.026944:0:23652:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4482711180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875636324130816:12345-0@lo:41:osp-pre-0-1.0 Request processed in 59us (377us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746787.026949:0:23652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:3.0:1788746787.026951:0:22619:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788746787.026964:0:23652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788746787.026970:0:23652:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4482712a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875636324130688:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788746787.026985:0:23652:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788746787.027014:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a45bca91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:41310026-2b0a-472c-80e6-fbabf81d5070:3645:1875636324130944:0@lo:400:kworker.0 00000100:00100000:2.0:1788746787.027017:0:23652:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4482712a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875636324130688:12345-0@lo:41:osp-pre-1-0.0 Request processed in 41us (349us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746787.027023:0:23652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788746787.027043:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a45bca91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1875636324131456:0@lo:8:kworker.0 00000100:00100000:0.0:1788746787.027047:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788746787.027065:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746787.027077:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a45bca91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875636324131584:0@lo:400:kworker.0 00000100:00100000:2.0:1788746787.027090:0:24665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324131328 00000100:00100000:2.0:1788746787.027094:0:24665:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324131328 00000100:00100000:0.0:1788746787.027097:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746787.027114:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788746787.027122:0:24665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324131456 00000100:00100000:2.0:1788746787.027125:0:24665:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324131456 00000100:00100000:0.0:1788746787.027127:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a45bca90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875636324131072:0@lo:400:kworker.0 00000100:00100000:2.0:1788746787.027137:0:24665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788746787.027143:0:24665:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4482711c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3643:x1875636324131328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788746787.027147:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746787.027163:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a45bca91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3645:1875636324131712:0@lo:400:kworker.0 00000100:00100000:0.0:1788746787.027182:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746787.027209:0:22629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324131072 00000100:00100000:0.0:1788746787.027213:0:22629:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324131072 00000100:00100000:0.0:1788746787.027232:0:22629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788746787.027238:0:22629:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a45c0ea4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1875636324131072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788746787.027271:0:22629:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a45c0ea4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1875636324131072:12345-0@lo:400:kworker.0 Request processed in 33us (123us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746787.027277:0:22629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788746787.027331:0:22623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324131584 00000100:00100000:0.0:1788746787.027335:0:22623:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324131584 00000100:00100000:0.0:1788746787.027350:0:22623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324131712 00000100:00100000:0.0:1788746787.027352:0:22623:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324131712 00000100:00100000:0.0:1788746787.027366:0:22623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788746787.027371:0:22623:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a45c0ea5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875636324131584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788746787.027401:0:22623:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a45c0ea5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875636324131584:12345-0@lo:400:kworker.0 Request processed in 29us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746787.027405:0:22623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788746787.027415:0:22623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788746787.027420:0:22623:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a45c0ea5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875636324131712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788746787.027441:0:22623:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a45c0ea5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875636324131712:12345-0@lo:400:kworker.0 Request processed in 21us (258us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746787.027446:0:22623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788746787.027463:0:24130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788746787.027468:0:24130:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4484469880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3642:x1875636324131456:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1788746787.027498:0:24130:0:(ldlm_lib.c:1202:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788746787.027532:0:24130:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4484469880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3642:x1875636324131456:12345-0@lo:8:kworker.0 Request processed in 62us (465us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788746787.027538:0:24130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:0.0:1788746787.027575:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8a45b7f9f000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788746787.027579:0:3642:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788746787.027583:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a45bca91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1875636324131456:0@lo:8:kworker.0 00000100:00100000:0.0:1788746787.027610:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a45bca90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875636324131072:0@lo:400:kworker.0 00010000:00080000:0.0:1788746787.027619:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a45bca91c00 x1875636324131712/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788746803 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788746787.027628:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a45bca91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3645:1875636324131712:0@lo:400:kworker.0 00010000:00080000:0.0:1788746787.027635:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a45bca91500 x1875636324131584/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788746803 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788746787.027642:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a45bca91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875636324131584:0@lo:400:kworker.0 00000100:00100000:1.0:1788746787.027747:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a45c0ea5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875636324131968:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788746787.027779:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746787.027820:0:24133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324131968 00000100:00100000:1.0:1788746787.027824:0:24133:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324131968 00000100:00100000:1.0:1788746787.027847:0:24133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788746787.027853:0:24133:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4483592a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3644:x1875636324131968:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788746787.027871:0:24133:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788746787.027905:0:24133:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4483592a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3644:x1875636324131968:12345-0@lo:13:osp-pre-0-1.0 Request processed in 52us (125us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746787.027911:0:24133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788746787.027933:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a45c0ea5500 x1875636324131968/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788746803 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788746787.027947:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a45c0ea5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875636324131968:0@lo:13:osp-pre-0-1.0 00010000:00080000:1.0:1788746787.027987:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a448448b800 x1875636324131840/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788746803 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788746787.027995:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a448448b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3643:1875636324131840:0@lo:400:kworker.0 00010000:00080000:1.0:1788746787.028005:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a45bca92680 x1875636324131200/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788746803 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788746787.028012:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a45bca92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875636324131200:0@lo:400:kworker.0 00000100:00100000:1.0:1788746787.028024:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a45c0ea5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875636324130816:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788746787.028046:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a4482712680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875636324130688:0@lo:41:osp-pre-1-0.0 00000100:00080000:1.0:1788746787.028079:0:22619:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788746787.028084:0:22619:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788746787.028155:0:22617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324130944 00000100:00100000:3.0:1788746787.028159:0:22617:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324130944 00000100:00100000:3.0:1788746787.028193:0:22617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788746787.028200:0:22617:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4585540450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41310026-2b0a-472c-80e6-fbabf81d5070+21:3645:x1875636324130944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788746787.028235:0:22617:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4585540450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41310026-2b0a-472c-80e6-fbabf81d5070+21:3645:x1875636324130944:12345-0@lo:400:kworker.0 Request processed in 36us (1187us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746787.028242:0:22617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1788746787.028309:0:24665:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4482711c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3643:x1875636324131328:12345-0@lo:400:kworker.0 Request processed in 1165us (1516us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746787.028326:0:24665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788746787.028489:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a45bca91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:41310026-2b0a-472c-80e6-fbabf81d5070:3645:1875636324130944:0@lo:400:kworker.0 00010000:00080000:3.0:1788746787.028601:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a45bca92300 x1875636324131328/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788746803 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788746787.028610:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a45bca92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875636324131328:0@lo:400:kworker.0 00000020:01000004:3.0:1788746787.497858:0:24944:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788746787.497862:0:24944:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:3.0:1788746787.497864:0:24944:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:3.0:1788746787.498016:0:24944:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8a45b49b3000 00000020:01000004:3.0:1788746787.498034:0:24944:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1788746787.498051:0:24944:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1788746787.498065:0:24944:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff8a45c0d9cd40) 00000020:00000080:3.0:1788746787.498084:0:24944:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1788746787.569233:0:24944:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1788746787.579633:0:24944:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1788746787.581175:0:24944:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1788746787.581530:0:24944:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:2.0:1788746787.581845:0:24944:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1788746787.582117:0:24944:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:2.0:1788746787.582475:0:24944:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:01000000:2.0:1788746787.584249:0:24944:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1788746787.584915:0:24944:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1788746787.584929:0:24944:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788746787.584954:0:24944:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xfac36e89154147d8 00000020:01000004:2.0:1788746787.584962:0:24944:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:2.0:1788746787.584984:0:24944:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.139@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788746787.584988:0:24944:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.139@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788746787.584994:0:24944:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1788746787.585024:0:24944:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:2.0:1788746787.585028:0:24944:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.139@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:3.0:1788746787.621849:0:24944:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.139@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788746787.621892:0:24944:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.204.139@tcp, index=0001, flags=0x20002 00000020:01000004:3.0:1788746787.621898:0:24944:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788746787.621899:0:24944:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788746787.621901:0:24944:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788746787.621902:0:24944:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788746787.621903:0:24944:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788746787.621904:0:24944:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788746787.621906:0:24944:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788746787.621908:0:24944:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788746787.621909:0:24944:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788746787.621913:0:24944:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:3.0:1788746787.621915:0:24944:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788746787.621917:0:24944:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788746787.621918:0:24944:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788746787.621919:0:24944:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788746787.621920:0:24944:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788746787.621921:0:24944:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788746787.621922:0:24944:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788746787.621923:0:24944:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788746787.621924:0:24944:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788746787.622076:0:24944:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1788746787.622099:0:24944:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a448448a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41310026-2b0a-472c-80e6-fbabf81d5070:24944:1875636324132096:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788746787.622172:0:24944:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746787.622279:0:24944:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a44836fd240 going to sleep for 11 seconds 00000100:00100000:1.0:1788746787.624404:0:22615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324132096 00000100:00100000:1.0:1788746787.624419:0:22615:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324132096 00000100:00100000:1.0:1788746787.624535:0:22615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788746787.624546:0:22615:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4585540050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41310026-2b0a-472c-80e6-fbabf81d5070+21:24944:x1875636324132096:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788746787.624596:0:22615:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1788746787.624600:0:22615:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:1.0:1788746787.624604:0:22615:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:1.0:1788746787.625003:0:22615:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4585540050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41310026-2b0a-472c-80e6-fbabf81d5070+21:24944:x1875636324132096:12345-0@lo:253:mount.lustre.0 Request processed in 459us (2830us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746787.625012:0:22615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1788746787.625103:0:24944:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a448448a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41310026-2b0a-472c-80e6-fbabf81d5070:24944:1875636324132096:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788746787.625119:0:24944:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1788746787.625122:0:24944:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788746787.625123:0:24944:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788746787.625125:0:24944:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788746787.625126:0:24944:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788746787.625127:0:24944:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788746787.625128:0:24944:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788746787.625129:0:24944:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788746787.625131:0:24944:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788746787.625147:0:24944:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788746787.625168:0:24944:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8a45b49b3000 from lustre-OST0001 10000000:01000000:0.0:1788746787.625198:0:24944:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:0.0:1788746787.625201:0:24944:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1788746787.625210:0:24944:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8a4483138000 local copy 00010000:00010000:0.0:1788746787.625219:0:24944:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.139@tcp lock: ffff8a44825c3400/0xfac36e89154144f2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xfac36e89154144f9 expref: -99 pid: 22602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788746787.625356:0:24944:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a45c0ea5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41310026-2b0a-472c-80e6-fbabf81d5070:24944:1875636324132224:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788746787.625402:0:24944:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746787.625435:0:24944:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a45853320c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788746787.625469:0:22618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324132224 00000100:00100000:2.0:1788746787.625476:0:22618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324132224 00000100:00100000:2.0:1788746787.625551:0:22618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788746787.625561:0:22618:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4585542c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41310026-2b0a-472c-80e6-fbabf81d5070+21:24944:x1875636324132224:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788746787.625649:0:22618:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4585542c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41310026-2b0a-472c-80e6-fbabf81d5070+21:24944:x1875636324132224:12345-0@lo:501:mount.lustre.0 Request processed in 89us (246us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788746787.625656:0:22618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1788746787.626257:0:24944:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a45c0ea5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41310026-2b0a-472c-80e6-fbabf81d5070:24944:1875636324132224:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1788746787.626277:0:24944:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.139@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1788746787.626342:0:24944:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.139@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1788746787.626352:0:24944:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff8a44825c3400/0xfac36e89154144f2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xfac36e89154144f9 expref: -99 pid: 22602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746787.626361:0:24944:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.139@tcp lock: ffff8a44825c3400/0xfac36e89154144f2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xfac36e89154144f9 expref: -99 pid: 22602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788746787.626390:0:24944:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8a45b49b3000 10000000:01000000:0.0:1788746787.626395:0:24944:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1788746787.626400:0:24944:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1788746787.626403:0:24944:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788746787.626407:0:24944:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:0.0:1788746787.626410:0:24944:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1788746787.626436:0:24944:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.139@tcp lock: ffff8a44825c3a00/0xfac36e89154147df lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746787.626444:0:24944:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.139@tcp lock: ffff8a44825c3a00/0xfac36e89154147df lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746787.626465:0:24944:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.139@tcp lock: ffff8a44825c3a00/0xfac36e89154147df lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788746787.626481:0:24944:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a45c0ea5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41310026-2b0a-472c-80e6-fbabf81d5070:24944:1875636324132352:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788746787.626536:0:24944:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746787.626570:0:24944:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a45853320c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788746787.627126:0:22618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324132352 00000100:00100000:2.0:1788746787.627133:0:22618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324132352 00000100:00100000:2.0:1788746787.627182:0:22618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788746787.627191:0:22618:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4585541050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41310026-2b0a-472c-80e6-fbabf81d5070+21:24944:x1875636324132352:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788746787.627204:0:22618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788746787.627218:0:22618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a4581526600/0xfac36e89154147e6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xfac36e89154147df expref: -99 pid: 22618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746787.627243:0:22618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a4581526600/0xfac36e89154147e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfac36e89154147df expref: 22 pid: 22618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746787.627253:0:22618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a4581526600/0xfac36e89154147e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfac36e89154147df expref: 22 pid: 22618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746787.627276:0:22618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a4581526600, rc 0) 00000100:00100000:2.0:1788746787.627365:0:22618:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4585541050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41310026-2b0a-472c-80e6-fbabf81d5070+22:24944:x1875636324132352:12345-0@lo:101:mount.lustre.0 Request processed in 175us (829us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746787.627371:0:22618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1788746787.627957:0:24944:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a45c0ea5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41310026-2b0a-472c-80e6-fbabf81d5070:24944:1875636324132352:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788746787.627973:0:24944:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.139@tcp lock: ffff8a44825c3a00/0xfac36e89154147df lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xfac36e89154147e6 expref: -99 pid: 24944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746787.627981:0:24944:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.139@tcp lock: ffff8a44825c3a00/0xfac36e89154147df lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xfac36e89154147e6 expref: -99 pid: 24944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788746787.630333:0:24944:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000040:00080000:0.0:1788746787.632280:0:24944:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788746787.638720:0:24944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:0.0:1788746787.638785:0:24944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 128 off8544 00000040:00080000:0.0:1788746787.638802:0:24944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 112 off8656 00000040:00080000:0.0:1788746787.638817:0:24944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8880 00000040:00080000:0.0:1788746787.638829:0:24944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9104 00000040:00080000:0.0:1788746787.638841:0:24944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 80 off9184 00000040:00080000:0.0:1788746787.638854:0:24944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 224 off9408 00000040:00080000:0.0:1788746787.638866:0:24944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9632 00000040:00080000:0.0:1788746787.638880:0:24944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 120 off9752 00000040:00080000:0.0:1788746787.638905:0:24944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 224 off9976 00000040:00080000:0.0:1788746787.638912:0:24944:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 10 count 11 00000100:00100000:0.0:1788746787.639018:0:24944:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a45c0ea5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41310026-2b0a-472c-80e6-fbabf81d5070:24944:1875636324132480:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788746787.639088:0:24944:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746787.639230:0:24944:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a4583971000 going to sleep for 11 seconds 00000100:00100000:2.0:1788746787.639713:0:22618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324132480 00000100:00100000:2.0:1788746787.639723:0:22618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324132480 00000100:00100000:2.0:1788746787.639817:0:22618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1788746787.639827:0:22618:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a45af2a5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41310026-2b0a-472c-80e6-fbabf81d5070+22:24944:x1875636324132480:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788746787.639992:0:22618:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a45af2a5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41310026-2b0a-472c-80e6-fbabf81d5070+22:24944:x1875636324132480:12345-0@lo:501:mount.lustre.0 Request processed in 166us (903us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746787.640001:0:22618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788746787.640071:0:24944:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a45c0ea5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41310026-2b0a-472c-80e6-fbabf81d5070:24944:1875636324132480:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788746787.640106:0:24944:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a45c0ea5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41310026-2b0a-472c-80e6-fbabf81d5070:24944:1875636324132608:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788746787.640148:0:24944:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746787.640216:0:24944:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a4583971000 going to sleep for 11 seconds 00000100:00100000:3.0:1788746787.640279:0:22617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324132608 00000100:00100000:3.0:1788746787.640318:0:22617:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324132608 00000100:00100000:3.0:1788746787.640341:0:22617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1788746787.640349:0:22617:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a45af2a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41310026-2b0a-472c-80e6-fbabf81d5070+22:24944:x1875636324132608:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788746787.644524:0:22617:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a45af2a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41310026-2b0a-472c-80e6-fbabf81d5070+22:24944:x1875636324132608:12345-0@lo:503:mount.lustre.0 Request processed in 4165us (4365us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746787.644559:0:22617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1788746787.644765:0:24944:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a45c0ea5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41310026-2b0a-472c-80e6-fbabf81d5070:24944:1875636324132608:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788746787.645274:0:24944:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788746787.645403:0:24944:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a45c0ea5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41310026-2b0a-472c-80e6-fbabf81d5070:24944:1875636324132736:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788746787.645456:0:24944:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746787.645488:0:24944:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a45b593c540 going to sleep for 11 seconds 00000100:00100000:2.0:1788746787.646330:0:22618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324132736 00000100:00100000:2.0:1788746787.646340:0:22618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324132736 00000100:00100000:2.0:1788746787.646394:0:22618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1788746787.646403:0:22618:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a45af2a7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41310026-2b0a-472c-80e6-fbabf81d5070+22:24944:x1875636324132736:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788746787.647017:0:22618:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a45af2a7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41310026-2b0a-472c-80e6-fbabf81d5070+22:24944:x1875636324132736:12345-0@lo:502:mount.lustre.0 Request processed in 613us (1559us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746787.647026:0:22618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1788746787.647151:0:24944:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a45c0ea5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41310026-2b0a-472c-80e6-fbabf81d5070:24944:1875636324132736:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788746787.647568:0:24944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:3.0:1788746787.647601:0:24944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 128 off8544 00000040:00080000:3.0:1788746787.647617:0:24944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 112 off8656 00000040:00080000:3.0:1788746787.647630:0:24944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8880 00000040:00080000:3.0:1788746787.647642:0:24944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9104 00000040:00080000:3.0:1788746787.647742:0:24944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 80 off9184 00000040:00080000:3.0:1788746787.647760:0:24944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 224 off9408 00000040:00080000:3.0:1788746787.647781:0:24944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9632 00000040:00080000:3.0:1788746787.647794:0:24944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 120 off9752 00000100:00100000:3.0:1788746787.647827:0:24944:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a448448ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41310026-2b0a-472c-80e6-fbabf81d5070:24944:1875636324132864:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788746787.647957:0:24944:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746787.648045:0:24944:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a44836fd6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788746787.648091:0:22615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324132864 00000100:00100000:1.0:1788746787.648098:0:22615:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324132864 00000100:00100000:1.0:1788746787.648137:0:22615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1788746787.648145:0:22615:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a45af2a4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41310026-2b0a-472c-80e6-fbabf81d5070+22:24944:x1875636324132864:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788746787.648254:0:22615:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a45af2a4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41310026-2b0a-472c-80e6-fbabf81d5070+22:24944:x1875636324132864:12345-0@lo:502:mount.lustre.0 Request processed in 110us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746787.648262:0:22615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788746787.648967:0:24944:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a448448ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41310026-2b0a-472c-80e6-fbabf81d5070:24944:1875636324132864:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788746787.649038:0:24944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 224 off9976 00000040:00080000:0.0:1788746787.649049:0:24944:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 10 count 11 00000020:01000000:0.0:1788746787.649913:0:24948:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788746787.649922:0:24948:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:0.0:1788746787.649929:0:24948:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788746787.649932:0:24948:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:0.0:1788746787.649938:0:24948:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788746787.649955:0:24948:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff8a45bdd799c0) 00000020:00000080:0.0:1788746787.649981:0:24948:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type obdfilter with refcount 2 00000020:00000080:0.0:1788746787.649988:0:24948:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1788746787.650069:0:24948:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8a45b49b3000 from lustre-OST0001, refs=2 00080000:01000000:0.0:1788746787.650078:0:24948:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:0.0:1788746787.650086:0:24948:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xfac36e89154147f4 00010000:00010000:0.0:1788746787.655881:0:24948:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:00000004:3.0:1788746787.659365:0:24948:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 8589934600 00080000:10000000:3.0:1788746787.662119:0:24948:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/32) registered 00000020:00000080:3.0:1788746787.666137:0:24948:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:3.0:1788746787.666154:0:24948:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788746787.666163:0:24948:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788746787.666165:0:24948:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:3.0:1788746787.666170:0:24948:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788746787.666175:0:24948:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788746787.666176:0:24948:0:(obd_config.c:1563:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788746787.666180:0:24948:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788746787.666182:0:24948:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788746787.666185:0:24948:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788746787.666187:0:24948:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788746787.666189:0:24948:0:(obd_config.c:1563:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000020:01000000:3.0:1788746787.666191:0:24948:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788746787.670072:0:24948:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788746787.670075:0:24948:0:(obd_config.c:1563:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788746787.670089:0:24948:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1788746787.670120:0:24948:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788746787.670123:0:24948:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788746787.670125:0:24948:0:(obd_config.c:1563:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788746787.670128:0:24948:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 11 count 11 00000020:01000000:2.0:1788746787.671099:0:24944:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:2.0:1788746787.671141:0:24944:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.139@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1788746787.671168:0:24944:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff8a44825c3a00/0xfac36e89154147df lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xfac36e89154147e6 expref: -99 pid: 24944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746787.671182:0:24944:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.139@tcp lock: ffff8a44825c3a00/0xfac36e89154147df lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xfac36e89154147e6 expref: -99 pid: 24944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788746787.671209:0:24944:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8a45b49b3000 from 1 10000000:01000000:2.0:1788746787.671212:0:24944:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788746787.671256:0:24944:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.139@tcp lock: ffff8a4581526400/0xfac36e89154147fb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746787.671265:0:24944:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.139@tcp lock: ffff8a4581526400/0xfac36e89154147fb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746787.671276:0:24944:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.139@tcp lock: ffff8a4581526400/0xfac36e89154147fb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788746787.671343:0:24944:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a448446ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41310026-2b0a-472c-80e6-fbabf81d5070:24944:1875636324132992:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788746787.671414:0:24944:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788746787.671457:0:22618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324132992 00000100:00100000:2.0:1788746787.671464:0:22618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324132992 00000100:00100000:2.0:1788746787.671511:0:22618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1788746787.671520:0:22618:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a45af2a5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41310026-2b0a-472c-80e6-fbabf81d5070+22:24944:x1875636324132992:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788746787.671533:0:22618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788746787.671546:0:22618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a4581527c00/0xfac36e8915414802 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xfac36e89154147fb expref: -99 pid: 22618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746787.671570:0:22618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a4581527c00/0xfac36e8915414802 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfac36e89154147fb expref: 23 pid: 22618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746787.671594:0:22618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a4581527c00/0xfac36e8915414802 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfac36e89154147fb expref: 23 pid: 22618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746787.671604:0:22618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a4581527c00, rc 0) 00000100:00100000:2.0:1788746787.671642:0:22618:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a45af2a5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41310026-2b0a-472c-80e6-fbabf81d5070+23:24944:x1875636324132992:12345-0@lo:101:mount.lustre.0 Request processed in 122us (228us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746787.671650:0:22618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1788746787.671693:0:24944:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a45c0c95240 going to sleep for 11 seconds 00000100:00100000:2.0:1788746787.671715:0:24944:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a448446ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41310026-2b0a-472c-80e6-fbabf81d5070:24944:1875636324132992:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788746787.671729:0:24944:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.139@tcp lock: ffff8a4581526400/0xfac36e89154147fb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xfac36e8915414802 expref: -99 pid: 24944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746787.671738:0:24944:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.139@tcp lock: ffff8a4581526400/0xfac36e89154147fb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xfac36e8915414802 expref: -99 pid: 24944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788746787.675946:0:24944:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000040:00080000:2.0:1788746787.676385:0:24944:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788746787.676610:0:24944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:2.0:1788746787.676635:0:24944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:2.0:1788746787.676651:0:24944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:2.0:1788746787.676666:0:24944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8976 00000040:00080000:2.0:1788746787.676681:0:24944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 112 off9088 00000040:00080000:2.0:1788746787.676696:0:24944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 224 off9312 00000040:00080000:2.0:1788746787.676710:0:24944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 224 off9536 00000040:00080000:2.0:1788746787.676722:0:24944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 128 off9664 00000040:00080000:2.0:1788746787.676737:0:24944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9888 00000040:00080000:2.0:1788746787.676768:0:24944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10112 00000040:00080000:2.0:1788746787.676785:0:24944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 128 off10240 00000040:00080000:2.0:1788746787.676803:0:24944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 224 off10464 00000040:00080000:2.0:1788746787.676809:0:24944:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 12 count 13 00000100:00100000:2.0:1788746787.676887:0:24944:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a448446ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41310026-2b0a-472c-80e6-fbabf81d5070:24944:1875636324133120:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788746787.679986:0:24944:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788746787.680045:0:24944:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a45c0c95b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788746787.680156:0:22617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324133120 00000100:00100000:3.0:1788746787.680166:0:22617:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324133120 00000100:00100000:3.0:1788746787.680223:0:22617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1788746787.680234:0:22617:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a45af2a6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41310026-2b0a-472c-80e6-fbabf81d5070+23:24944:x1875636324133120:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788746787.680436:0:22617:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a45af2a6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41310026-2b0a-472c-80e6-fbabf81d5070+23:24944:x1875636324133120:12345-0@lo:501:mount.lustre.0 Request processed in 204us (457us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746787.680444:0:22617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788746787.680589:0:24944:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a448446ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41310026-2b0a-472c-80e6-fbabf81d5070:24944:1875636324133120:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788746787.680654:0:24944:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a448446ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41310026-2b0a-472c-80e6-fbabf81d5070:24944:1875636324133248:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788746787.680701:0:24944:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788746787.680730:0:24944:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a45c0c95b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788746787.680780:0:22615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324133248 00000100:00100000:3.0:1788746787.680785:0:22615:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324133248 00000100:00100000:3.0:1788746787.680816:0:22615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1788746787.680823:0:22615:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a45af2a6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41310026-2b0a-472c-80e6-fbabf81d5070+23:24944:x1875636324133248:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788746787.680903:0:22615:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a45af2a6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41310026-2b0a-472c-80e6-fbabf81d5070+23:24944:x1875636324133248:12345-0@lo:503:mount.lustre.0 Request processed in 81us (201us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746787.680910:0:22615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788746787.681039:0:24944:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a448446ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41310026-2b0a-472c-80e6-fbabf81d5070:24944:1875636324133248:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788746787.682593:0:24944:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788746787.682686:0:24944:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a448446ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41310026-2b0a-472c-80e6-fbabf81d5070:24944:1875636324133376:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788746787.682762:0:24944:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788746787.682808:0:24944:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a45c0c95240 going to sleep for 11 seconds 00000100:00100000:3.0:1788746787.683036:0:22618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324133376 00000100:00100000:3.0:1788746787.683044:0:22618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324133376 00000100:00100000:3.0:1788746787.683094:0:22618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1788746787.683103:0:22618:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a45af2a6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41310026-2b0a-472c-80e6-fbabf81d5070+23:24944:x1875636324133376:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788746787.683206:0:22618:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a45af2a6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41310026-2b0a-472c-80e6-fbabf81d5070+23:24944:x1875636324133376:12345-0@lo:502:mount.lustre.0 Request processed in 104us (443us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746787.683213:0:22618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788746787.684744:0:24944:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a448446ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41310026-2b0a-472c-80e6-fbabf81d5070:24944:1875636324133376:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788746787.685026:0:24944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:2.0:1788746787.685056:0:24944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:2.0:1788746787.685071:0:24944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:2.0:1788746787.685085:0:24944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:2.0:1788746787.685097:0:24944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000040:00080000:2.0:1788746787.685110:0:24944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:2.0:1788746787.685123:0:24944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 224 off9536 00000040:00080000:2.0:1788746787.685136:0:24944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 128 off9664 00000040:00080000:2.0:1788746787.685149:0:24944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9888 00000040:00080000:2.0:1788746787.685161:0:24944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10112 00000040:00080000:2.0:1788746787.685174:0:24944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 128 off10240 00000100:00100000:2.0:1788746787.685221:0:24944:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a448446ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41310026-2b0a-472c-80e6-fbabf81d5070:24944:1875636324133504:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788746787.685282:0:24944:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788746787.685430:0:22617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324133504 00000100:00100000:2.0:1788746787.685437:0:22617:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324133504 00000100:00100000:2.0:1788746787.685481:0:22617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788746787.685489:0:22617:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a45af2a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41310026-2b0a-472c-80e6-fbabf81d5070+23:24944:x1875636324133504:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788746787.685588:0:22617:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a45af2a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41310026-2b0a-472c-80e6-fbabf81d5070+23:24944:x1875636324133504:12345-0@lo:502:mount.lustre.0 Request processed in 100us (305us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746787.685602:0:22617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788746787.685653:0:24944:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a45c0c95240 going to sleep for 11 seconds 00000100:00100000:2.0:1788746787.685667:0:24944:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a448446ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41310026-2b0a-472c-80e6-fbabf81d5070:24944:1875636324133504:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788746787.685703:0:24944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 224 off10464 00000040:00080000:2.0:1788746787.685711:0:24944:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:1.0:1788746787.689268:0:24952:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788746787.689491:0:24952:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788746787.689494:0:24952:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788746787.689505:0:24952:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8a45b49b3000 00000020:00000080:1.0:1788746787.689508:0:24952:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788746787.689515:0:24952:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788746787.689518:0:24952:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788746787.689533:0:24952:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1788746787.689536:0:24952:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788746787.689539:0:24952:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788746787.689541:0:24952:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788746787.689544:0:24952:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8a45b49b3000 00000020:00000080:1.0:1788746787.689546:0:24952:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788746787.689606:0:24952:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788746787.689610:0:24952:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788746787.689612:0:24952:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1788746787.689614:0:24952:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788746787.689617:0:24952:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788746787.689618:0:24952:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788746787.689622:0:24952:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8a45b49b3000 00000020:00000080:1.0:1788746787.689624:0:24952:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788746787.689641:0:24952:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788746787.689644:0:24952:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788746787.689645:0:24952:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788746787.689648:0:24952:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788746787.689650:0:24952:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788746787.689651:0:24952:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1788746787.689655:0:24952:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8a45b49b3000 00000020:00000080:1.0:1788746787.689657:0:24952:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788746787.689693:0:24952:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788746787.689696:0:24952:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788746787.689698:0:24952:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1788746787.689701:0:24952:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 13 count 13 00000020:01000000:2.0:1788746787.689849:0:24944:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:2.0:1788746787.689884:0:24944:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.139@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788746787.689912:0:24944:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff8a4581526400/0xfac36e89154147fb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xfac36e8915414802 expref: -99 pid: 24944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746787.689928:0:24944:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.139@tcp lock: ffff8a4581526400/0xfac36e89154147fb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xfac36e8915414802 expref: -99 pid: 24944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788746787.690008:0:24944:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788746787.690012:0:24944:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8a45b49b3000 10000000:01000000:2.0:1788746787.690016:0:24944:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8a45b49b3000 10000000:01000000:2.0:1788746787.690021:0:24944:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788746787.690027:0:24944:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8a45b49b3000 from 1 10000000:01000000:2.0:1788746787.690030:0:24944:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788746787.690077:0:24944:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.139@tcp lock: ffff8a4581688a00/0xfac36e8915414809 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746787.690088:0:24944:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.139@tcp lock: ffff8a4581688a00/0xfac36e8915414809 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746787.690101:0:24944:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.139@tcp lock: ffff8a4581688a00/0xfac36e8915414809 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788746787.690130:0:24944:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a448446ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41310026-2b0a-472c-80e6-fbabf81d5070:24944:1875636324133632:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788746787.690226:0:24944:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788746787.690272:0:22615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324133632 00000100:00100000:2.0:1788746787.690279:0:22615:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324133632 00000100:00100000:2.0:1788746787.690361:0:22615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788746787.690370:0:22615:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a45af2a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41310026-2b0a-472c-80e6-fbabf81d5070+23:24944:x1875636324133632:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788746787.690384:0:22615:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788746787.690396:0:22615:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a4581689000/0xfac36e8915414810 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xfac36e8915414809 expref: -99 pid: 22615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746787.690423:0:22615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a4581689000/0xfac36e8915414810 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfac36e8915414809 expref: 24 pid: 22615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746787.690434:0:22615:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a4581689000/0xfac36e8915414810 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfac36e8915414809 expref: 24 pid: 22615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746787.690443:0:22615:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a4581689000, rc 0) 00000100:00100000:2.0:1788746787.690479:0:22615:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a45af2a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41310026-2b0a-472c-80e6-fbabf81d5070+24:24944:x1875636324133632:12345-0@lo:101:mount.lustre.0 Request processed in 109us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746787.690486:0:22615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788746787.690532:0:24944:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a45c0c95b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788746787.690554:0:24944:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a448446ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41310026-2b0a-472c-80e6-fbabf81d5070:24944:1875636324133632:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788746787.690570:0:24944:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.139@tcp lock: ffff8a4581688a00/0xfac36e8915414809 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xfac36e8915414810 expref: -99 pid: 24944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746787.690579:0:24944:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.139@tcp lock: ffff8a4581688a00/0xfac36e8915414809 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xfac36e8915414810 expref: -99 pid: 24944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788746787.694556:0:24944:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000040:00080000:2.0:1788746787.694887:0:24944:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788746787.695163:0:24944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:2.0:1788746787.695191:0:24944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 120 off8536 00000040:00080000:2.0:1788746787.695207:0:24944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 168 off8704 00000040:00080000:2.0:1788746787.695221:0:24944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8928 00000040:00080000:2.0:1788746787.695235:0:24944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 224 off9152 00000040:00080000:2.0:1788746787.695249:0:24944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 120 off9272 00000040:00080000:2.0:1788746787.695263:0:24944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 168 off9440 00000040:00080000:2.0:1788746787.695275:0:24944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 224 off9664 00000040:00080000:2.0:1788746787.695514:0:24944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:2.0:1788746787.695534:0:24944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 120 off10008 00000040:00080000:2.0:1788746787.695565:0:24944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 224 off10232 00000040:00080000:2.0:1788746787.695581:0:24944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10456 00000040:00080000:2.0:1788746787.695595:0:24944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].13, 88 off10544 00000040:00080000:2.0:1788746787.695607:0:24944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].14, 128 off10672 00000040:00080000:2.0:1788746787.695620:0:24944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].15, 144 off10816 00000040:00080000:2.0:1788746787.695634:0:24944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].16, 160 off10976 00000040:00080000:2.0:1788746787.695648:0:24944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].17, 224 off11200 00000040:00080000:2.0:1788746787.695663:0:24944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].18, 224 off11424 00000040:00080000:2.0:1788746787.695677:0:24944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].19, 80 off11504 00000040:00080000:2.0:1788746787.695690:0:24944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].20, 224 off11728 00000040:00080000:2.0:1788746787.695702:0:24944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].21, 224 off11952 00000040:00080000:2.0:1788746787.695714:0:24944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].22, 88 off12040 00000040:00080000:2.0:1788746787.695725:0:24944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].23, 128 off12168 00000040:00080000:2.0:1788746787.695738:0:24944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].24, 144 off12312 00000040:00080000:2.0:1788746787.695752:0:24944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].25, 160 off12472 00000040:00080000:2.0:1788746787.695766:0:24944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].26, 224 off12696 00000040:00080000:2.0:1788746787.695793:0:24944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].27, 224 off12920 00000040:00080000:2.0:1788746787.695808:0:24944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].28, 80 off13000 00000040:00080000:2.0:1788746787.695822:0:24944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].29, 224 off13224 00000040:00080000:2.0:1788746787.695836:0:24944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].30, 224 off13448 00000040:00080000:2.0:1788746787.695849:0:24944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].31, 88 off13536 00000040:00080000:2.0:1788746787.695863:0:24944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].32, 128 off13664 00000040:00080000:2.0:1788746787.695889:0:24944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].33, 144 off13808 00000040:00080000:2.0:1788746787.695903:0:24944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].34, 128 off13936 00000040:00080000:2.0:1788746787.695916:0:24944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].35, 224 off14160 00000040:00080000:2.0:1788746787.695929:0:24944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].36, 224 off14384 00000040:00080000:2.0:1788746787.696122:0:24944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].37, 80 off14464 00000040:00080000:2.0:1788746787.696140:0:24944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].38, 224 off14688 00000040:00080000:2.0:1788746787.696153:0:24944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].39, 224 off14912 00000040:00080000:2.0:1788746787.696167:0:24944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].40, 88 off15000 00000040:00080000:2.0:1788746787.696180:0:24944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].41, 128 off15128 00000040:00080000:2.0:1788746787.696193:0:24944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].42, 144 off15272 00000040:00080000:2.0:1788746787.696220:0:24944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].43, 128 off15400 00000040:00080000:2.0:1788746787.696236:0:24944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].44, 224 off15624 00000040:00080000:2.0:1788746787.696249:0:24944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].45, 224 off15848 00000040:00080000:2.0:1788746787.696261:0:24944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].46, 80 off15928 00000040:00080000:2.0:1788746787.696275:0:24944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].47, 224 off16152 00000040:00080000:2.0:1788746787.696349:0:24944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].48, 232 off16384 00000040:00080000:2.0:1788746787.696488:0:24944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].49, 224 off16608 00000040:00080000:2.0:1788746787.696509:0:24944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].50, 120 off16728 00000040:00080000:2.0:1788746787.696526:0:24944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].51, 224 off16952 00000040:00080000:2.0:1788746787.696531:0:24944:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 51 count 51 00000100:00100000:2.0:1788746787.696637:0:24944:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a448446ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41310026-2b0a-472c-80e6-fbabf81d5070:24944:1875636324133760:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788746787.696702:0:24944:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788746787.696743:0:24944:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a45c0c95480 going to sleep for 11 seconds 00000100:00100000:3.0:1788746787.697620:0:22618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324133760 00000100:00100000:3.0:1788746787.697629:0:22618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324133760 00000100:00100000:3.0:1788746787.697683:0:22618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1788746787.697693:0:22618:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a45af2a5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41310026-2b0a-472c-80e6-fbabf81d5070+24:24944:x1875636324133760:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788746787.697823:0:22618:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a45af2a5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41310026-2b0a-472c-80e6-fbabf81d5070+24:24944:x1875636324133760:12345-0@lo:501:mount.lustre.0 Request processed in 131us (1120us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746787.697831:0:22618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788746787.697935:0:24944:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a448446ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41310026-2b0a-472c-80e6-fbabf81d5070:24944:1875636324133760:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788746787.698097:0:24944:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a448446ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41310026-2b0a-472c-80e6-fbabf81d5070:24944:1875636324133888:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788746787.698146:0:24944:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788746787.698178:0:24944:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a45c0c95480 going to sleep for 11 seconds 00000100:00100000:3.0:1788746787.699108:0:22617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324133888 00000100:00100000:3.0:1788746787.699119:0:22617:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324133888 00000100:00100000:3.0:1788746787.699159:0:22617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1788746787.699166:0:22617:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a45af2a7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41310026-2b0a-472c-80e6-fbabf81d5070+24:24944:x1875636324133888:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788746787.699319:0:22617:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a45af2a7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41310026-2b0a-472c-80e6-fbabf81d5070+24:24944:x1875636324133888:12345-0@lo:503:mount.lustre.0 Request processed in 152us (1172us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746787.699325:0:22617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788746787.700123:0:24944:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a448446ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41310026-2b0a-472c-80e6-fbabf81d5070:24944:1875636324133888:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788746787.700618:0:24944:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788746787.700719:0:24944:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a448446ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41310026-2b0a-472c-80e6-fbabf81d5070:24944:1875636324134016:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788746787.700775:0:24944:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788746787.703413:0:24944:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a45995b0000 going to sleep for 11 seconds 00000100:00100000:3.0:1788746787.711762:0:22615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324134016 00000100:00100000:3.0:1788746787.711778:0:22615:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324134016 00000100:00100000:3.0:1788746787.711850:0:22615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788746787.711860:0:22615:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a45af2a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41310026-2b0a-472c-80e6-fbabf81d5070+24:24944:x1875636324134016:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788746787.712045:0:22615:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a45af2a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41310026-2b0a-472c-80e6-fbabf81d5070+24:24944:x1875636324134016:12345-0@lo:502:mount.lustre.0 Request processed in 186us (11268us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746787.712054:0:22615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788746787.713136:0:24944:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a448446ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41310026-2b0a-472c-80e6-fbabf81d5070:24944:1875636324134016:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788746787.714162:0:24944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:2.0:1788746787.714206:0:24944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 120 off8536 00000040:00080000:2.0:1788746787.714224:0:24944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 168 off8704 00000040:00080000:2.0:1788746787.714240:0:24944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8928 00000040:00080000:2.0:1788746787.714253:0:24944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 224 off9152 00000040:00080000:2.0:1788746787.714266:0:24944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 120 off9272 00000040:00080000:2.0:1788746787.714279:0:24944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 168 off9440 00000040:00080000:2.0:1788746787.715048:0:24944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 224 off9664 00000040:00080000:2.0:1788746787.715067:0:24944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:2.0:1788746787.715080:0:24944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 120 off10008 00000040:00080000:2.0:1788746787.715093:0:24944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 224 off10232 00000040:00080000:2.0:1788746787.715105:0:24944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10456 00000040:00080000:2.0:1788746787.715118:0:24944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].13, 88 off10544 00000040:00080000:2.0:1788746787.715129:0:24944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].14, 128 off10672 00000040:00080000:2.0:1788746787.715141:0:24944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].15, 144 off10816 00000040:00080000:2.0:1788746787.715153:0:24944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].16, 160 off10976 00000040:00080000:2.0:1788746787.715181:0:24944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].17, 224 off11200 00000040:00080000:2.0:1788746787.715196:0:24944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].18, 224 off11424 00000040:00080000:2.0:1788746787.715213:0:24944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].19, 80 off11504 00000040:00080000:2.0:1788746787.715226:0:24944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].20, 224 off11728 00000040:00080000:2.0:1788746787.715237:0:24944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].21, 224 off11952 00000040:00080000:2.0:1788746787.715248:0:24944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].22, 88 off12040 00000040:00080000:2.0:1788746787.715260:0:24944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].23, 128 off12168 00000040:00080000:2.0:1788746787.715272:0:24944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].24, 144 off12312 00000040:00080000:2.0:1788746787.716273:0:24944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].25, 160 off12472 00000040:00080000:2.0:1788746787.716392:0:24944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].26, 224 off12696 00000040:00080000:2.0:1788746787.716410:0:24944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].27, 224 off12920 00000040:00080000:2.0:1788746787.716436:0:24944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].28, 80 off13000 00000040:00080000:2.0:1788746787.716451:0:24944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].29, 224 off13224 00000040:00080000:2.0:1788746787.716467:0:24944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].30, 224 off13448 00000040:00080000:2.0:1788746787.716486:0:24944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].31, 88 off13536 00000040:00080000:2.0:1788746787.716500:0:24944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].32, 128 off13664 00000040:00080000:2.0:1788746787.716526:0:24944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].33, 144 off13808 00000040:00080000:2.0:1788746787.716541:0:24944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].34, 128 off13936 00000040:00080000:2.0:1788746787.716555:0:24944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].35, 224 off14160 00000040:00080000:2.0:1788746787.716567:0:24944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].36, 224 off14384 00000040:00080000:2.0:1788746787.716580:0:24944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].37, 80 off14464 00000040:00080000:2.0:1788746787.716592:0:24944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].38, 224 off14688 00000040:00080000:2.0:1788746787.716603:0:24944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].39, 224 off14912 00000040:00080000:2.0:1788746787.716614:0:24944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].40, 88 off15000 00000040:00080000:2.0:1788746787.716625:0:24944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].41, 128 off15128 00000040:00080000:2.0:1788746787.716638:0:24944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].42, 144 off15272 00000040:00080000:2.0:1788746787.716650:0:24944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].43, 128 off15400 00000040:00080000:2.0:1788746787.716664:0:24944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].44, 224 off15624 00000040:00080000:2.0:1788746787.716679:0:24944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].45, 224 off15848 00000040:00080000:2.0:1788746787.716691:0:24944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].46, 80 off15928 00000040:00080000:2.0:1788746787.716704:0:24944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].47, 224 off16152 00000040:00080000:2.0:1788746787.716717:0:24944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].48, 232 off16384 00000100:00100000:2.0:1788746787.716801:0:24944:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a448446ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41310026-2b0a-472c-80e6-fbabf81d5070:24944:1875636324134144:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788746787.716896:0:24944:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746787.717120:0:22618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324134144 00000100:00100000:0.0:1788746787.717129:0:22618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324134144 00000100:00100000:0.0:1788746787.717184:0:22618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788746787.717208:0:22618:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a45af2a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41310026-2b0a-472c-80e6-fbabf81d5070+24:24944:x1875636324134144:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788746787.717363:0:22618:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a45af2a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41310026-2b0a-472c-80e6-fbabf81d5070+24:24944:x1875636324134144:12345-0@lo:502:mount.lustre.0 Request processed in 156us (465us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746787.717371:0:22618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788746787.717768:0:24944:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a45c0c95b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788746787.717796:0:24944:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a448446ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41310026-2b0a-472c-80e6-fbabf81d5070:24944:1875636324134144:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788746787.718432:0:24944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].49, 224 off16608 00000040:00080000:2.0:1788746787.718465:0:24944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].50, 120 off16728 00000100:00100000:2.0:1788746787.718502:0:24944:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a448446ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41310026-2b0a-472c-80e6-fbabf81d5070:24944:1875636324134272:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788746787.718557:0:24944:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788746787.718593:0:24944:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a45c0c95b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788746787.719560:0:22617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324134272 00000100:00100000:2.0:1788746787.719572:0:22617:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324134272 00000100:00100000:2.0:1788746787.719623:0:22617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788746787.719631:0:22617:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4585855c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41310026-2b0a-472c-80e6-fbabf81d5070+24:24944:x1875636324134272:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788746787.719768:0:22617:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4585855c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41310026-2b0a-472c-80e6-fbabf81d5070+24:24944:x1875636324134272:12345-0@lo:502:mount.lustre.0 Request processed in 137us (1211us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746787.719776:0:22617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788746787.719833:0:24944:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a448446ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41310026-2b0a-472c-80e6-fbabf81d5070:24944:1875636324134272:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788746787.719911:0:24944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].51, 224 off16952 00000040:00080000:2.0:1788746787.719922:0:24944:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:1.0:1788746787.727037:0:24957:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1788746787.727060:0:24957:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff8a45c0eccd40) 00000020:00000080:1.0:1788746787.727085:0:24957:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type lwp with refcount 2 00000020:01000004:1.0:1788746787.727167:0:24957:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8a45b49b3000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1788746787.727171:0:24957:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8a45b49b3000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1788746787.727174:0:24957:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8a45b49b3000 3 00010000:00080000:1.0:1788746787.727203:0:24957:0:(ldlm_lib.c:103:import_set_conn()) imp ffff8a4588ad0000@lustre-MDT0000-lwp-OST0001: add connection 192.168.204.139@tcp at head 00010000:00010000:0.0:1788746787.732774:0:22611:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788746787.732864:0:24957:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-11 is initialized 00000020:00000080:1.0:1788746787.733151:0:24957:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:1.0:1788746787.733203:0:24957:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788746787.733216:0:24957:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xfac36e891541481e 00000100:00080000:1.0:1788746787.733228:0:24957:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788746787.733240:0:24957:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8a4588ad0000 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:1.0:1788746787.733280:0:24957:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a4483593b80 x1875636324134400/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788746787.734103:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a4483593b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3642:1875636324134400:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788746787.734173:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788746787.734659:0:24957:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000020:01000004:1.0:1788746787.734883:0:24957:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1788746787.734899:0:24957:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff8a45c0ec8000) 00000020:00000080:1.0:1788746787.734921:0:24957:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:1.0:1788746787.735025:0:24957:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8a45b49b3000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1788746787.735030:0:24957:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8a45b49b3000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1788746787.735032:0:24957:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8a45b49b3000 3 00010000:00080000:1.0:1788746787.735061:0:24957:0:(ldlm_lib.c:103:import_set_conn()) imp ffff8a45851f7800@lustre-MDT0001-lwp-OST0001: add connection 192.168.204.139@tcp at head 00010000:00010000:1.0:1788746787.736681:0:24957:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-12 is initialized 00000020:00000080:1.0:1788746787.736870:0:24957:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:1.0:1788746787.736914:0:24957:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788746787.736925:0:24957:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0xfac36e891541482c 00000100:00080000:1.0:1788746787.736935:0:24957:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788746787.736945:0:24957:0:(import.c:666:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff8a45851f7800 using connection 192.168.204.139@tcp/0@lo 00000100:00080000:0.0:1788746787.737368:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788746787.737373:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788746787.737376:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788746787.737379:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788746787.737418:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788746787.737421:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788746787.737424:0:36:0:(import.c:65:import_set_state_nolock()) ffff8a45b7f9f000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788746787.737429:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 716 00000100:00080000:0.0:1788746787.737431:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788746787.737437:0:36:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8a45b7f9f000 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:0.0:1788746787.737451:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a45c0ea7b80 x1875636324135168/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788746787.738125:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a45c0ea7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1875636324135168:0@lo:8:kworker.0 00000100:00100000:2.0:1788746787.738197:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788746787.738261:0:22623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324134400 00000100:00100000:2.0:1788746787.738268:0:22623:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324134400 00000100:00100000:2.0:1788746787.738400:0:22623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788746787.738407:0:22623:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a448446ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3642:x1875636324134400:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1788746787.738435:0:22623:0:(ldlm_lib.c:1456:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 717 last 0 00000020:00000080:2.0:1788746787.738467:0:22623:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xfac36e8915414833 00000004:00100000:2.0:1788746787.738484:0:22623:0:(mdt_handler.c:7495:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788746787.738516:0:22623:0:(import.c:65:import_set_state_nolock()) ffff8a45b49b0800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788746787.738570:0:22623:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a448446ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1875636324134400:12345-0@lo:38:llog_process_th.0 Request processed in 161us (4396us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746787.738577:0:22623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788746787.738600:0:24130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324135168 00000100:00100000:2.0:1788746787.738617:0:24130:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324135168 00000100:00100000:2.0:1788746787.738641:0:24130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788746787.738646:0:24130:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a448446a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3642:x1875636324135168:12345-0@lo:8:kworker.0 00000100:00100000:2.0:1788746787.738687:0:24130:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a448446a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3642:x1875636324135168:12345-0@lo:8:kworker.0 Request processed in 40us (490us total) trans 0 rc -11/-11 00000100:00100000:2.0:1788746787.738693:0:24130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788746787.738733:0:3642:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788746787.738740:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8a45b7f9f000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788746787.738744:0:3642:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1788746787.738747:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a45c0ea7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1875636324135168:0@lo:8:kworker.0 00010000:00080000:2.0:1788746787.738762:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a4483593b80 x1875636324134400/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788746797 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788746787.738770:0:3642:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788746787.738775:0:3642:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 3 00000100:00080000:2.0:1788746787.738782:0:3642:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1788746787.738787:0:3642:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788746787.738790:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8a4588ad0000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788746787.738794:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a4483593b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3642:1875636324134400:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788746787.739356:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a45c0ea4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875636324134912:0@lo:400:kworker.0 00000100:00100000:1.0:1788746787.739609:0:24957:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a4483590a80 x1875636324134528/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788746787.739646:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a45c0ea6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875636324135040:0@lo:400:kworker.0 00000100:00100000:1.0:1788746787.739684:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746787.739727:0:24129:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324135040 00000100:00100000:3.0:1788746787.739731:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746787.739741:0:24129:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324135040 00000100:00100000:3.0:1788746787.739764:0:22629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324134912 00000100:00100000:3.0:1788746787.739768:0:22629:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324134912 00000100:00100000:1.0:1788746787.739774:0:24129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788746787.739780:0:24129:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4483590e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875636324135040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788746787.739793:0:22629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788746787.739798:0:22629:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a448448aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875636324134912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788746787.739821:0:24129:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4483590e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875636324135040:12345-0@lo:400:kworker.0 Request processed in 41us (138us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746787.739827:0:24129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788746787.739836:0:22629:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a448448aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875636324134912:12345-0@lo:400:kworker.0 Request processed in 38us (106us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746787.739842:0:22629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:1.0:1788746787.739853:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a45c0ea6300 x1875636324135040/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788746803 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788746787.739864:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a45c0ea6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875636324135040:0@lo:400:kworker.0 00000100:00100000:3.0:1788746787.739881:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a45c0ea4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875636324134912:0@lo:400:kworker.0 00000100:00100000:2.0:1788746787.739957:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a4483590a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3642:1875636324134528:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788746787.739992:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788746787.740034:0:22625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324134528 00000100:00100000:2.0:1788746787.740038:0:22625:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324134528 00000100:00100000:2.0:1788746787.740058:0:22625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788746787.740063:0:22625:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4484469f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3642:x1875636324134528:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1788746787.740083:0:22625:0:(ldlm_lib.c:1456:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 717 last 0 00000020:00000080:2.0:1788746787.740125:0:22625:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0xfac36e891541483a 00000004:00100000:2.0:1788746787.740137:0:22625:0:(mdt_handler.c:7495:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788746787.740164:0:22625:0:(import.c:65:import_set_state_nolock()) ffff8a45b0c1a000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788746787.740202:0:22625:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4484469f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1875636324134528:12345-0@lo:38:llog_process_th.0 Request processed in 137us (209us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746787.740209:0:22625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1788746787.740239:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a4483590a80 x1875636324134528/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788746797 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788746787.740247:0:3642:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788746787.740253:0:3642:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 3 00000100:00080000:2.0:1788746787.740260:0:3642:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1788746787.740264:0:3642:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1788746787.740266:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8a45851f7800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788746787.740270:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a4483590a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3642:1875636324134528:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788746787.740356:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a45c0ea6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875636324134784:0@lo:400:kworker.0 00000100:00100000:2.0:1788746787.740385:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788746787.740405:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788746787.740411:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a45c0ea5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875636324134656:0@lo:400:kworker.0 00000100:00100000:2.0:1788746787.740431:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788746787.740459:0:22628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324134656 00000100:00100000:2.0:1788746787.740462:0:22628:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324134656 00000100:00100000:2.0:1788746787.740488:0:22628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788746787.740495:0:22628:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a448446a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875636324134656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788746787.740529:0:22628:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a448446a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875636324134656:12345-0@lo:400:kworker.0 Request processed in 35us (97us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746787.740545:0:22628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788746787.740562:0:22624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324134784 00000100:00100000:2.0:1788746787.740566:0:22624:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324134784 00000100:00100000:2.0:1788746787.740587:0:22624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788746787.740593:0:22624:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a448446b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875636324134784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788746787.740621:0:22624:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a448446b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875636324134784:12345-0@lo:400:kworker.0 Request processed in 29us (236us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746787.740627:0:22624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788746787.740651:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a45c0ea5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875636324134656:0@lo:400:kworker.0 00010000:00080000:2.0:1788746787.740660:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a45c0ea6680 x1875636324134784/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788746803 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788746787.740669:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a45c0ea6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875636324134784:0@lo:400:kworker.0 00000100:00100000:2.0:1788746787.743695:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a45c0ea4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875636324135296:0@lo:400:kworker.0 00000100:00100000:2.0:1788746787.743767:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788746787.743805:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788746787.743811:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a45c0ea6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3645:1875636324135424:0@lo:400:kworker.0 00000100:00100000:2.0:1788746787.743857:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788746787.743891:0:22623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324135296 00000100:00100000:2.0:1788746787.743898:0:22623:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324135296 00000100:00100000:3.0:1788746787.745039:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a45c0ea5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3643:1875636324135552:0@lo:400:kworker.0 00000100:00100000:3.0:1788746787.745087:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788746787.745341:0:22623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324135424 00000100:00100000:2.0:1788746787.745351:0:22623:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324135424 00000100:00100000:2.0:1788746787.745386:0:22623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324135552 00000100:00100000:2.0:1788746787.745388:0:22623:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324135552 00000100:00100000:2.0:1788746787.745405:0:22623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788746787.745416:0:22623:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4484469500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875636324135296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788746787.745492:0:22623:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4484469500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875636324135296:12345-0@lo:400:kworker.0 Request processed in 77us (1724us total) trans 0 rc 0/0 00010000:00080000:3.0:1788746787.745529:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a45c0ea4a80 x1875636324135296/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788746803 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788746787.745530:0:22623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788746787.745542:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a45c0ea4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875636324135296:0@lo:400:kworker.0 00000100:00100000:2.0:1788746787.745546:0:22623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788746787.745552:0:22623:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a448446aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875636324135424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788746787.745592:0:22623:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a448446aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875636324135424:12345-0@lo:400:kworker.0 Request processed in 40us (1734us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746787.745598:0:22623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788746787.745609:0:22623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788746787.745615:0:22623:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4484489880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875636324135552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788746787.745649:0:22623:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4484489880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875636324135552:12345-0@lo:400:kworker.0 Request processed in 35us (562us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746787.745655:0:22623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:2.0:1788746787.745686:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a45c0ea5500 x1875636324135552/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788746803 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788746787.745695:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a45c0ea5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3643:1875636324135552:0@lo:400:kworker.0 00010000:00080000:3.0:1788746787.746036:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a45c0ea6680 x1875636324135424/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788746803 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788746787.746042:0:24957:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:3.0:1788746787.746046:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a45c0ea6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3645:1875636324135424:0@lo:400:kworker.0 00000100:00080000:1.0:1788746787.746078:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788746787.746083:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788746787.746086:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788746787.746089:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:1.0:1788746787.747155:0:24957:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 52 count 51 00000020:01000000:1.0:1788746787.747343:0:24944:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:1.0:1788746787.747379:0:24944:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.139@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788746787.747400:0:24944:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff8a4581688a00/0xfac36e8915414809 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xfac36e8915414810 expref: -99 pid: 24944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746787.747412:0:24944:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.139@tcp lock: ffff8a4581688a00/0xfac36e8915414809 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xfac36e8915414810 expref: -99 pid: 24944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788746787.747461:0:24944:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788746787.747463:0:24944:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788746787.747465:0:24944:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788746787.747470:0:24944:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788746787.747471:0:24944:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788746787.747473:0:24944:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788746787.747475:0:24944:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788746787.747476:0:24944:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788746787.747478:0:24944:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788746787.747483:0:24944:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:1.0:1788746787.747485:0:24944:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788746787.747486:0:24944:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788746787.747487:0:24944:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788746787.747488:0:24944:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788746787.747488:0:24944:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788746787.747489:0:24944:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788746787.747490:0:24944:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788746787.747491:0:24944:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788746787.747492:0:24944:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788746787.747517:0:24944:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1788746787.747535:0:24944:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a4483590000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41310026-2b0a-472c-80e6-fbabf81d5070:24944:1875636324135680:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788746787.747591:0:24944:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746787.747631:0:24944:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a45bc98e240 going to sleep for 11 seconds 00000100:00100000:3.0:1788746787.747744:0:22618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324135680 00000100:00100000:3.0:1788746787.747753:0:22618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324135680 00000100:00100000:3.0:1788746787.747795:0:22618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1788746787.747804:0:22618:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4585856850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41310026-2b0a-472c-80e6-fbabf81d5070+24:24944:x1875636324135680:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788746787.747832:0:22618:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1788746787.747852:0:22618:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1788746787.749579:0:22618:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788746787.749601:0:22618:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:1.0:1788746787.749742:0:22639:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788746787.749748:0:22639:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788746787.749772:0:22639:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a45ae45f000/0xfac36e8915414841 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746787.749795:0:22639:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a45c216d000/0xfac36e89154147b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfac36e89154147ae expref: 24 pid: 22617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746787.749804:0:22639:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a45c216d400/0xfac36e89154147c3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfac36e89154147bc expref: 24 pid: 22617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746787.749812:0:22639:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a45ae45f000/0xfac36e8915414841 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746787.749851:0:22639:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a45c216d400/0xfac36e89154147c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xfac36e89154147bc expref: 24 pid: 22617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746787.749872:0:22639:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a45c216d400/0xfac36e89154147c3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xfac36e89154147bc expref: 24 pid: 22617 timeout: 817 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788746787.749890:0:22639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a4483591880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22639:1875636324135808:0@lo:104: 00000100:00100000:1.0:1788746787.749954:0:22639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788746787.749998:0:22639:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a45c216d000/0xfac36e89154147b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xfac36e89154147ae expref: 24 pid: 22617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746787.750008:0:22639:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a45c216d000/0xfac36e89154147b5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xfac36e89154147ae expref: 24 pid: 22617 timeout: 817 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788746787.750016:0:22639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a4483591c00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22639:1875636324135936:0@lo:104: 00000100:00100000:1.0:1788746787.750039:0:22639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746787.750055:0:22639:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a45bc98e840 going to sleep for 11 seconds 00000100:00100000:1.0:1788746787.750081:0:22606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324135808 00000100:00100000:1.0:1788746787.750088:0:22606:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324135808 00000100:00100000:1.0:1788746787.750119:0:22606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324135936 00000100:00100000:1.0:1788746787.750122:0:22606:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324135936 00000100:00100000:1.0:1788746787.750135:0:22606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788746787.750142:0:22606:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4483591f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:41310026-2b0a-472c-80e6-fbabf81d5070+4:22639:x1875636324135808:12345-0@lo:104: 00010000:00010000:1.0:1788746787.750153:0:22606:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.139@tcp lock: ffff8a44825c3200/0xfac36e89154147bc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xfac36e89154147c3 expref: -99 pid: 22620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746787.750216:0:22606:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788746787.750222:0:22606:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4483591f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:41310026-2b0a-472c-80e6-fbabf81d5070+4:22639:x1875636324135808:12345-0@lo:104: Request processed in 80us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746787.750230:0:22606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788746787.750247:0:22606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788746787.750258:0:22606:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4483590a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:41310026-2b0a-472c-80e6-fbabf81d5070+3:22639:x1875636324135936:12345-0@lo:104: 00010000:00010000:1.0:1788746787.750266:0:22606:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.139@tcp lock: ffff8a44825c2200/0xfac36e89154147ae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xfac36e89154147b5 expref: -99 pid: 22620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788746787.750439:0:22639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a4483591880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22639:1875636324135808:0@lo:104: 00000100:00100000:0.0:1788746787.750448:0:22639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a4483591c00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22639:1875636324135936:0@lo:104: 00010000:00010000:0.0:1788746787.750466:0:22639:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a45ae45f000/0xfac36e8915414841 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788746787.750854:0:22618:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4585856850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41310026-2b0a-472c-80e6-fbabf81d5070+24:24944:x1875636324135680:12345-0@lo:253:mount.lustre.0 Request processed in 3049us (3261us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746787.750863:0:22618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788746787.751070:0:24944:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a4483590000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41310026-2b0a-472c-80e6-fbabf81d5070:24944:1875636324135680:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788746787.751081:0:24944:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1788746787.751092:0:24944:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788746787.751093:0:24944:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788746787.751094:0:24944:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788746787.751095:0:24944:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788746787.751097:0:24944:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788746787.751098:0:24944:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788746787.751099:0:24944:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788746787.751100:0:24944:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788746787.751102:0:24944:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788746787.751113:0:24944:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:1.0:1788746787.754798:0:22606:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788746787.754816:0:22606:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4483590a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:41310026-2b0a-472c-80e6-fbabf81d5070+3:22639:x1875636324135936:12345-0@lo:104: Request processed in 4554us (4771us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746787.754828:0:22606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:1.0:1788746787.754877:0:22612:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788746787.754886:0:22612:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.139@tcp lock: ffff8a44825c3200/0xfac36e89154147bc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xfac36e89154147c3 expref: -99 pid: 22620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746787.754898:0:22612:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a44825c3200 already unused, calling callback (ffffffffc1180c20) 10000000:00010000:1.0:1788746787.754903:0:22612:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.139@tcp lock: ffff8a44825c3200/0xfac36e89154147bc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xfac36e89154147c3 expref: -99 pid: 22620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746787.754914:0:22612:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.139@tcp lock: ffff8a44825c3200/0xfac36e89154147bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xfac36e89154147c3 expref: -99 pid: 22620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788746787.754921:0:22612:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.139@tcp lock: ffff8a44825c3200/0xfac36e89154147bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xfac36e89154147c3 expref: -99 pid: 22620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788746787.754926:0:22612:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788746787.754935:0:22611:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788746787.754980:0:22612:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.139@tcp lock: ffff8a44825c3200/0xfac36e89154147bc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfac36e89154147c3 expref: -99 pid: 22620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746787.754987:0:22612:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788746787.755013:0:22612:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.139@tcp lock: ffff8a44825c3200/0xfac36e89154147bc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfac36e89154147c3 expref: -99 pid: 22620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746787.755033:0:22612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.139@tcp lock: ffff8a44825c3200/0xfac36e89154147bc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfac36e89154147c3 expref: -99 pid: 22620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746787.755045:0:22612:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788746787.755047:0:22612:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788746787.755049:0:22612:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788746787.755061:0:22611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.139@tcp lock: ffff8a44825c2200/0xfac36e89154147ae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xfac36e89154147b5 expref: -99 pid: 22620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746787.755067:0:22611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a44825c2200 already unused, calling callback (ffffffffc1180c20) 10000000:00010000:0.0:1788746787.755070:0:22611:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.139@tcp lock: ffff8a44825c2200/0xfac36e89154147ae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xfac36e89154147b5 expref: -99 pid: 22620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788746787.755073:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a4483593b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:41310026-2b0a-472c-80e6-fbabf81d5070:3644:1875636324136064:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788746787.755077:0:22611:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.139@tcp lock: ffff8a44825c2200/0xfac36e89154147ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xfac36e89154147b5 expref: -99 pid: 22620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788746787.755083:0:22611:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.139@tcp lock: ffff8a44825c2200/0xfac36e89154147ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xfac36e89154147b5 expref: -99 pid: 22620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788746787.755088:0:22611:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788746787.755106:0:22611:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.139@tcp lock: ffff8a44825c2200/0xfac36e89154147ae lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfac36e89154147b5 expref: -99 pid: 22620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746787.755112:0:22611:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788746787.755131:0:22611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.139@tcp lock: ffff8a44825c2200/0xfac36e89154147ae lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfac36e89154147b5 expref: -99 pid: 22620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746787.755137:0:22611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.139@tcp lock: ffff8a44825c2200/0xfac36e89154147ae lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfac36e89154147b5 expref: -99 pid: 22620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788746787.755138:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788746787.755163:0:22611:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788746787.755165:0:22611:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788746787.755167:0:22611:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788746787.755199:0:22609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324136064 00000100:00100000:1.0:1788746787.755206:0:22609:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324136064 00000100:00100000:2.0:1788746787.755208:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788746787.755219:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a45c0ea4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:41310026-2b0a-472c-80e6-fbabf81d5070:3646:1875636324136192:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788746787.755237:0:22609:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a45c216d400/0xfac36e89154147c3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfac36e89154147bc expref: 24 pid: 22617 timeout: 817 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788746787.755250:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746787.755777:0:22609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324136192 00000100:00100000:1.0:1788746787.755784:0:22609:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324136192 00010000:00010000:1.0:1788746787.755799:0:22609:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a45c216d000/0xfac36e89154147b5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfac36e89154147ae expref: 25 pid: 22617 timeout: 817 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788746787.755816:0:22609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788746787.755825:0:22609:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4483590000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41310026-2b0a-472c-80e6-fbabf81d5070+25:3644:x1875636324136064:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788746787.755838:0:22609:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788746787.755842:0:22609:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a45c216d400/0xfac36e89154147c3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfac36e89154147bc expref: 25 pid: 22617 timeout: 817 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746787.755853:0:22609:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a45c216d400/0xfac36e89154147c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xfac36e89154147bc expref: 25 pid: 22617 timeout: 817 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746787.755867:0:22609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a45c216d400/0xfac36e89154147c3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xfac36e89154147bc expref: 25 pid: 22617 timeout: 817 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746787.755887:0:22609:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788746787.755926:0:22609:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4483590000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41310026-2b0a-472c-80e6-fbabf81d5070+24:3644:x1875636324136064:12345-0@lo:103:ldlm_bl.0 Request processed in 103us (788us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746787.755933:0:22609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788746787.755946:0:22609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788746787.755953:0:22609:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4484468700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41310026-2b0a-472c-80e6-fbabf81d5070+23:3646:x1875636324136192:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788746787.755960:0:22609:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788746787.755964:0:22609:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a45c216d000/0xfac36e89154147b5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfac36e89154147ae expref: 23 pid: 22617 timeout: 817 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746787.755973:0:22609:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a45c216d000/0xfac36e89154147b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xfac36e89154147ae expref: 23 pid: 22617 timeout: 817 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746787.755983:0:22609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a45c216d000/0xfac36e89154147b5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xfac36e89154147ae expref: 23 pid: 22617 timeout: 817 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746787.755993:0:22609:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a45ae45f000/0xfac36e8915414841 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746787.756002:0:22609:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a45ae45f000/0xfac36e8915414841 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788746787.756018:0:22609:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.006588047s 00010000:00010000:1.0:1788746787.756022:0:22609:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a45ae45f000/0xfac36e8915414841 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746787.756029:0:22609:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a45ae45f000/0xfac36e8915414841 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746787.756044:0:22609:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a45ae45f000/0xfac36e8915414841 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746787.756052:0:22609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a45ae45f000/0xfac36e8915414841 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746787.756057:0:22609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a45ae45f000 already unused, calling callback (ffffffffc0b5a8d0) 00010000:00010000:1.0:1788746787.756061:0:22609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a45ae45f000/0xfac36e8915414841 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746787.756068:0:22609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a45ae45f000/0xfac36e8915414841 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746787.756090:0:22609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a45ae45f000/0xfac36e8915414841 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746787.756101:0:22609:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788746787.756136:0:22609:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4484468700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41310026-2b0a-472c-80e6-fbabf81d5070+22:3646:x1875636324136192:12345-0@lo:103:ldlm_bl.0 Request processed in 183us (884us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746787.756142:0:22609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:0.0:1788746787.756177:0:22639:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a45ae45f000/0xfac36e8915414841 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746787.756186:0:22639:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a45ae45f000/0xfac36e8915414841 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788746787.756189:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a4483593b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:41310026-2b0a-472c-80e6-fbabf81d5070:3644:1875636324136064:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788746787.756193:0:22639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a45ae45f000/0xfac36e8915414841 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788746787.756244:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a45c0ea4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:41310026-2b0a-472c-80e6-fbabf81d5070:3646:1875636324136192:0@lo:103:ldlm_bl.0 00000001:00000004:3.0:1788746787.761860:0:24944:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 12884901888 00002000:00080000:2.0:1788746787.769886:0:24944:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:2.0:1788746787.769898:0:24944:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:2.0:1788746787.770012:0:24944:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788746787.770059:0:24944:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.139@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788746787.770082:0:24944:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=50 00000080:00000004:2.0:1788746787.770109:0:24944:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:2.0:1788746787.771087:0:24944:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788746787.771384:0:24944:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000040:00080000:3.0:1788746788.116025:0:23382:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:00000004:0.0:1788746788.692519:0:25010:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788746788.692872:0:25010:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1788746788.754705:0:3642:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788746767/real 1788746767] req@ffff8a4483cbea00 x1875636324122496/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788746787 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788746788.754736:0:3642:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8a4483cbea00 x1875636324122496/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788746787 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788746788.754747:0:3642:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788746767/real 1788746767] req@ffff8a4483cbdc00 x1875636324122624/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788746787 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788746788.754757:0:3642:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8a4483cbdc00 x1875636324122624/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788746787 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788746788.754777:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8a45b7e60000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788746788.754795:0:3642:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788746788.754799:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a4483cbea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1875636324122496:0@lo:8:kworker.0 00000100:00080000:0.0:1788746788.754806:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8a45bfe8d800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788746788.754821:0:3642:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788746788.754824:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a4483cbdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1875636324122624:0@lo:8:kworker.0 00000100:00080000:0.0:1788746788.754909:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788746788.754913:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1788746788.754915:0:36:0:(import.c:65:import_set_state_nolock()) ffff8a45b7e60000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788746788.754919:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 697 00000100:00080000:0.0:1788746788.754925:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1788746788.754946:0:36:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8a45b7e60000 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:0.0:1788746788.754967:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a45c0ea5f80 x1875636324136576/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788746788.754979:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788746788.754982:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788746788.754984:0:36:0:(import.c:65:import_set_state_nolock()) ffff8a45bfe8d800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788746788.754987:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 697 00000100:00080000:0.0:1788746788.754989:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1788746788.754993:0:36:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8a45bfe8d800 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:0.0:1788746788.755003:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a45c0ea4380 x1875636324136704/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788746788.755159:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788746788.755163:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788746788.755165:0:36:0:(import.c:65:import_set_state_nolock()) ffff8a45b7f9f000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788746788.755173:0:36:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8a45b7f9f000 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:0.0:1788746788.755188:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a45bca92300 x1875636324137216/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788746788.755255:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a45c0ea5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1875636324136576:0@lo:8:kworker.0 00000100:00100000:0.0:1788746788.755347:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746788.755385:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a45c0ea4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1875636324136704:0@lo:8:kworker.0 00000100:00100000:0.0:1788746788.755406:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746788.755422:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a45bca92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1875636324137216:0@lo:8:kworker.0 00000100:00100000:0.0:1788746788.755441:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746788.755470:0:24130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324136576 00000100:00100000:0.0:1788746788.755477:0:24130:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324136576 00000100:00100000:0.0:1788746788.755505:0:24130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324136704 00000100:00100000:0.0:1788746788.755508:0:24130:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324136704 00000100:00100000:0.0:1788746788.755516:0:24130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324137216 00000100:00100000:0.0:1788746788.755518:0:24130:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324137216 00000100:00100000:0.0:1788746788.755529:0:24130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788746788.755536:0:24130:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a45bca91f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3642:x1875636324136576:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1788746788.755564:0:24130:0:(ldlm_lib.c:1456:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 718 last 0 00000020:00000080:0.0:1788746788.755593:0:24130:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xfac36e8915414848 00002000:00100000:0.0:1788746788.755606:0:24130:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8a45b7e40800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1788746788.755610:0:24130:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:0.0:1788746788.755613:0:24130:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1788746788.755688:0:24130:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788746788.755712:0:24130:0:(import.c:65:import_set_state_nolock()) ffff8a45b7e46000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788746788.755761:0:24130:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a45bca91f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3642:x1875636324136576:12345-0@lo:8:kworker.0 Request processed in 223us (414us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746788.755769:0:24130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788746788.755786:0:24130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788746788.755791:0:24130:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4483ddb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3642:x1875636324136704:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1788746788.755816:0:24130:0:(ldlm_lib.c:1456:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 718 last 0 00000020:00000080:0.0:1788746788.755832:0:24130:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xfac36e891541484f 00002000:00100000:0.0:1788746788.755839:0:24130:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8a45b7e47800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1788746788.755842:0:24130:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:0.0:1788746788.755844:0:24130:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:2.0:1788746788.756310:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a45c0ea6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:41310026-2b0a-472c-80e6-fbabf81d5070:3646:1875636324136320:0@lo:400:kworker.0 00000100:00100000:2.0:1788746788.756351:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788746788.756379:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a45c0ea4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875636324137088:0@lo:400:kworker.0 00000100:00100000:2.0:1788746788.756403:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788746788.756415:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a45bca91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3646:1875636324137728:0@lo:400:kworker.0 00000100:00100000:2.0:1788746788.756436:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788746788.756458:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1788746788.756464:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a45c0ea5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875636324136960:0@lo:400:kworker.0 00000100:00100000:2.0:1788746788.756485:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788746788.756511:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a45bca91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3646:1875636324137600:0@lo:400:kworker.0 00000100:00100000:2.0:1788746788.756533:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788746788.756829:0:22623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324137728 00000100:00100000:2.0:1788746788.756837:0:22623:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324137728 00000100:00100000:2.0:1788746788.756884:0:22623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324137600 00000100:00100000:2.0:1788746788.756887:0:22623:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324137600 00000100:00100000:2.0:1788746788.756902:0:22623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788746788.756908:0:22623:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4484468e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875636324137728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788746788.756964:0:22623:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4484468e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875636324137728:12345-0@lo:400:kworker.0 Request processed in 56us (527us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746788.756971:0:22623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788746788.756985:0:22623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788746788.756992:0:22623:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4484468a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875636324137600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788746788.757040:0:22623:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4484468a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875636324137600:12345-0@lo:400:kworker.0 Request processed in 47us (504us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746788.757046:0:22623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:2.0:1788746788.757096:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a45bca91500 x1875636324137600/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788746804 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788746788.757108:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a45bca91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3646:1875636324137600:0@lo:400:kworker.0 00010000:00080000:2.0:1788746788.757118:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a45bca91c00 x1875636324137728/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788746804 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788746788.757127:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a45bca91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3646:1875636324137728:0@lo:400:kworker.0 00000100:00100000:1.0:1788746788.757388:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a45c0ea7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875636324136448:0@lo:400:kworker.0 00000100:00100000:1.0:1788746788.757421:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746788.757447:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a45bca91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875636324137344:0@lo:400:kworker.0 00000100:00100000:1.0:1788746788.757466:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746788.757485:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a45bca90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3643:1875636324137856:0@lo:400:kworker.0 00000100:00100000:1.0:1788746788.757508:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746788.757536:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788746788.757543:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a45c0ea6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875636324136832:0@lo:400:kworker.0 00000100:00100000:1.0:1788746788.757566:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746788.757584:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a45bca92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3643:1875636324137472:0@lo:400:kworker.0 00000100:00100000:1.0:1788746788.757604:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746788.757627:0:24129:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324137088 00000100:00100000:1.0:1788746788.757632:0:24129:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324137088 00000100:00100000:1.0:1788746788.757655:0:24129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788746788.757663:0:24129:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4484468000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875636324137088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788746788.757701:0:24129:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4484468000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875636324137088:12345-0@lo:400:kworker.0 Request processed in 39us (1297us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746788.757708:0:24129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788746788.757721:0:24129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788746788.757725:0:24129:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4483ddaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3642:x1875636324137216:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1788746788.757748:0:24129:0:(ldlm_lib.c:1456:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 718 last 0 00000020:00000080:1.0:1788746788.757773:0:24129:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xfac36e8915414856 00002000:00100000:1.0:1788746788.757783:0:24129:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff8a4591094800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:1.0:1788746788.757787:0:24129:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00002000:00100000:1.0:1788746788.757789:0:24129:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1788746788.757845:0:24129:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:1.0:1788746788.757866:0:24129:0:(import.c:65:import_set_state_nolock()) ffff8a45b0c9d000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788746788.757899:0:24129:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4483ddaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3642:x1875636324137216:12345-0@lo:8:kworker.0 Request processed in 172us (2456us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746788.757905:0:24129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:1.0:1788746788.757943:0:22619:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788746788.757983:0:22612:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788746788.757993:0:22625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324137344 00000100:00100000:1.0:1788746788.758003:0:22625:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324137344 00000100:00100000:1.0:1788746788.758020:0:22625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324137856 00000100:00100000:1.0:1788746788.758022:0:22625:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324137856 00000100:00100000:1.0:1788746788.758160:0:22625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324136832 00000100:00100000:1.0:1788746788.758164:0:22625:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324136832 00000100:00100000:1.0:1788746788.758180:0:22625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324137472 00000100:00100000:1.0:1788746788.758183:0:22625:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324137472 00000100:00100000:1.0:1788746788.758196:0:22625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788746788.758201:0:22625:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4483591c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875636324137344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788746788.758238:0:22625:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4483591c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875636324137344:12345-0@lo:400:kworker.0 Request processed in 36us (771us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746788.758244:0:22625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788746788.758257:0:22625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788746788.758262:0:22625:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4483591880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875636324137856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788746788.758334:0:22625:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4483591880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875636324137856:12345-0@lo:400:kworker.0 Request processed in 71us (824us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746788.758341:0:22625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788746788.758353:0:22625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788746788.758359:0:22625:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4482712680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875636324136832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788746788.758382:0:22625:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4482712680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875636324136832:12345-0@lo:400:kworker.0 Request processed in 25us (816us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746788.758387:0:22625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788746788.758396:0:22625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788746788.758401:0:22625:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4483cbdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875636324137472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788746788.758418:0:22625:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4483cbdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875636324137472:12345-0@lo:400:kworker.0 Request processed in 18us (814us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746788.758423:0:22625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:1.0:1788746788.758444:0:22619:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1788746788.758463:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a45c0ea6680 x1875636324136832/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788746804 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788746788.758474:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a45c0ea6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875636324136832:0@lo:400:kworker.0 00010000:00080000:1.0:1788746788.758482:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a45bca92680 x1875636324137472/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788746804 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788746788.758489:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a45bca92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3643:1875636324137472:0@lo:400:kworker.0 00010000:00080000:1.0:1788746788.758497:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a45bca91880 x1875636324137344/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788746804 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788746788.758504:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a45bca91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875636324137344:0@lo:400:kworker.0 00010000:00080000:1.0:1788746788.758511:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a45bca90000 x1875636324137856/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788746804 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788746788.758518:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a45bca90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3643:1875636324137856:0@lo:400:kworker.0 00010000:00080000:1.0:1788746788.758550:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a45c0ea4a80 x1875636324137088/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788746804 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788746788.758558:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a45c0ea4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875636324137088:0@lo:400:kworker.0 00002000:00080000:0.0:1788746788.758745:0:24130:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788746788.758765:0:24130:0:(import.c:65:import_set_state_nolock()) ffff8a45b7e40000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788746788.758794:0:24130:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4483ddb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3642:x1875636324136704:12345-0@lo:8:kworker.0 Request processed in 3002us (3387us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746788.758801:0:24130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788746788.758831:0:22615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324136320 00000100:00100000:0.0:1788746788.758835:0:22615:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324136320 00000100:00100000:0.0:1788746788.758868:0:22615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788746788.758875:0:22615:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4585855450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41310026-2b0a-472c-80e6-fbabf81d5070+22:3646:x1875636324136320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788746788.758904:0:22615:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4585855450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41310026-2b0a-472c-80e6-fbabf81d5070+22:3646:x1875636324136320:12345-0@lo:400:kworker.0 Request processed in 30us (2553us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746788.758909:0:22615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00010000:00080000:0.0:1788746788.759160:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a45c0ea5f80 x1875636324136576/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788746813 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788746788.759169:0:3642:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788746788.759178:0:3642:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 3 00000100:00080000:0.0:1788746788.759185:0:3642:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1788746788.759191:0:3642:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1788746788.759194:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8a45b7e60000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1788746788.759208:0:3642:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1788746788.759212:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a45c0ea5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1875636324136576:0@lo:8:kworker.0 00010000:00080000:0.0:1788746788.759232:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a45c0ea4380 x1875636324136704/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788746813 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788746788.759238:0:3642:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788746788.759242:0:3642:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 3 00000100:00080000:0.0:1788746788.759247:0:3642:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1788746788.759250:0:3642:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1788746788.759252:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8a45bfe8d800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1788746788.759265:0:3642:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1788746788.759268:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a45c0ea4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1875636324136704:0@lo:8:kworker.0 00010000:00080000:0.0:1788746788.759305:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a45bca92300 x1875636324137216/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788746813 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788746788.759315:0:3642:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 3 00000100:00080000:0.0:1788746788.759319:0:3642:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1788746788.759323:0:3642:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1788746788.759325:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8a45b7f9f000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1788746788.759335:0:3642:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1788746788.759339:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a45bca92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1875636324137216:0@lo:8:kworker.0 00000004:00080000:0.0:1788746788.759389:0:22648:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x5:0x0] 00000100:00100000:0.0:1788746788.759405:0:22648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a4483dd9880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22648:1875636324138112:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1788746788.759432:0:22648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746788.759447:0:22648:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a45b8787240 going to sleep for 11 seconds 00000004:00080000:1.0:1788746788.759952:0:22650:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x22:0x0] 00000100:00100000:1.0:1788746788.759965:0:22650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a4483cbd880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22650:1875636324138368:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1788746788.759997:0:22650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746788.760015:0:22650:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a45bc98e9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788746788.760194:0:22628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324136960 00000100:00100000:2.0:1788746788.760202:0:22628:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324136960 00000100:00100000:2.0:1788746788.760237:0:22628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324136448 00000100:00100000:2.0:1788746788.760241:0:22628:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324136448 00000100:00100000:2.0:1788746788.760256:0:22628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788746788.760263:0:22628:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4484468380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875636324136960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788746788.760348:0:22628:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4484468380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875636324136960:12345-0@lo:400:kworker.0 Request processed in 86us (3861us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746788.760355:0:22628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788746788.760372:0:22628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788746788.760379:0:22628:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4483593b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1875636324136448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788746788.760407:0:22628:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4483593b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1875636324136448:12345-0@lo:400:kworker.0 Request processed in 30us (2987us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746788.760413:0:22628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000004:00080000:2.0:1788746788.760432:0:22647:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1788746788.760517:0:22647:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 718501229571ns, next at 0ns, rc = 0 00080000:00080000:2.0:1788746788.760523:0:22647:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:1.0:1788746788.760612:0:23367:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1788746788.760657:0:23367:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 718501369791ns, next at 0ns, rc = 0 00080000:00080000:1.0:1788746788.760662:0:23367:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:1.0:1788746788.761268:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a4483dd9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875636324137984:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788746788.761341:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746788.761380:0:24133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324137984 00000100:00100000:1.0:1788746788.761386:0:24133:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324137984 00000100:00100000:1.0:1788746788.761426:0:24133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788746788.761432:0:24133:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a45c0ea4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3644:x1875636324137984:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788746788.761455:0:24133:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788746788.761488:0:24133:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a45c0ea4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3644:x1875636324137984:12345-0@lo:13:osp-pre-0-0.0 Request processed in 56us (147us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746788.761494:0:24133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1788746788.761524:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a4483dd9c00 x1875636324137984/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788746804 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788746788.761541:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a4483dd9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875636324137984:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788746788.761558:0:22619:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788746788.761578:0:24129:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324138112 00000100:00100000:1.0:1788746788.761582:0:24129:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324138112 00000100:00100000:1.0:1788746788.761603:0:24129:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324138368 00000100:00100000:1.0:1788746788.761606:0:24129:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324138368 00000100:00100000:1.0:1788746788.761626:0:24129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788746788.761631:0:24129:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4483dd9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:22648:x1875636324138112:12345-0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1788746788.761812:0:24131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788746788.761820:0:24131:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4483cbe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:22650:x1875636324138368:12345-0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1788746788.762066:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a4483cbea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875636324138240:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788746788.762098:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1788746788.762126:0:22649:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1788746788.762185:0:22649:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 718502897854ns, next at 0ns, rc = 0 00080000:00080000:3.0:1788746788.762190:0:22649:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:3.0:1788746788.762230:0:23368:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:3.0:1788746788.762246:0:23368:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a4484488700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23368:1875636324138624:0@lo:7:osp-pre-1-1.0 00000100:00100000:3.0:1788746788.762269:0:23368:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746788.762278:0:23368:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a4484498f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788746788.762312:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788746788.762320:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a448448b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875636324138496:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788746788.762341:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746788.767332:0:24665:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:1.0:1788746788.767345:0:24665:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00000100:00100000:1.0:1788746788.767384:0:24134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324138240 00000100:00100000:1.0:1788746788.767394:0:24134:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324138240 00000100:00100000:1.0:1788746788.767428:0:24134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324138496 00000100:00100000:1.0:1788746788.767437:0:24134:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324138496 00000100:00100000:1.0:1788746788.767457:0:24134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788746788.767465:0:24134:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4484489f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3645:x1875636324138240:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788746788.767489:0:24134:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3915866112 avail 3684343808 00000100:00100000:1.0:1788746788.767568:0:24134:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4484489f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3645:x1875636324138240:12345-0@lo:13:osp-pre-1-0.0 Request processed in 103us (5468us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746788.767575:0:24134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788746788.767592:0:24134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788746788.767597:0:24134:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4484488380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3645:x1875636324138496:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788746788.767605:0:24134:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3915866112 avail 3684343808 00000100:00100000:1.0:1788746788.767624:0:24134:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4484488380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3645:x1875636324138496:12345-0@lo:13:osp-pre-1-1.0 Request processed in 27us (5282us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746788.767629:0:24134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:1.0:1788746788.767643:0:22619:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788746788.767745:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a45c0ea7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875636324136448:0@lo:400:kworker.0 00000100:00100000:1.0:1788746788.767785:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a45c0ea5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875636324136960:0@lo:400:kworker.0 00000100:00100000:1.0:1788746788.767795:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a45c0ea6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:41310026-2b0a-472c-80e6-fbabf81d5070:3646:1875636324136320:0@lo:400:kworker.0 00000100:00100000:1.0:1788746788.767815:0:24130:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:1.0:1788746788.767821:0:24130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324138624 00000100:00100000:1.0:1788746788.767824:0:24130:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324138624 00010000:00080000:3.0:1788746788.768139:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a448448b480 x1875636324138496/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788746804 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788746788.768157:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a448448b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875636324138496:0@lo:13:osp-pre-1-1.0 00010000:00080000:3.0:1788746788.768168:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a4483cbea00 x1875636324138240/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788746804 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788746788.768179:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a4483cbea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875636324138240:0@lo:13:osp-pre-1-0.0 00000004:00080000:2.0:1788746788.770451:0:23357:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00002000:00080000:1.0:1788746788.771263:0:24129:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:1.0:1788746788.771273:0:24129:0:(ofd_dev.c:1642:ofd_create_hdl()) ofd_last_id() = 65 -> diff = -60 00002000:02000040:1.0:1788746788.771305:0:24129:0:(ofd_dev.c:1493:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:6 to 0x280000401:65) 00000004:00080000:3.0:1788746788.773406:0:22603:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000100:00100000:2.0:1788746788.774008:0:25016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788746788.774023:0:25016:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4484489c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+6:23368:x1875636324138624:12345-0@lo:7:osp-pre-1-1.0 00002000:00080000:3.0:1788746788.775616:0:24131:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:3.0:1788746788.775624:0:24131:0:(ofd_dev.c:1642:ofd_create_hdl()) ofd_last_id() = 65 -> diff = -31 00002000:02000040:3.0:1788746788.775629:0:24131:0:(ofd_dev.c:1493:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:35 to 0x2c0000401:65) 00002000:00080000:2.0:1788746788.784942:0:25016:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:2.0:1788746788.784956:0:25016:0:(ofd_dev.c:1210:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x41:0x0] 00000100:00100000:2.0:1788746788.785335:0:25016:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4484489c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+6:23368:x1875636324138624:12345-0@lo:7:osp-pre-1-1.0 Request processed in 11313us (23060us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746788.785347:0:25016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000004:00080000:2.0:1788746788.785396:0:22603:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00010000:00080000:2.0:1788746788.790425:0:23368:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a4484488700 x1875636324138624/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788746804 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788746788.790444:0:23368:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a4484488700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23368:1875636324138624:0@lo:7:osp-pre-1-1.0 00000004:00080000:2.0:1788746788.790461:0:23368:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x41:0x0] 00000100:00100000:2.0:1788746788.790507:0:23368:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a448446b480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23368:1875636324138752:0@lo:5:osp-pre-1-1.0 00000100:00100000:2.0:1788746788.790566:0:23368:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788746788.790614:0:23368:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a45a90d4b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788746788.790701:0:24130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324138752 00000100:00100000:1.0:1788746788.790708:0:24130:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324138752 00000100:00100000:1.0:1788746788.790807:0:24130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788746788.790816:0:24130:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4484469c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:23368:x1875636324138752:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:1.0:1788746788.790850:0:24130:0:(ofd_dev.c:1642:ofd_create_hdl()) ofd_last_id() = 65 -> diff = 0 00000100:00100000:1.0:1788746788.790895:0:24130:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4484469c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:23368:x1875636324138752:12345-0@lo:5:osp-pre-1-1.0 Request processed in 80us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746788.790902:0:24130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00002000:00010000:3.0:1788746788.794865:0:24131:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788746788.794879:0:24131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000094f076bb/0xfac36e891541485d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746788.794909:0:24131:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x41:0x0].0x0 since=718s v=(0 0) 00010000:00010000:3.0:1788746788.794914:0:24131:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x41:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788746788.795095:0:24131:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000094f076bb/0xfac36e891541485d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746788.795117:0:24131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000094f076bb/0xfac36e891541485d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746788.795129:0:24131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000094f076bb/0xfac36e891541485d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746788.795137:0:24131:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000094f076bb/0xfac36e891541485d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746788.795161:0:24131:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788746788.795173:0:22611:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788746788.795179:0:22611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000094f076bb/0xfac36e891541485d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746788.795187:0:22611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a45c216ca00 already unused, calling callback (ffffffffc0b5a8d0) 00010000:00010000:3.0:1788746788.795192:0:22611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000094f076bb/0xfac36e891541485d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746788.795202:0:22611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000094f076bb/0xfac36e891541485d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746788.795232:0:22611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000094f076bb/0xfac36e891541485d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746788.795240:0:22611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000094f076bb/0xfac36e891541485d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746788.795260:0:22611:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788746788.795262:0:22611:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788746788.795264:0:22611:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788746788.796157:0:24131:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788746788.796167:0:24131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000057f38603/0xfac36e8915414864 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746788.796179:0:24131:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x40:0x0].0x0 since=718s v=(0 0) 00010000:00010000:3.0:1788746788.796182:0:24131:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788746788.796186:0:24131:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000057f38603/0xfac36e8915414864 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746788.796195:0:24131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000057f38603/0xfac36e8915414864 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746788.796204:0:24131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000057f38603/0xfac36e8915414864 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746788.796211:0:24131:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000057f38603/0xfac36e8915414864 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746788.796319:0:24131:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00080000:1.0:1788746788.797006:0:23368:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a448446b480 x1875636324138752/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788746804 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788746788.797022:0:23368:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a448446b480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23368:1875636324138752:0@lo:5:osp-pre-1-1.0 00000004:00080000:1.0:1788746788.797197:0:23368:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x41:0x0] from OST, last_created [0x2c0000400:0x41:0x0]last_used is [0x2c0000400:0x41:0x0] 00000100:00100000:1.0:1788746788.797247:0:23368:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a45c0ea6300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23368:1875636324138880:0@lo:5:osp-pre-1-1.0 00000100:00100000:1.0:1788746788.797340:0:23368:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746788.797375:0:23368:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a45ac68fa80 going to sleep for 11 seconds 00002000:00010000:1.0:1788746788.799317:0:24129:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788746788.799333:0:24129:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008bac3af1/0xfac36e891541486b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746788.799351:0:24129:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x41:0x0].0x0 since=718s v=(0 0) 00010000:00010000:1.0:1788746788.799356:0:24129:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x41:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788746788.799362:0:24129:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008bac3af1/0xfac36e891541486b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746788.799382:0:24129:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008bac3af1/0xfac36e891541486b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746788.799395:0:24129:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008bac3af1/0xfac36e891541486b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746788.799415:0:24129:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008bac3af1/0xfac36e891541486b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788746788.801150:0:25016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324138880 00000100:00100000:0.0:1788746788.801167:0:25016:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324138880 00000100:00100000:0.0:1788746788.801244:0:24665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788746788.801257:0:24665:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a45c0ea5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:23368:x1875636324138880:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:0.0:1788746788.801351:0:24665:0:(ofd_dev.c:1749:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 66 00010000:00010000:2.0:1788746788.803126:0:22612:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788746788.803138:0:22612:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000057f38603/0xfac36e8915414864 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746788.803153:0:22612:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a45c216c400 already unused, calling callback (ffffffffc0b5a8d0) 00010000:00010000:2.0:1788746788.803158:0:22612:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000057f38603/0xfac36e8915414864 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746788.803170:0:22612:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000057f38603/0xfac36e8915414864 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746788.803194:0:22612:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000057f38603/0xfac36e8915414864 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746788.803212:0:22612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000057f38603/0xfac36e8915414864 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746788.803239:0:22612:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788746788.803243:0:22612:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008bac3af1/0xfac36e891541486b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746788.803250:0:22612:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a45ae45f200 already unused, calling callback (ffffffffc0b5a8d0) 00010000:00010000:2.0:1788746788.803254:0:22612:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008bac3af1/0xfac36e891541486b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746788.803261:0:22612:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008bac3af1/0xfac36e891541486b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746788.803272:0:22612:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008bac3af1/0xfac36e891541486b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746788.803303:0:22612:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788746788.803305:0:22612:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788746788.803307:0:22612:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788746788.804685:0:24131:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788746788.804696:0:24131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a8a6158e/0xfac36e8915414872 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746788.804712:0:24131:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3f:0x0].0x0 since=718s v=(0 0) 00010000:00010000:0.0:1788746788.804717:0:24131:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788746788.804723:0:24131:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a8a6158e/0xfac36e8915414872 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746788.804738:0:24131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a8a6158e/0xfac36e8915414872 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746788.804747:0:24131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a8a6158e/0xfac36e8915414872 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746788.804756:0:24131:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a8a6158e/0xfac36e8915414872 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746788.804780:0:24131:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788746788.805117:0:22611:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788746788.805124:0:22611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a8a6158e/0xfac36e8915414872 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746788.805133:0:22611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a44825c2200 already unused, calling callback (ffffffffc0b5a8d0) 00010000:00010000:2.0:1788746788.805146:0:22611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a8a6158e/0xfac36e8915414872 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746788.805155:0:22611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a8a6158e/0xfac36e8915414872 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746788.805169:0:22611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a8a6158e/0xfac36e8915414872 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746788.805175:0:22611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a8a6158e/0xfac36e8915414872 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746788.805193:0:22611:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788746788.805194:0:22611:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788746788.805196:0:22611:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788746788.806178:0:24131:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788746788.806187:0:24131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b35efffe/0xfac36e8915414879 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746788.806199:0:24131:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3e:0x0].0x0 since=718s v=(0 0) 00010000:00010000:0.0:1788746788.806202:0:24131:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788746788.806207:0:24131:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b35efffe/0xfac36e8915414879 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746788.806224:0:24131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b35efffe/0xfac36e8915414879 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746788.806234:0:24131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b35efffe/0xfac36e8915414879 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746788.806242:0:24131:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b35efffe/0xfac36e8915414879 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746788.806260:0:24131:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788746788.806516:0:22612:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788746788.806523:0:22612:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b35efffe/0xfac36e8915414879 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746788.806532:0:22612:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a44825c2a00 already unused, calling callback (ffffffffc0b5a8d0) 00010000:00010000:2.0:1788746788.806536:0:22612:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b35efffe/0xfac36e8915414879 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746788.806545:0:22612:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b35efffe/0xfac36e8915414879 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746788.806560:0:22612:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b35efffe/0xfac36e8915414879 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746788.806573:0:22612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b35efffe/0xfac36e8915414879 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746788.806588:0:22612:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788746788.806590:0:22612:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788746788.806591:0:22612:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788746788.806713:0:24129:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788746788.806721:0:24129:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008bac3af1/0xfac36e891541486b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746788.807360:0:22611:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788746788.808006:0:24129:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788746788.808015:0:24129:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aeb6a59c/0xfac36e8915414880 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746788.808096:0:24129:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x40:0x0].0x0 since=718s v=(0 0) 00010000:00010000:1.0:1788746788.808102:0:24129:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788746788.808107:0:24129:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aeb6a59c/0xfac36e8915414880 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746788.808121:0:24129:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000aeb6a59c/0xfac36e8915414880 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746788.808131:0:24129:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aeb6a59c/0xfac36e8915414880 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746788.808138:0:24129:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000aeb6a59c/0xfac36e8915414880 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746788.808174:0:24129:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788746788.808433:0:24131:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788746788.808439:0:24131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000833d432b/0xfac36e8915414887 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746788.808448:0:24131:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3d:0x0].0x0 since=718s v=(0 0) 00010000:00010000:2.0:1788746788.808451:0:24131:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788746788.808455:0:24131:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000833d432b/0xfac36e8915414887 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746788.808465:0:24131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000833d432b/0xfac36e8915414887 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746788.808472:0:24131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000833d432b/0xfac36e8915414887 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746788.808577:0:22612:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788746788.808584:0:22612:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000aeb6a59c/0xfac36e8915414880 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746788.808593:0:22612:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a45ae45f000 already unused, calling callback (ffffffffc0b5a8d0) 00010000:00010000:0.0:1788746788.808597:0:22612:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000aeb6a59c/0xfac36e8915414880 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746788.808606:0:22612:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000aeb6a59c/0xfac36e8915414880 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746788.808626:0:22612:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000aeb6a59c/0xfac36e8915414880 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746788.808634:0:22612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aeb6a59c/0xfac36e8915414880 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746788.808659:0:22612:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788746788.808660:0:22612:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788746788.808663:0:22612:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788746788.808687:0:24131:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000833d432b/0xfac36e8915414887 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746788.808709:0:24131:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788746788.809351:0:22611:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788746788.809358:0:22611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000833d432b/0xfac36e8915414887 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746788.809368:0:22611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a4581688c00 already unused, calling callback (ffffffffc0b5a8d0) 00010000:00010000:0.0:1788746788.809372:0:22611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000833d432b/0xfac36e8915414887 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746788.809380:0:22611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000833d432b/0xfac36e8915414887 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746788.809393:0:22611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000833d432b/0xfac36e8915414887 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746788.809401:0:22611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000833d432b/0xfac36e8915414887 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746788.809420:0:22611:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788746788.809421:0:22611:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788746788.809423:0:22611:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788746788.812229:0:24129:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788746788.812242:0:24129:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c0b856a6/0xfac36e891541488e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746788.812260:0:24129:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3f:0x0].0x0 since=718s v=(0 0) 00010000:00010000:1.0:1788746788.812265:0:24129:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788746788.812271:0:24129:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c0b856a6/0xfac36e891541488e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746788.812307:0:24129:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c0b856a6/0xfac36e891541488e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746788.812318:0:24129:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c0b856a6/0xfac36e891541488e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746788.812327:0:24129:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c0b856a6/0xfac36e891541488e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746788.812347:0:24129:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788746788.812358:0:22612:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788746788.812363:0:22612:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c0b856a6/0xfac36e891541488e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746788.812371:0:22612:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a45ae45e000 already unused, calling callback (ffffffffc0b5a8d0) 00010000:00010000:1.0:1788746788.812382:0:22612:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c0b856a6/0xfac36e891541488e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746788.812391:0:22612:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c0b856a6/0xfac36e891541488e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746788.812407:0:22612:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c0b856a6/0xfac36e891541488e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746788.812415:0:22612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c0b856a6/0xfac36e891541488e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746788.812432:0:22612:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788746788.812433:0:22612:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788746788.812435:0:22612:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788746788.813499:0:24129:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788746788.813507:0:24129:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000098b4c6d7/0xfac36e8915414895 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746788.813519:0:24129:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3e:0x0].0x0 since=718s v=(0 0) 00010000:00010000:1.0:1788746788.813523:0:24129:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788746788.813527:0:24129:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000098b4c6d7/0xfac36e8915414895 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746788.813537:0:24129:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000098b4c6d7/0xfac36e8915414895 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746788.813545:0:24129:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000098b4c6d7/0xfac36e8915414895 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746788.813559:0:24129:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000098b4c6d7/0xfac36e8915414895 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746788.813580:0:24129:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788746788.813746:0:22611:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788746788.813753:0:22611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000098b4c6d7/0xfac36e8915414895 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746788.813760:0:22611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a45ae45e200 already unused, calling callback (ffffffffc0b5a8d0) 00010000:00010000:2.0:1788746788.813764:0:22611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000098b4c6d7/0xfac36e8915414895 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746788.813773:0:22611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000098b4c6d7/0xfac36e8915414895 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746788.813787:0:22611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000098b4c6d7/0xfac36e8915414895 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746788.813794:0:22611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000098b4c6d7/0xfac36e8915414895 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746788.813813:0:22611:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788746788.813815:0:22611:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788746788.813817:0:22611:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788746788.816130:0:24129:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788746788.816143:0:24129:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e55e37de/0xfac36e891541489c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746788.816160:0:24129:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3d:0x0].0x0 since=718s v=(0 0) 00010000:00010000:1.0:1788746788.816164:0:24129:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788746788.816169:0:24129:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e55e37de/0xfac36e891541489c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746788.816182:0:24129:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e55e37de/0xfac36e891541489c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746788.816192:0:24129:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e55e37de/0xfac36e891541489c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746788.816200:0:24129:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e55e37de/0xfac36e891541489c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746788.816229:0:24129:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788746788.816512:0:22612:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788746788.816520:0:22612:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e55e37de/0xfac36e891541489c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746788.816528:0:22612:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a45b7f95600 already unused, calling callback (ffffffffc0b5a8d0) 00010000:00010000:2.0:1788746788.816532:0:22612:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e55e37de/0xfac36e891541489c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746788.816552:0:22612:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e55e37de/0xfac36e891541489c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746788.816569:0:22612:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e55e37de/0xfac36e891541489c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746788.816576:0:22612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e55e37de/0xfac36e891541489c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746788.816593:0:22612:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788746788.816594:0:22612:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788746788.816596:0:22612:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788746788.817730:0:24129:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788746788.817740:0:24129:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000089b4464b/0xfac36e89154148a3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746788.817762:0:24129:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3c:0x0].0x0 since=718s v=(0 0) 00010000:00010000:1.0:1788746788.817765:0:24129:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788746788.817771:0:24129:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000089b4464b/0xfac36e89154148a3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746788.817784:0:24129:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000089b4464b/0xfac36e89154148a3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746788.817792:0:24129:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000089b4464b/0xfac36e89154148a3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746788.817799:0:24129:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000089b4464b/0xfac36e89154148a3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746788.817816:0:24129:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788746788.818608:0:22611:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788746788.818616:0:22611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000089b4464b/0xfac36e89154148a3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746788.818626:0:22611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a45b7f94e00 already unused, calling callback (ffffffffc0b5a8d0) 00010000:00010000:2.0:1788746788.818630:0:22611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000089b4464b/0xfac36e89154148a3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746788.818639:0:22611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000089b4464b/0xfac36e89154148a3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746788.818655:0:22611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000089b4464b/0xfac36e89154148a3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746788.818673:0:22611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000089b4464b/0xfac36e89154148a3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746788.818689:0:22611:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788746788.818690:0:22611:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788746788.818692:0:22611:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788746788.819336:0:24129:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788746788.819344:0:24129:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fc780001/0xfac36e89154148aa lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746788.819356:0:24129:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3b:0x0].0x0 since=718s v=(0 0) 00010000:00010000:2.0:1788746788.819360:0:24129:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788746788.819366:0:24129:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fc780001/0xfac36e89154148aa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746788.819376:0:24129:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fc780001/0xfac36e89154148aa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746788.819384:0:24129:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fc780001/0xfac36e89154148aa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746788.819391:0:24129:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fc780001/0xfac36e89154148aa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746788.819422:0:24129:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788746788.819430:0:22612:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788746788.819441:0:22612:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fc780001/0xfac36e89154148aa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746788.819448:0:22612:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a4581689e00 already unused, calling callback (ffffffffc0b5a8d0) 00010000:00010000:2.0:1788746788.819452:0:22612:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fc780001/0xfac36e89154148aa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746788.819460:0:22612:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fc780001/0xfac36e89154148aa lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746788.819473:0:22612:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fc780001/0xfac36e89154148aa lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746788.820003:0:22612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fc780001/0xfac36e89154148aa lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746788.820020:0:22612:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788746788.820022:0:22612:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788746788.820091:0:22612:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788746788.821219:0:24129:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788746788.821229:0:24129:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c16a8865/0xfac36e89154148b1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746788.821241:0:24129:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3a:0x0].0x0 since=718s v=(0 0) 00010000:00010000:1.0:1788746788.821245:0:24129:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788746788.821251:0:24129:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c16a8865/0xfac36e89154148b1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746788.821262:0:24129:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c16a8865/0xfac36e89154148b1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746788.821310:0:24129:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c16a8865/0xfac36e89154148b1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746788.821318:0:24129:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c16a8865/0xfac36e89154148b1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746788.821337:0:24129:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788746788.821841:0:24131:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788746788.821849:0:24131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000059802833/0xfac36e89154148b8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746788.821868:0:24131:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3c:0x0].0x0 since=718s v=(0 0) 00010000:00010000:0.0:1788746788.821871:0:24131:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788746788.821875:0:24131:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000059802833/0xfac36e89154148b8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746788.821885:0:24131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000059802833/0xfac36e89154148b8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746788.821893:0:24131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000059802833/0xfac36e89154148b8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746788.821900:0:24131:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000059802833/0xfac36e89154148b8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746788.823771:0:24131:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1788746788.824624:0:24131:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788746788.824634:0:24131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000081537fb/0xfac36e89154148bf lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746788.824652:0:24131:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3b:0x0].0x0 since=718s v=(0 0) 00010000:00010000:0.0:1788746788.824656:0:24131:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788746788.824661:0:24131:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000081537fb/0xfac36e89154148bf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746788.824677:0:24131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000081537fb/0xfac36e89154148bf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746788.824699:0:24131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000081537fb/0xfac36e89154148bf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746788.824707:0:24131:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000081537fb/0xfac36e89154148bf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746788.824844:0:22611:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788746788.824853:0:22611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c16a8865/0xfac36e89154148b1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746788.824862:0:22611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a45b7f95000 already unused, calling callback (ffffffffc0b5a8d0) 00010000:00010000:2.0:1788746788.824867:0:22611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c16a8865/0xfac36e89154148b1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746788.824887:0:22611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c16a8865/0xfac36e89154148b1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746788.824903:0:22611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c16a8865/0xfac36e89154148b1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746788.824910:0:22611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c16a8865/0xfac36e89154148b1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746788.827085:0:22611:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788746788.827096:0:22611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000059802833/0xfac36e89154148b8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746788.827109:0:22611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a44825c2600 already unused, calling callback (ffffffffc0b5a8d0) 00010000:00010000:2.0:1788746788.827113:0:22611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000059802833/0xfac36e89154148b8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746788.827124:0:22611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000059802833/0xfac36e89154148b8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746788.827144:0:22611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000059802833/0xfac36e89154148b8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746788.827151:0:22611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000059802833/0xfac36e89154148b8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746788.827180:0:22611:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788746788.827184:0:22611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000081537fb/0xfac36e89154148bf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746788.827190:0:22611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a44825c3800 already unused, calling callback (ffffffffc0b5a8d0) 00010000:00010000:2.0:1788746788.827193:0:22611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000081537fb/0xfac36e89154148bf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746788.827200:0:22611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000081537fb/0xfac36e89154148bf lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746788.827209:0:22611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000081537fb/0xfac36e89154148bf lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746788.827215:0:22611:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788746788.827217:0:22611:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788746788.827220:0:22611:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788746788.828188:0:22612:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788746788.828350:0:24129:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788746788.828359:0:24129:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000089a303cc/0xfac36e89154148c6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746788.828374:0:24129:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x39:0x0].0x0 since=718s v=(0 0) 00010000:00010000:1.0:1788746788.828378:0:24129:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788746788.828384:0:24129:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000089a303cc/0xfac36e89154148c6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746788.828397:0:24129:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000089a303cc/0xfac36e89154148c6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746788.828406:0:24129:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000089a303cc/0xfac36e89154148c6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746788.828413:0:24129:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000089a303cc/0xfac36e89154148c6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746788.828442:0:24129:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788746788.829097:0:22611:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788746788.829105:0:22611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000089a303cc/0xfac36e89154148c6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746788.829114:0:22611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a45b7f94800 already unused, calling callback (ffffffffc0b5a8d0) 00010000:00010000:2.0:1788746788.829118:0:22611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000089a303cc/0xfac36e89154148c6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746788.829139:0:22611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000089a303cc/0xfac36e89154148c6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746788.829156:0:22611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000089a303cc/0xfac36e89154148c6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746788.829163:0:22611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000089a303cc/0xfac36e89154148c6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746788.829181:0:22611:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788746788.829183:0:22611:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788746788.829185:0:22611:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788746788.829595:0:24131:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788746788.829603:0:24131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000081537fb/0xfac36e89154148bf lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746788.830116:0:22612:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788746788.830175:0:24129:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788746788.830182:0:24129:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a82e132c/0xfac36e89154148cd lrc: 3/0,1 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746788.830194:0:24129:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x38:0x0].0x0 since=718s v=(0 0) 00010000:00010000:1.0:1788746788.830198:0:24129:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788746788.830203:0:24129:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a82e132c/0xfac36e89154148cd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746788.830214:0:24129:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a82e132c/0xfac36e89154148cd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746788.830222:0:24129:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a82e132c/0xfac36e89154148cd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746788.830230:0:24129:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a82e132c/0xfac36e89154148cd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746788.830251:0:24129:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788746788.830598:0:22611:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788746788.830603:0:22611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a82e132c/0xfac36e89154148cd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746788.830612:0:22611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a45b7f95400 already unused, calling callback (ffffffffc0b5a8d0) 00010000:00010000:2.0:1788746788.830616:0:22611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a82e132c/0xfac36e89154148cd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746788.830625:0:22611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a82e132c/0xfac36e89154148cd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746788.830639:0:22611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a82e132c/0xfac36e89154148cd lrc: 1/0,0 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746788.830657:0:22611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a82e132c/0xfac36e89154148cd lrc: 0/0,0 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746788.830672:0:22611:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788746788.830673:0:22611:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788746788.830675:0:22611:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788746788.831161:0:24131:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788746788.831169:0:24131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b35efffe/0xfac36e89154148d4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746788.831178:0:24131:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3a:0x0].0x0 since=718s v=(0 0) 00010000:00010000:0.0:1788746788.831181:0:24131:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788746788.831185:0:24131:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b35efffe/0xfac36e89154148d4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746788.831196:0:24131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b35efffe/0xfac36e89154148d4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746788.831203:0:24131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b35efffe/0xfac36e89154148d4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746788.831221:0:24131:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b35efffe/0xfac36e89154148d4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746788.831233:0:24131:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788746788.832147:0:22612:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788746788.832157:0:22612:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b35efffe/0xfac36e89154148d4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746788.832168:0:22612:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a44825c2a00 already unused, calling callback (ffffffffc0b5a8d0) 00010000:00010000:1.0:1788746788.832181:0:22612:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b35efffe/0xfac36e89154148d4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746788.832189:0:22612:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b35efffe/0xfac36e89154148d4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746788.832211:0:22612:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b35efffe/0xfac36e89154148d4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746788.832217:0:22612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b35efffe/0xfac36e89154148d4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746788.832232:0:22612:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788746788.832234:0:22612:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788746788.832236:0:22612:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788746788.832470:0:24129:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788746788.832476:0:24129:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a8a6158e/0xfac36e89154148db lrc: 3/0,1 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788746788.832713:0:24131:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788746788.832719:0:24131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fc780001/0xfac36e89154148e2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746788.832729:0:24131:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x39:0x0].0x0 since=718s v=(0 0) 00010000:00010000:2.0:1788746788.832733:0:24131:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788746788.832737:0:24131:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fc780001/0xfac36e89154148e2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746788.832748:0:24131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fc780001/0xfac36e89154148e2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746788.832756:0:24131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fc780001/0xfac36e89154148e2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746788.832763:0:24131:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fc780001/0xfac36e89154148e2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746788.832781:0:24131:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788746788.832790:0:22611:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788746788.832803:0:22611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fc780001/0xfac36e89154148e2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746788.832810:0:22611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a4581689e00 already unused, calling callback (ffffffffc0b5a8d0) 00010000:00010000:2.0:1788746788.832813:0:22611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fc780001/0xfac36e89154148e2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746788.832821:0:22611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fc780001/0xfac36e89154148e2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746788.832832:0:22611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fc780001/0xfac36e89154148e2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746788.832840:0:22611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fc780001/0xfac36e89154148e2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746788.832853:0:22611:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788746788.832854:0:22611:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788746788.832856:0:22611:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788746788.833174:0:24129:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x37:0x0].0x0 since=718s v=(0 0) 00010000:00010000:0.0:1788746788.833177:0:24129:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788746788.833181:0:24129:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a8a6158e/0xfac36e89154148db lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746788.833191:0:24129:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a8a6158e/0xfac36e89154148db lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746788.833199:0:24129:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a8a6158e/0xfac36e89154148db lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746788.833206:0:24129:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a8a6158e/0xfac36e89154148db lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746788.833220:0:24129:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788746788.833474:0:22612:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788746788.833712:0:22612:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a8a6158e/0xfac36e89154148db lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746788.833722:0:22612:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a44825c2200 already unused, calling callback (ffffffffc0b5a8d0) 00010000:00010000:1.0:1788746788.833726:0:22612:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a8a6158e/0xfac36e89154148db lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746788.833735:0:22612:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a8a6158e/0xfac36e89154148db lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746788.833749:0:22612:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a8a6158e/0xfac36e89154148db lrc: 1/0,0 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746788.833764:0:22612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a8a6158e/0xfac36e89154148db lrc: 0/0,0 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746788.833780:0:22612:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788746788.833782:0:22612:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788746788.833784:0:22612:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788746788.834836:0:24129:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788746788.834846:0:24129:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000081537fb/0xfac36e89154148e9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746788.834866:0:24129:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x36:0x0].0x0 since=718s v=(0 0) 00010000:00010000:0.0:1788746788.834870:0:24129:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788746788.834875:0:24129:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000081537fb/0xfac36e89154148e9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746788.834887:0:24129:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000081537fb/0xfac36e89154148e9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746788.834897:0:24129:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000081537fb/0xfac36e89154148e9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746788.834904:0:24129:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000081537fb/0xfac36e89154148e9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746788.835880:0:24129:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788746788.839673:0:24129:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788746788.839685:0:24129:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000db47a92/0xfac36e89154148f0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746788.839701:0:24129:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x35:0x0].0x0 since=718s v=(0 0) 00010000:00010000:1.0:1788746788.839706:0:24129:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788746788.839711:0:24129:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000db47a92/0xfac36e89154148f0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746788.839725:0:24129:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000db47a92/0xfac36e89154148f0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746788.839734:0:24129:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000db47a92/0xfac36e89154148f0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746788.839742:0:24129:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000db47a92/0xfac36e89154148f0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746788.842964:0:22611:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788746788.842978:0:22611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000081537fb/0xfac36e89154148e9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746788.842991:0:22611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a44825c3800 already unused, calling callback (ffffffffc0b5a8d0) 00010000:00010000:2.0:1788746788.842996:0:22611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000081537fb/0xfac36e89154148e9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746788.843018:0:22611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000081537fb/0xfac36e89154148e9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746788.843049:0:22611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000081537fb/0xfac36e89154148e9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746788.843057:0:22611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000081537fb/0xfac36e89154148e9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746788.843080:0:22611:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788746788.843083:0:22611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000db47a92/0xfac36e89154148f0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746788.843089:0:22611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a45b7f95e00 already unused, calling callback (ffffffffc0b5a8d0) 00010000:00010000:2.0:1788746788.843092:0:22611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000db47a92/0xfac36e89154148f0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746788.843098:0:22611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000db47a92/0xfac36e89154148f0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746788.843107:0:22611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000db47a92/0xfac36e89154148f0 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746788.843114:0:22611:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788746788.843116:0:22611:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788746788.843123:0:22611:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788746788.843422:0:24131:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788746788.843431:0:24131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ae70bcb1/0xfac36e89154148f7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746788.843442:0:24131:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x38:0x0].0x0 since=718s v=(0 0) 00010000:00010000:0.0:1788746788.843447:0:24131:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788746788.843452:0:24131:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ae70bcb1/0xfac36e89154148f7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746788.843465:0:24131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ae70bcb1/0xfac36e89154148f7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746788.844181:0:24131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ae70bcb1/0xfac36e89154148f7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746788.844190:0:24131:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ae70bcb1/0xfac36e89154148f7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746788.844211:0:24131:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788746788.845672:0:24131:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788746788.845682:0:24131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000d218db8/0xfac36e89154148fe lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746788.845696:0:24131:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x37:0x0].0x0 since=718s v=(0 0) 00010000:00010000:0.0:1788746788.845700:0:24131:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788746788.845705:0:24131:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000d218db8/0xfac36e89154148fe lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746788.845718:0:24131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000d218db8/0xfac36e89154148fe lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746788.845726:0:24131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000d218db8/0xfac36e89154148fe lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746788.845735:0:24131:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000d218db8/0xfac36e89154148fe lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746788.845780:0:24131:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788746788.846586:0:22611:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788746788.846594:0:22611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ae70bcb1/0xfac36e89154148f7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746788.846604:0:22611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a44825c3200 already unused, calling callback (ffffffffc0b5a8d0) 00010000:00010000:2.0:1788746788.846609:0:22611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ae70bcb1/0xfac36e89154148f7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746788.846618:0:22611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ae70bcb1/0xfac36e89154148f7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746788.846636:0:22611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ae70bcb1/0xfac36e89154148f7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746788.846643:0:22611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ae70bcb1/0xfac36e89154148f7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746788.846661:0:22611:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788746788.846664:0:22611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000d218db8/0xfac36e89154148fe lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746788.846670:0:22611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a44825c2400 already unused, calling callback (ffffffffc0b5a8d0) 00010000:00010000:2.0:1788746788.846673:0:22611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000d218db8/0xfac36e89154148fe lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746788.846680:0:22611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000d218db8/0xfac36e89154148fe lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746788.846695:0:22611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000d218db8/0xfac36e89154148fe lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746788.846703:0:22611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000d218db8/0xfac36e89154148fe lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746788.846714:0:22611:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788746788.846715:0:22611:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788746788.846717:0:22611:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788746788.846838:0:24131:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788746788.846845:0:24131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001fb473e1/0xfac36e8915414905 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746788.846855:0:24131:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x36:0x0].0x0 since=718s v=(0 0) 00010000:00010000:0.0:1788746788.846858:0:24131:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788746788.846863:0:24131:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001fb473e1/0xfac36e8915414905 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746788.846872:0:24131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001fb473e1/0xfac36e8915414905 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746788.846880:0:24131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001fb473e1/0xfac36e8915414905 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746788.846889:0:24131:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001fb473e1/0xfac36e8915414905 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746788.847091:0:24131:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788746788.849078:0:24129:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788746788.849092:0:24129:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000db47a92/0xfac36e89154148f0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746788.849138:0:22612:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788746788.849144:0:22612:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001fb473e1/0xfac36e8915414905 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746788.849153:0:22612:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a44825c2000 already unused, calling callback (ffffffffc0b5a8d0) 00010000:00010000:1.0:1788746788.849158:0:22612:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001fb473e1/0xfac36e8915414905 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746788.849168:0:22612:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001fb473e1/0xfac36e8915414905 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746788.849187:0:22612:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001fb473e1/0xfac36e8915414905 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746788.849194:0:22612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001fb473e1/0xfac36e8915414905 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746788.849209:0:22612:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788746788.849211:0:22612:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788746788.849213:0:22612:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788746788.850466:0:24129:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788746788.850488:0:24129:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000777d814e/0xfac36e891541490c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746788.850503:0:24129:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x34:0x0].0x0 since=718s v=(0 0) 00010000:00010000:1.0:1788746788.850513:0:24129:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788746788.850519:0:24129:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000777d814e/0xfac36e891541490c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746788.850533:0:24129:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000777d814e/0xfac36e891541490c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746788.850543:0:24129:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000777d814e/0xfac36e891541490c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746788.850551:0:24129:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000777d814e/0xfac36e891541490c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746788.850568:0:24129:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788746788.850577:0:22612:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788746788.850582:0:22612:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000777d814e/0xfac36e891541490c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746788.850590:0:22612:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a45b7f95200 already unused, calling callback (ffffffffc0b5a8d0) 00010000:00010000:1.0:1788746788.850594:0:22612:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000777d814e/0xfac36e891541490c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746788.850601:0:22612:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000777d814e/0xfac36e891541490c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746788.850613:0:22612:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000777d814e/0xfac36e891541490c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746788.850630:0:22612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000777d814e/0xfac36e891541490c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746788.850644:0:22612:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788746788.850646:0:22612:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788746788.850647:0:22612:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788746788.851620:0:24129:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788746788.851630:0:24129:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b35efffe/0xfac36e8915414913 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746788.851642:0:24129:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x33:0x0].0x0 since=718s v=(0 0) 00010000:00010000:0.0:1788746788.851655:0:24129:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788746788.851659:0:24129:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b35efffe/0xfac36e8915414913 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746788.851672:0:24129:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b35efffe/0xfac36e8915414913 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746788.851680:0:24129:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b35efffe/0xfac36e8915414913 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746788.851688:0:24129:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b35efffe/0xfac36e8915414913 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746788.851702:0:24129:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788746788.852239:0:24129:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788746788.852246:0:24129:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000059802833/0xfac36e891541491a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746788.852255:0:24129:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x32:0x0].0x0 since=718s v=(0 0) 00010000:00010000:0.0:1788746788.852259:0:24129:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788746788.852263:0:24129:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000059802833/0xfac36e891541491a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746788.852273:0:24129:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000059802833/0xfac36e891541491a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746788.852311:0:24129:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000059802833/0xfac36e891541491a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746788.852325:0:24129:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000059802833/0xfac36e891541491a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746788.852332:0:24129:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788746788.853311:0:22612:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788746788.853319:0:22612:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b35efffe/0xfac36e8915414913 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746788.853328:0:22612:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a44825c2a00 already unused, calling callback (ffffffffc0b5a8d0) 00010000:00010000:1.0:1788746788.853332:0:22612:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b35efffe/0xfac36e8915414913 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746788.853341:0:22612:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b35efffe/0xfac36e8915414913 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746788.853360:0:22612:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b35efffe/0xfac36e8915414913 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746788.853368:0:22612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b35efffe/0xfac36e8915414913 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746788.853390:0:22612:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788746788.853393:0:22612:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000059802833/0xfac36e891541491a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746788.853409:0:22612:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a44825c2600 already unused, calling callback (ffffffffc0b5a8d0) 00010000:00010000:1.0:1788746788.853413:0:22612:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000059802833/0xfac36e891541491a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746788.853420:0:22612:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000059802833/0xfac36e891541491a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746788.853431:0:22612:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000059802833/0xfac36e891541491a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746788.853438:0:22612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000059802833/0xfac36e891541491a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746788.853451:0:22612:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788746788.853452:0:22612:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788746788.853454:0:22612:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788746788.855263:0:24129:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788746788.855275:0:24129:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000864f3afc/0xfac36e8915414921 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746788.855316:0:24129:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x31:0x0].0x0 since=718s v=(0 0) 00010000:00010000:0.0:1788746788.855321:0:24129:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788746788.855328:0:24129:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000864f3afc/0xfac36e8915414921 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746788.855341:0:24129:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000864f3afc/0xfac36e8915414921 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746788.855351:0:24129:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000864f3afc/0xfac36e8915414921 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746788.855359:0:24129:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000864f3afc/0xfac36e8915414921 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746788.855382:0:24129:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788746788.855895:0:22612:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788746788.855903:0:22612:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000864f3afc/0xfac36e8915414921 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746788.855911:0:22612:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a4580031a00 already unused, calling callback (ffffffffc0b5a8d0) 00010000:00010000:1.0:1788746788.855915:0:22612:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000864f3afc/0xfac36e8915414921 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746788.856442:0:22612:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000864f3afc/0xfac36e8915414921 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746788.856470:0:22612:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000864f3afc/0xfac36e8915414921 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746788.856633:0:22612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000864f3afc/0xfac36e8915414921 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746788.856659:0:22612:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788746788.856662:0:22612:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788746788.856664:0:22612:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788746788.856719:0:24131:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788746788.856726:0:24131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001b583b07/0xfac36e8915414928 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746788.856737:0:24131:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x35:0x0].0x0 since=718s v=(0 0) 00010000:00010000:1.0:1788746788.856740:0:24131:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788746788.856745:0:24131:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001b583b07/0xfac36e8915414928 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746788.856756:0:24131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001b583b07/0xfac36e8915414928 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746788.856764:0:24131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001b583b07/0xfac36e8915414928 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746788.856771:0:24131:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001b583b07/0xfac36e8915414928 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746788.856796:0:24131:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788746788.857647:0:22612:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788746788.857655:0:22612:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001b583b07/0xfac36e8915414928 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746788.857671:0:22612:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a45b7f94400 already unused, calling callback (ffffffffc0b5a8d0) 00010000:00010000:0.0:1788746788.857675:0:22612:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001b583b07/0xfac36e8915414928 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746788.857683:0:22612:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001b583b07/0xfac36e8915414928 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746788.857698:0:22612:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001b583b07/0xfac36e8915414928 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746788.857706:0:22612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001b583b07/0xfac36e8915414928 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746788.857722:0:22612:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788746788.857724:0:22612:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788746788.857725:0:22612:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788746788.857812:0:24129:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788746788.857819:0:24129:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d1dbed52/0xfac36e891541492f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746788.857828:0:24129:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x30:0x0].0x0 since=718s v=(0 0) 00010000:00010000:0.0:1788746788.857832:0:24129:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788746788.857837:0:24129:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d1dbed52/0xfac36e891541492f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746788.857846:0:24129:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d1dbed52/0xfac36e891541492f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746788.857860:0:24129:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d1dbed52/0xfac36e891541492f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746788.857866:0:24129:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d1dbed52/0xfac36e891541492f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746788.857880:0:24129:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788746788.857888:0:22612:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788746788.857891:0:22612:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d1dbed52/0xfac36e891541492f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746788.857897:0:22612:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a4580031400 already unused, calling callback (ffffffffc0b5a8d0) 00010000:00010000:0.0:1788746788.857900:0:22612:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d1dbed52/0xfac36e891541492f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746788.857908:0:22612:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d1dbed52/0xfac36e891541492f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746788.857919:0:22612:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d1dbed52/0xfac36e891541492f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746788.858260:0:22611:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788746788.859310:0:22612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d1dbed52/0xfac36e891541492f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746788.859337:0:22612:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788746788.859345:0:22612:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788746788.859347:0:22612:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788746788.859620:0:24131:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788746788.859628:0:24131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fc780001/0xfac36e8915414936 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746788.859640:0:24131:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x34:0x0].0x0 since=718s v=(0 0) 00010000:00010000:2.0:1788746788.859644:0:24131:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788746788.859649:0:24131:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fc780001/0xfac36e8915414936 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746788.859661:0:24131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fc780001/0xfac36e8915414936 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746788.859670:0:24131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fc780001/0xfac36e8915414936 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746788.859678:0:24131:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fc780001/0xfac36e8915414936 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746788.859705:0:24131:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788746788.859912:0:24129:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788746788.860176:0:22611:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788746788.860183:0:22611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fc780001/0xfac36e8915414936 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746788.860191:0:22611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a4581689e00 already unused, calling callback (ffffffffc0b5a8d0) 00010000:00010000:0.0:1788746788.860195:0:22611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fc780001/0xfac36e8915414936 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746788.860205:0:22611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fc780001/0xfac36e8915414936 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746788.860221:0:22611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fc780001/0xfac36e8915414936 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746788.860228:0:22611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fc780001/0xfac36e8915414936 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746788.860245:0:22611:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788746788.860246:0:22611:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788746788.860248:0:22611:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788746788.860268:0:24129:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008ab1ffe6/0xfac36e891541493d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746788.860304:0:24129:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f:0x0].0x0 since=718s v=(0 0) 00010000:00010000:1.0:1788746788.860308:0:24129:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788746788.860312:0:24129:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008ab1ffe6/0xfac36e891541493d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746788.860321:0:24129:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008ab1ffe6/0xfac36e891541493d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746788.860329:0:24129:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008ab1ffe6/0xfac36e891541493d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746788.860336:0:24129:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008ab1ffe6/0xfac36e891541493d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746788.860351:0:24129:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788746788.861081:0:22612:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788746788.861088:0:22612:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008ab1ffe6/0xfac36e891541493d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746788.861097:0:22612:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a45b7f94a00 already unused, calling callback (ffffffffc0b5a8d0) 00010000:00010000:0.0:1788746788.861101:0:22612:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008ab1ffe6/0xfac36e891541493d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746788.861116:0:22612:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008ab1ffe6/0xfac36e891541493d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746788.861129:0:22612:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008ab1ffe6/0xfac36e891541493d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746788.861136:0:22612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008ab1ffe6/0xfac36e891541493d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746788.861151:0:22612:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788746788.861152:0:22612:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788746788.861153:0:22612:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788746788.861784:0:24131:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788746788.861792:0:24131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000051c2a3a4/0xfac36e8915414944 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746788.861803:0:24131:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x33:0x0].0x0 since=718s v=(0 0) 00010000:00010000:2.0:1788746788.861807:0:24131:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788746788.861811:0:24131:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000051c2a3a4/0xfac36e8915414944 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746788.861822:0:24131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000051c2a3a4/0xfac36e8915414944 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746788.861829:0:24131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000051c2a3a4/0xfac36e8915414944 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746788.861837:0:24131:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000051c2a3a4/0xfac36e8915414944 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746788.861853:0:24131:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788746788.862010:0:24129:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788746788.862015:0:24129:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ff3c185e/0xfac36e891541494b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746788.862022:0:24129:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e:0x0].0x0 since=718s v=(0 0) 00000001:00080000:0.0:1788746788.862248:0:24945:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901889 is committed 00000001:00100000:0.0:1788746788.862265:0:24945:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:0.0:1788746788.862270:0:24945:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:0.0:1788746788.862311:0:22611:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788746788.862318:0:22611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000051c2a3a4/0xfac36e8915414944 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746788.862325:0:22611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a4581688400 already unused, calling callback (ffffffffc0b5a8d0) 00010000:00010000:0.0:1788746788.862329:0:22611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000051c2a3a4/0xfac36e8915414944 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746788.862337:0:22611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000051c2a3a4/0xfac36e8915414944 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746788.862364:0:22611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000051c2a3a4/0xfac36e8915414944 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746788.862371:0:22611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000051c2a3a4/0xfac36e8915414944 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746788.862388:0:22611:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788746788.862389:0:22611:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788746788.862391:0:22611:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788746788.862572:0:24129:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788746788.862578:0:24129:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ff3c185e/0xfac36e891541494b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746788.862588:0:24129:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ff3c185e/0xfac36e891541494b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746788.862596:0:24129:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ff3c185e/0xfac36e891541494b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746788.862604:0:24129:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ff3c185e/0xfac36e891541494b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746788.862622:0:24129:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788746788.863439:0:24129:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788746788.863445:0:24129:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001faedcc6/0xfac36e8915414952 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746788.863455:0:24129:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d:0x0].0x0 since=718s v=(0 0) 00010000:00010000:1.0:1788746788.863458:0:24129:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788746788.863462:0:24129:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001faedcc6/0xfac36e8915414952 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746788.863472:0:24129:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001faedcc6/0xfac36e8915414952 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746788.864079:0:24129:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001faedcc6/0xfac36e8915414952 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746788.864096:0:24129:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001faedcc6/0xfac36e8915414952 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746788.864119:0:24129:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788746788.864321:0:22612:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788746788.864328:0:22612:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ff3c185e/0xfac36e891541494b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746788.864336:0:22612:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a45b7f94000 already unused, calling callback (ffffffffc0b5a8d0) 00010000:00010000:0.0:1788746788.864340:0:22612:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ff3c185e/0xfac36e891541494b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746788.864350:0:22612:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ff3c185e/0xfac36e891541494b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746788.864366:0:22612:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ff3c185e/0xfac36e891541494b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746788.864373:0:22612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ff3c185e/0xfac36e891541494b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746788.864403:0:22612:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788746788.864407:0:22612:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001faedcc6/0xfac36e8915414952 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746788.864413:0:22612:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a45b7f95800 already unused, calling callback (ffffffffc0b5a8d0) 00010000:00010000:0.0:1788746788.864416:0:22612:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001faedcc6/0xfac36e8915414952 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746788.864423:0:22612:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001faedcc6/0xfac36e8915414952 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746788.864433:0:22612:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001faedcc6/0xfac36e8915414952 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746788.864440:0:22612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001faedcc6/0xfac36e8915414952 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746788.864452:0:22612:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788746788.864453:0:22612:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788746788.864455:0:22612:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788746788.864615:0:22611:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788746788.864935:0:24665:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a45c0ea5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:23368:x1875636324138880:12345-0@lo:5:osp-pre-1-1.0 Request processed in 63673us (67586us total) trans 12884901889 rc 0/0 00000100:00100000:0.0:1788746788.864947:0:24665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788746788.865046:0:23368:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 12884901889 gen 2 00000100:00100000:1.0:1788746788.865053:0:23368:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a45c0ea6300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23368:1875636324138880:0@lo:5:osp-pre-1-1.0 00000004:00080000:1.0:1788746788.865070:0:23368:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x41:0x0]-[0x2c0000400:0x61:0x0] 00002000:00010000:0.0:1788746788.865526:0:24131:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788746788.865532:0:24131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000085a5d078/0xfac36e8915414959 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746788.865550:0:24131:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x32:0x0].0x0 since=718s v=(0 0) 00010000:00010000:0.0:1788746788.865554:0:24131:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788746788.865559:0:24131:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000085a5d078/0xfac36e8915414959 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746788.865572:0:24131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000085a5d078/0xfac36e8915414959 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746788.865579:0:24131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000085a5d078/0xfac36e8915414959 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746788.865586:0:24131:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000085a5d078/0xfac36e8915414959 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746788.865601:0:24131:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788746788.865611:0:22612:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788746788.865615:0:22612:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000085a5d078/0xfac36e8915414959 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746788.865621:0:22612:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a4580030a00 already unused, calling callback (ffffffffc0b5a8d0) 00010000:00010000:0.0:1788746788.865624:0:22612:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000085a5d078/0xfac36e8915414959 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746788.865630:0:22612:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000085a5d078/0xfac36e8915414959 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746788.865652:0:22612:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000085a5d078/0xfac36e8915414959 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746788.865658:0:22612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000085a5d078/0xfac36e8915414959 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746788.865673:0:22612:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788746788.865675:0:22612:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788746788.865676:0:22612:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788746788.865912:0:23368:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a45c0ea6300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:23368:1875636324139008:0@lo:900:osp-pre-1-1.0 00000100:00100000:1.0:1788746788.865971:0:23368:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746788.865996:0:23368:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a4588138d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788746788.866030:0:22634:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324139008 00000100:00100000:1.0:1788746788.866037:0:22634:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324139008 00000100:00100000:1.0:1788746788.866073:0:22634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788746788.866081:0:22634:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a45c0ea7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23368:x1875636324139008:12345-0@lo:900:osp-pre-1-1.0 00000100:00100000:1.0:1788746788.866126:0:22634:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a45c0ea7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23368:x1875636324139008:12345-0@lo:900:osp-pre-1-1.0 Request processed in 46us (155us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746788.866132:0:22634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1788746788.866159:0:23368:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a45c0ea6300 x1875636324139008/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788746804 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788746788.866170:0:23368:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a45c0ea6300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:23368:1875636324139008:0@lo:900:osp-pre-1-1.0 00002000:00010000:0.0:1788746788.868130:0:24131:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788746788.868142:0:24131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000034323a77/0xfac36e8915414960 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746788.868157:0:24131:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x31:0x0].0x0 since=718s v=(0 0) 00010000:00010000:0.0:1788746788.868161:0:24131:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788746788.868166:0:24131:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000034323a77/0xfac36e8915414960 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746788.868179:0:24131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000034323a77/0xfac36e8915414960 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746788.868189:0:24131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000034323a77/0xfac36e8915414960 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746788.868197:0:24131:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000034323a77/0xfac36e8915414960 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746788.868236:0:24131:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788746788.870135:0:22611:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788746788.870148:0:22611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000034323a77/0xfac36e8915414960 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746788.870161:0:22611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a4580030e00 already unused, calling callback (ffffffffc0b5a8d0) 00010000:00010000:3.0:1788746788.870165:0:22611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000034323a77/0xfac36e8915414960 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746788.870176:0:22611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000034323a77/0xfac36e8915414960 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746788.870196:0:22611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000034323a77/0xfac36e8915414960 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746788.870204:0:22611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000034323a77/0xfac36e8915414960 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746788.870225:0:22611:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788746788.870227:0:22611:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788746788.870229:0:22611:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788746788.870665:0:24131:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788746788.870673:0:24131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002aae6300/0xfac36e8915414967 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746788.870685:0:24131:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x30:0x0].0x0 since=718s v=(0 0) 00010000:00010000:0.0:1788746788.870688:0:24131:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788746788.870694:0:24131:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002aae6300/0xfac36e8915414967 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746788.870705:0:24131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002aae6300/0xfac36e8915414967 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746788.870714:0:24131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002aae6300/0xfac36e8915414967 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746788.870722:0:24131:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002aae6300/0xfac36e8915414967 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746788.870738:0:24131:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788746788.870747:0:22612:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788746788.870751:0:22612:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002aae6300/0xfac36e8915414967 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746788.870759:0:22612:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a4580030000 already unused, calling callback (ffffffffc0b5a8d0) 00010000:00010000:0.0:1788746788.870769:0:22612:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002aae6300/0xfac36e8915414967 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746788.870777:0:22612:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002aae6300/0xfac36e8915414967 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746788.870788:0:22612:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002aae6300/0xfac36e8915414967 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746788.870796:0:22612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002aae6300/0xfac36e8915414967 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746788.870808:0:22612:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788746788.870810:0:22612:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788746788.870811:0:22612:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788746788.872158:0:24131:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788746788.872169:0:24131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d1dbed52/0xfac36e891541496e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746788.872183:0:24131:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f:0x0].0x0 since=718s v=(0 0) 00010000:00010000:0.0:1788746788.872186:0:24131:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788746788.872191:0:24131:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d1dbed52/0xfac36e891541496e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746788.872203:0:24131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d1dbed52/0xfac36e891541496e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746788.872211:0:24131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d1dbed52/0xfac36e891541496e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746788.872225:0:24131:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d1dbed52/0xfac36e891541496e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746788.872248:0:24131:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788746788.872464:0:22611:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788746788.872471:0:22611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d1dbed52/0xfac36e891541496e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746788.872491:0:22611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a4580031400 already unused, calling callback (ffffffffc0b5a8d0) 00010000:00010000:3.0:1788746788.872502:0:22611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d1dbed52/0xfac36e891541496e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746788.872511:0:22611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d1dbed52/0xfac36e891541496e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746788.872528:0:22611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d1dbed52/0xfac36e891541496e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746788.872535:0:22611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d1dbed52/0xfac36e891541496e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746788.872551:0:22611:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788746788.872552:0:22611:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788746788.872554:0:22611:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788746788.872821:0:24131:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788746788.872827:0:24131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e8af8967/0xfac36e8915414975 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746788.872836:0:24131:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e:0x0].0x0 since=718s v=(0 0) 00010000:00010000:0.0:1788746788.872839:0:24131:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788746788.872843:0:24131:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e8af8967/0xfac36e8915414975 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746788.872852:0:24131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e8af8967/0xfac36e8915414975 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746788.872860:0:24131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e8af8967/0xfac36e8915414975 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746788.872867:0:24131:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e8af8967/0xfac36e8915414975 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746788.872881:0:24131:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788746788.872887:0:22612:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788746788.872892:0:22612:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e8af8967/0xfac36e8915414975 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746788.872904:0:22612:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a4580030800 already unused, calling callback (ffffffffc0b5a8d0) 00010000:00010000:0.0:1788746788.872907:0:22612:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e8af8967/0xfac36e8915414975 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746788.873366:0:22612:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e8af8967/0xfac36e8915414975 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746788.873381:0:22612:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e8af8967/0xfac36e8915414975 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746788.873388:0:22612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e8af8967/0xfac36e8915414975 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746788.873404:0:22612:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788746788.873406:0:22612:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788746788.873408:0:22612:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788746788.873776:0:24131:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788746788.873783:0:24131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c48da59d/0xfac36e891541497c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746788.873792:0:24131:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d:0x0].0x0 since=718s v=(0 0) 00010000:00010000:0.0:1788746788.873795:0:24131:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788746788.873800:0:24131:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c48da59d/0xfac36e891541497c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746788.873812:0:24131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c48da59d/0xfac36e891541497c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746788.873827:0:24131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c48da59d/0xfac36e891541497c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746788.873834:0:24131:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c48da59d/0xfac36e891541497c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746788.873892:0:24131:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788746788.875778:0:24131:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788746788.875791:0:24131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000800df80e/0xfac36e8915414983 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746788.875805:0:24131:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c:0x0].0x0 since=718s v=(0 0) 00010000:00010000:0.0:1788746788.875809:0:24131:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788746788.875815:0:24131:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000800df80e/0xfac36e8915414983 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746788.875827:0:24131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000800df80e/0xfac36e8915414983 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746788.875835:0:24131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000800df80e/0xfac36e8915414983 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746788.875843:0:24131:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000800df80e/0xfac36e8915414983 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746788.880588:0:22611:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788746788.880603:0:22611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c48da59d/0xfac36e891541497c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746788.880618:0:22611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a4580031600 already unused, calling callback (ffffffffc0b5a8d0) 00010000:00010000:3.0:1788746788.880623:0:22611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c48da59d/0xfac36e891541497c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746788.880635:0:22611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c48da59d/0xfac36e891541497c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746788.880656:0:22611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c48da59d/0xfac36e891541497c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746788.880676:0:22611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c48da59d/0xfac36e891541497c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746788.880714:0:22611:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788746788.880718:0:22611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000800df80e/0xfac36e8915414983 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746788.880724:0:22611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a4580031000 already unused, calling callback (ffffffffc0b5a8d0) 00010000:00010000:3.0:1788746788.880727:0:22611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000800df80e/0xfac36e8915414983 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746788.880735:0:22611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000800df80e/0xfac36e8915414983 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746788.880745:0:22611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000800df80e/0xfac36e8915414983 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746788.880753:0:22611:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788746788.880754:0:22611:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788746788.880757:0:22611:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788746788.880850:0:24129:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788746788.880857:0:24129:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000094f076bb/0xfac36e891541498a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746788.880868:0:24129:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c:0x0].0x0 since=718s v=(0 0) 00010000:00010000:3.0:1788746788.880878:0:24129:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788746788.880885:0:24129:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000094f076bb/0xfac36e891541498a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746788.880900:0:24129:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000094f076bb/0xfac36e891541498a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746788.880910:0:24129:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000094f076bb/0xfac36e891541498a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746788.881033:0:24129:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000094f076bb/0xfac36e891541498a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746788.881062:0:24129:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788746788.881580:0:24129:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788746788.881587:0:24129:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000057f38603/0xfac36e8915414991 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746788.881596:0:24129:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b:0x0].0x0 since=718s v=(0 0) 00010000:00010000:3.0:1788746788.881598:0:24129:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788746788.881602:0:24129:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000057f38603/0xfac36e8915414991 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746788.881611:0:24129:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000057f38603/0xfac36e8915414991 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746788.881619:0:24129:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000057f38603/0xfac36e8915414991 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746788.881634:0:24129:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000057f38603/0xfac36e8915414991 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746788.881649:0:24129:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788746788.881658:0:22611:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788746788.881662:0:22611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000094f076bb/0xfac36e891541498a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746788.881668:0:22611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a45c216ca00 already unused, calling callback (ffffffffc0b5a8d0) 00010000:00010000:3.0:1788746788.881671:0:22611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000094f076bb/0xfac36e891541498a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746788.881678:0:22611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000094f076bb/0xfac36e891541498a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746788.881690:0:22611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000094f076bb/0xfac36e891541498a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746788.881697:0:22611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000094f076bb/0xfac36e891541498a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746788.881712:0:22611:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788746788.881715:0:22611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000057f38603/0xfac36e8915414991 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746788.881734:0:22611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a45c216c400 already unused, calling callback (ffffffffc0b5a8d0) 00010000:00010000:3.0:1788746788.881737:0:22611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000057f38603/0xfac36e8915414991 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746788.881745:0:22611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000057f38603/0xfac36e8915414991 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746788.881755:0:22611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000057f38603/0xfac36e8915414991 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746788.881762:0:22611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000057f38603/0xfac36e8915414991 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746788.881775:0:22611:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788746788.881776:0:22611:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788746788.881778:0:22611:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788746788.882693:0:24131:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788746788.882702:0:24131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000800df80e/0xfac36e8915414983 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746788.882731:0:22612:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788746788.883122:0:22611:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788746788.883412:0:24129:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788746788.883420:0:24129:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000044964b7e/0xfac36e8915414998 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746788.883432:0:24129:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a:0x0].0x0 since=718s v=(0 0) 00010000:00010000:3.0:1788746788.883435:0:24129:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788746788.883441:0:24129:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000044964b7e/0xfac36e8915414998 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746788.883452:0:24129:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000044964b7e/0xfac36e8915414998 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746788.883468:0:24129:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000044964b7e/0xfac36e8915414998 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746788.883476:0:24129:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000044964b7e/0xfac36e8915414998 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788746788.883642:0:24131:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788746788.883648:0:24131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000034323a77/0xfac36e891541499f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746788.883656:0:24131:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b:0x0].0x0 since=718s v=(0 0) 00010000:00010000:0.0:1788746788.883659:0:24131:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788746788.883663:0:24131:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000034323a77/0xfac36e891541499f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746788.883672:0:24131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000034323a77/0xfac36e891541499f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746788.883680:0:24131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000034323a77/0xfac36e891541499f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746788.883687:0:24131:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000034323a77/0xfac36e891541499f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746788.883704:0:24131:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788746788.884035:0:22612:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788746788.884042:0:22612:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000034323a77/0xfac36e891541499f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746788.884062:0:22612:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a4580030e00 already unused, calling callback (ffffffffc0b5a8d0) 00010000:00010000:2.0:1788746788.884066:0:22612:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000034323a77/0xfac36e891541499f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746788.884076:0:22612:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000034323a77/0xfac36e891541499f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746788.884093:0:22612:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000034323a77/0xfac36e891541499f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746788.884101:0:22612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000034323a77/0xfac36e891541499f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746788.884116:0:22612:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788746788.884118:0:22612:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788746788.884119:0:22612:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788746788.884667:0:24131:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788746788.884674:0:24131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000777d814e/0xfac36e89154149a6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746788.884695:0:24131:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a:0x0].0x0 since=718s v=(0 0) 00010000:00010000:1.0:1788746788.884698:0:24131:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788746788.884703:0:24131:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000777d814e/0xfac36e89154149a6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746788.884713:0:24131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000777d814e/0xfac36e89154149a6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746788.884721:0:24131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000777d814e/0xfac36e89154149a6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746788.884728:0:24131:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000777d814e/0xfac36e89154149a6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746788.884742:0:24131:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788746788.885019:0:22611:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788746788.885025:0:22611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000777d814e/0xfac36e89154149a6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746788.885033:0:22611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a45b7f95200 already unused, calling callback (ffffffffc0b5a8d0) 00010000:00010000:2.0:1788746788.885036:0:22611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000777d814e/0xfac36e89154149a6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746788.885044:0:22611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000777d814e/0xfac36e89154149a6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746788.885064:0:22611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000777d814e/0xfac36e89154149a6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746788.885071:0:22611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000777d814e/0xfac36e89154149a6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746788.885086:0:22611:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788746788.885088:0:22611:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788746788.885090:0:22611:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788746788.885696:0:24131:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788746788.885704:0:24131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000db47a92/0xfac36e89154149ad lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746788.885714:0:24131:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x29:0x0].0x0 since=718s v=(0 0) 00010000:00010000:1.0:1788746788.885717:0:24131:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788746788.885722:0:24131:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000db47a92/0xfac36e89154149ad lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746788.885732:0:24131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000db47a92/0xfac36e89154149ad lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746788.885751:0:24131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000db47a92/0xfac36e89154149ad lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746788.885758:0:24131:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000db47a92/0xfac36e89154149ad lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746788.890161:0:24131:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788746788.894637:0:22612:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788746788.894651:0:22612:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000db47a92/0xfac36e89154149ad lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746788.894666:0:22612:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a45b7f95e00 already unused, calling callback (ffffffffc0b5a8d0) 00010000:00010000:2.0:1788746788.894671:0:22612:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000db47a92/0xfac36e89154149ad lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746788.894683:0:22612:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000db47a92/0xfac36e89154149ad lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746788.894704:0:22612:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000db47a92/0xfac36e89154149ad lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746788.894712:0:22612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000db47a92/0xfac36e89154149ad lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746788.894746:0:22612:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788746788.894751:0:22612:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000044964b7e/0xfac36e8915414998 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746788.894759:0:22612:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a45c216c200 already unused, calling callback (ffffffffc0b5a8d0) 00010000:00010000:2.0:1788746788.894762:0:22612:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000044964b7e/0xfac36e8915414998 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746788.894770:0:22612:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000044964b7e/0xfac36e8915414998 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746788.894779:0:22612:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000044964b7e/0xfac36e8915414998 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746788.894787:0:22612:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788746788.894788:0:22612:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788746788.894790:0:22612:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788746788.899233:0:24129:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788746788.899254:0:24129:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000044964b7e/0xfac36e8915414998 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788746788.900391:0:24129:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788746788.900402:0:24129:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002aae6300/0xfac36e89154149b4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746788.900417:0:24129:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x29:0x0].0x0 since=718s v=(0 0) 00010000:00010000:0.0:1788746788.900421:0:24129:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788746788.900427:0:24129:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002aae6300/0xfac36e89154149b4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746788.900440:0:24129:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002aae6300/0xfac36e89154149b4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746788.900450:0:24129:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002aae6300/0xfac36e89154149b4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746788.900457:0:24129:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002aae6300/0xfac36e89154149b4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746788.900475:0:24129:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788746788.901766:0:22612:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788746788.901779:0:22612:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002aae6300/0xfac36e89154149b4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746788.901792:0:22612:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a4580030000 already unused, calling callback (ffffffffc0b5a8d0) 00010000:00010000:2.0:1788746788.901797:0:22612:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002aae6300/0xfac36e89154149b4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746788.901819:0:22612:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002aae6300/0xfac36e89154149b4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746788.901839:0:22612:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002aae6300/0xfac36e89154149b4 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746788.901848:0:22612:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788746788.901850:0:22612:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788746788.901852:0:22612:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788746788.901858:0:22611:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788746788.902005:0:24129:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002aae6300/0xfac36e89154149b4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788746788.903717:0:24129:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788746788.903728:0:24129:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000800df80e/0xfac36e89154149bb lrc: 3/0,1 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746788.903751:0:24129:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x28:0x0].0x0 since=718s v=(0 0) 00010000:00010000:0.0:1788746788.903755:0:24129:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788746788.903761:0:24129:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000800df80e/0xfac36e89154149bb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746788.903776:0:24129:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000800df80e/0xfac36e89154149bb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746788.903786:0:24129:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000800df80e/0xfac36e89154149bb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746788.903794:0:24129:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000800df80e/0xfac36e89154149bb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746788.903815:0:24129:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788746788.904906:0:22612:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788746788.905777:0:22612:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000800df80e/0xfac36e89154149bb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746788.905793:0:22612:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a4580031000 already unused, calling callback (ffffffffc0b5a8d0) 00010000:00010000:2.0:1788746788.905799:0:22612:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000800df80e/0xfac36e89154149bb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746788.905809:0:22612:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000800df80e/0xfac36e89154149bb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746788.905831:0:22612:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000800df80e/0xfac36e89154149bb lrc: 1/0,0 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746788.905838:0:22612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000800df80e/0xfac36e89154149bb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746788.905874:0:22612:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788746788.905875:0:22612:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788746788.905877:0:22612:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788746788.906696:0:24129:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788746788.906706:0:24129:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e8af8967/0xfac36e89154149c2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746788.906719:0:24129:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x27:0x0].0x0 since=718s v=(0 0) 00010000:00010000:0.0:1788746788.906724:0:24129:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788746788.906729:0:24129:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e8af8967/0xfac36e89154149c2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746788.906741:0:24129:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e8af8967/0xfac36e89154149c2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746788.906761:0:24129:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e8af8967/0xfac36e89154149c2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746788.906769:0:24129:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e8af8967/0xfac36e89154149c2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746788.906789:0:24129:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788746788.908056:0:22611:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788746788.908066:0:22611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e8af8967/0xfac36e89154149c2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746788.908077:0:22611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a4580030800 already unused, calling callback (ffffffffc0b5a8d0) 00010000:00010000:2.0:1788746788.908082:0:22611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e8af8967/0xfac36e89154149c2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746788.908091:0:22611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e8af8967/0xfac36e89154149c2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746788.908108:0:22611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e8af8967/0xfac36e89154149c2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746788.908116:0:22611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e8af8967/0xfac36e89154149c2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746788.908133:0:22611:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788746788.908134:0:22611:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788746788.908135:0:22611:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788746788.910475:0:24129:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788746788.911067:0:24129:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002aae6300/0xfac36e89154149c9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746788.911085:0:24129:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x26:0x0].0x0 since=718s v=(0 0) 00010000:00010000:0.0:1788746788.911091:0:24129:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788746788.911098:0:24129:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002aae6300/0xfac36e89154149c9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746788.911113:0:24129:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002aae6300/0xfac36e89154149c9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746788.911124:0:24129:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002aae6300/0xfac36e89154149c9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746788.911132:0:24129:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002aae6300/0xfac36e89154149c9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746788.911176:0:24129:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788746788.912081:0:22612:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788746788.912091:0:22612:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002aae6300/0xfac36e89154149c9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746788.912117:0:22612:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a4580030000 already unused, calling callback (ffffffffc0b5a8d0) 00010000:00010000:2.0:1788746788.912121:0:22612:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002aae6300/0xfac36e89154149c9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746788.912130:0:22612:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002aae6300/0xfac36e89154149c9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746788.912147:0:22612:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002aae6300/0xfac36e89154149c9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746788.912154:0:22612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002aae6300/0xfac36e89154149c9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746788.912174:0:22612:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788746788.912176:0:22612:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788746788.912178:0:22612:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788746788.916272:0:24129:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788746788.916310:0:24129:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000085a5d078/0xfac36e89154149d0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746788.916329:0:24129:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x25:0x0].0x0 since=718s v=(0 0) 00010000:00010000:0.0:1788746788.916334:0:24129:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788746788.916340:0:24129:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000085a5d078/0xfac36e89154149d0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746788.916355:0:24129:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000085a5d078/0xfac36e89154149d0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746788.916366:0:24129:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000085a5d078/0xfac36e89154149d0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746788.916374:0:24129:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000085a5d078/0xfac36e89154149d0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746788.916396:0:24129:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788746788.916736:0:22611:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788746788.916744:0:22611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000085a5d078/0xfac36e89154149d0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746788.916754:0:22611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a4580030a00 already unused, calling callback (ffffffffc0b5a8d0) 00010000:00010000:2.0:1788746788.916758:0:22611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000085a5d078/0xfac36e89154149d0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746788.916768:0:22611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000085a5d078/0xfac36e89154149d0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746788.916793:0:22611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000085a5d078/0xfac36e89154149d0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746788.916801:0:22611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000085a5d078/0xfac36e89154149d0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746788.916825:0:22611:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788746788.916827:0:22611:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788746788.916830:0:22611:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788746788.916898:0:24129:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788746788.916905:0:24129:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000864f3afc/0xfac36e89154149d7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746788.917031:0:24129:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x24:0x0].0x0 since=718s v=(0 0) 00010000:00010000:0.0:1788746788.917042:0:24129:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788746788.917047:0:24129:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000864f3afc/0xfac36e89154149d7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746788.917057:0:24129:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000864f3afc/0xfac36e89154149d7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746788.917066:0:24129:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000864f3afc/0xfac36e89154149d7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746788.917073:0:24129:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000864f3afc/0xfac36e89154149d7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746788.917091:0:24129:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788746788.917137:0:22612:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788746788.917144:0:22612:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000864f3afc/0xfac36e89154149d7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746788.917152:0:22612:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a4580031a00 already unused, calling callback (ffffffffc0b5a8d0) 00010000:00010000:2.0:1788746788.917156:0:22612:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000864f3afc/0xfac36e89154149d7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746788.917164:0:22612:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000864f3afc/0xfac36e89154149d7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746788.917176:0:22612:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000864f3afc/0xfac36e89154149d7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746788.917183:0:22612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000864f3afc/0xfac36e89154149d7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746788.917211:0:22612:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788746788.917213:0:22612:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788746788.917214:0:22612:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788746788.917639:0:24129:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788746788.917647:0:24129:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000034323a77/0xfac36e89154149de lrc: 3/0,1 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746788.917656:0:24129:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x23:0x0].0x0 since=718s v=(0 0) 00010000:00010000:0.0:1788746788.917658:0:24129:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788746788.917663:0:24129:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000034323a77/0xfac36e89154149de lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746788.917673:0:24129:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000034323a77/0xfac36e89154149de lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746788.917681:0:24129:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000034323a77/0xfac36e89154149de lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746788.917696:0:24129:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000034323a77/0xfac36e89154149de lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746788.917715:0:24129:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788746788.917723:0:22611:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788746788.917730:0:22611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000034323a77/0xfac36e89154149de lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746788.917739:0:22611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a4580030e00 already unused, calling callback (ffffffffc0b5a8d0) 00010000:00010000:2.0:1788746788.917744:0:22611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000034323a77/0xfac36e89154149de lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746788.917752:0:22611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000034323a77/0xfac36e89154149de lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746788.917764:0:22611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000034323a77/0xfac36e89154149de lrc: 1/0,0 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746788.917772:0:22611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000034323a77/0xfac36e89154149de lrc: 0/0,0 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746788.917790:0:22611:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788746788.917792:0:22611:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788746788.917794:0:22611:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788746788.919452:0:24129:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788746788.919466:0:24129:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c48da59d/0xfac36e89154149e5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746788.920052:0:24129:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=718s v=(0 0) 00010000:00010000:0.0:1788746788.920059:0:24129:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788746788.920065:0:24129:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c48da59d/0xfac36e89154149e5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746788.920081:0:24129:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c48da59d/0xfac36e89154149e5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746788.920091:0:24129:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c48da59d/0xfac36e89154149e5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746788.920098:0:24129:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c48da59d/0xfac36e89154149e5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746788.920133:0:24129:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788746788.920225:0:22612:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788746788.920234:0:22612:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c48da59d/0xfac36e89154149e5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746788.920257:0:22612:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a4580031600 already unused, calling callback (ffffffffc0b5a8d0) 00010000:00010000:2.0:1788746788.920261:0:22612:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c48da59d/0xfac36e89154149e5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746788.920273:0:22612:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c48da59d/0xfac36e89154149e5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746788.920404:0:22612:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c48da59d/0xfac36e89154149e5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746788.920412:0:22612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c48da59d/0xfac36e89154149e5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746788.920433:0:22612:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788746788.920435:0:22612:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788746788.920437:0:22612:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:0.0:1788746788.922026:0:24129:0:(ofd_dev.c:1520:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:5 00000100:00100000:0.0:1788746788.922137:0:24129:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4483dd9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:22648:x1875636324138112:12345-0@lo:5:osp-pre-0-0.0 Request processed in 160498us (162698us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746788.922158:0:24129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788746788.922223:0:22648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a4483dd9880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22648:1875636324138112:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1788746788.922239:0:22648:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x41:0x0] from OST, last_created [0x280000401:0x41:0x0]last_used is [0x280000401:0x5:0x0] 00000100:00100000:0.0:1788746788.923105:0:22648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a4483dd9880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22648:1875636324139136:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1788746788.923153:0:22648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746788.923182:0:22648:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a45875f43c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788746788.923204:0:24129:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324139136 00000100:00100000:0.0:1788746788.923212:0:24129:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324139136 00000100:00100000:0.0:1788746788.923258:0:25016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788746788.923267:0:25016:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4483ddb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:22648:x1875636324139136:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:0.0:1788746788.923341:0:25016:0:(ofd_dev.c:1749:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 66 00002000:00010000:1.0:1788746788.930629:0:24131:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788746788.930641:0:24131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006e8c061d/0xfac36e89154149ec lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746788.930659:0:24131:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x28:0x0].0x0 since=718s v=(0 0) 00010000:00010000:1.0:1788746788.930663:0:24131:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788746788.930669:0:24131:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006e8c061d/0xfac36e89154149ec lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746788.930684:0:24131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006e8c061d/0xfac36e89154149ec lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746788.930695:0:24131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006e8c061d/0xfac36e89154149ec lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746788.930704:0:24131:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006e8c061d/0xfac36e89154149ec lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746788.930740:0:24131:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788746788.930836:0:22611:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788746788.930845:0:22611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006e8c061d/0xfac36e89154149ec lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746788.930856:0:22611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a45b7f94c00 already unused, calling callback (ffffffffc0b5a8d0) 00010000:00010000:2.0:1788746788.930860:0:22611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006e8c061d/0xfac36e89154149ec lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746788.930869:0:22611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006e8c061d/0xfac36e89154149ec lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746788.930895:0:22611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006e8c061d/0xfac36e89154149ec lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746788.930902:0:22611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006e8c061d/0xfac36e89154149ec lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746788.930920:0:22611:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788746788.930922:0:22611:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788746788.930924:0:22611:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788746788.932194:0:24131:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788746788.932205:0:24131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005f049398/0xfac36e89154149f3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746788.932218:0:24131:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x27:0x0].0x0 since=718s v=(0 0) 00010000:00010000:1.0:1788746788.932222:0:24131:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788746788.932228:0:24131:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005f049398/0xfac36e89154149f3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746788.932239:0:24131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005f049398/0xfac36e89154149f3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746788.932248:0:24131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005f049398/0xfac36e89154149f3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746788.932256:0:24131:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005f049398/0xfac36e89154149f3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746788.932316:0:24131:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788746788.932397:0:22612:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788746788.932404:0:22612:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005f049398/0xfac36e89154149f3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746788.932412:0:22612:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a45b7f95c00 already unused, calling callback (ffffffffc0b5a8d0) 00010000:00010000:2.0:1788746788.932416:0:22612:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005f049398/0xfac36e89154149f3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746788.932425:0:22612:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005f049398/0xfac36e89154149f3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746788.932439:0:22612:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005f049398/0xfac36e89154149f3 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746788.932445:0:22612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005f049398/0xfac36e89154149f3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746788.932469:0:22612:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788746788.932471:0:22612:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788746788.932473:0:22612:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788746788.933828:0:24131:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788746788.933840:0:24131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dac8e4a9/0xfac36e89154149fa lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746788.933854:0:24131:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x26:0x0].0x0 since=718s v=(0 0) 00010000:00010000:1.0:1788746788.933864:0:24131:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788746788.933870:0:24131:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dac8e4a9/0xfac36e89154149fa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746788.933884:0:24131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dac8e4a9/0xfac36e89154149fa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746788.933893:0:24131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dac8e4a9/0xfac36e89154149fa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746788.933901:0:24131:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dac8e4a9/0xfac36e89154149fa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746788.935105:0:24131:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788746788.936756:0:24131:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788746788.936772:0:24131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b53ce43c/0xfac36e8915414a01 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746788.936791:0:24131:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x25:0x0].0x0 since=718s v=(0 0) 00010000:00010000:1.0:1788746788.936796:0:24131:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788746788.936802:0:24131:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b53ce43c/0xfac36e8915414a01 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746788.936817:0:24131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b53ce43c/0xfac36e8915414a01 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746788.936828:0:24131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b53ce43c/0xfac36e8915414a01 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746788.936843:0:24131:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b53ce43c/0xfac36e8915414a01 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746788.936865:0:24131:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788746788.936988:0:22611:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788746788.936996:0:22611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dac8e4a9/0xfac36e89154149fa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746788.937007:0:22611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a45b7f95a00 already unused, calling callback (ffffffffc0b5a8d0) 00010000:00010000:2.0:1788746788.937012:0:22611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dac8e4a9/0xfac36e89154149fa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746788.937023:0:22611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dac8e4a9/0xfac36e89154149fa lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746788.937042:0:22611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dac8e4a9/0xfac36e89154149fa lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746788.937050:0:22611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dac8e4a9/0xfac36e89154149fa lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746788.937071:0:22611:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788746788.937075:0:22611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b53ce43c/0xfac36e8915414a01 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746788.937083:0:22611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a45b7f94600 already unused, calling callback (ffffffffc0b5a8d0) 00010000:00010000:2.0:1788746788.937094:0:22611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b53ce43c/0xfac36e8915414a01 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746788.937102:0:22611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b53ce43c/0xfac36e8915414a01 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746788.937113:0:22611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b53ce43c/0xfac36e8915414a01 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746788.937119:0:22611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b53ce43c/0xfac36e8915414a01 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746788.937133:0:22611:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788746788.937135:0:22611:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788746788.937137:0:22611:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788746788.937145:0:22612:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788746788.939430:0:24131:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788746788.939443:0:24131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000228b46d8/0xfac36e8915414a08 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746788.939458:0:24131:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x24:0x0].0x0 since=718s v=(0 0) 00010000:00010000:1.0:1788746788.939463:0:24131:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788746788.939469:0:24131:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000228b46d8/0xfac36e8915414a08 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746788.939495:0:24131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000228b46d8/0xfac36e8915414a08 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746788.939505:0:24131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000228b46d8/0xfac36e8915414a08 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746788.939513:0:24131:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000228b46d8/0xfac36e8915414a08 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746788.939536:0:24131:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788746788.939633:0:22611:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788746788.939641:0:22611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000228b46d8/0xfac36e8915414a08 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746788.939650:0:22611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a45b7f94200 already unused, calling callback (ffffffffc0b5a8d0) 00010000:00010000:2.0:1788746788.939654:0:22611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000228b46d8/0xfac36e8915414a08 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746788.939663:0:22611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000228b46d8/0xfac36e8915414a08 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746788.939679:0:22611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000228b46d8/0xfac36e8915414a08 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746788.939693:0:22611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000228b46d8/0xfac36e8915414a08 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746788.939709:0:22611:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788746788.939711:0:22611:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788746788.939713:0:22611:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788746788.940181:0:24131:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788746788.940188:0:24131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000db47a92/0xfac36e8915414a0f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746788.940203:0:24131:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x23:0x0].0x0 since=718s v=(0 0) 00010000:00010000:1.0:1788746788.940207:0:24131:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788746788.940211:0:24131:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000db47a92/0xfac36e8915414a0f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746788.940221:0:24131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000db47a92/0xfac36e8915414a0f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746788.940229:0:24131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000db47a92/0xfac36e8915414a0f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746788.940237:0:24131:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000db47a92/0xfac36e8915414a0f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746788.940258:0:24131:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788746788.940265:0:22612:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788746788.940271:0:22612:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000db47a92/0xfac36e8915414a0f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:1.0:1788746788.940329:0:24131:0:(ofd_dev.c:1520:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:34 00010000:00010000:2.0:1788746788.940385:0:22612:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a45b7f95e00 already unused, calling callback (ffffffffc0b5a8d0) 00010000:00010000:2.0:1788746788.940389:0:22612:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000db47a92/0xfac36e8915414a0f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746788.940398:0:22612:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000db47a92/0xfac36e8915414a0f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746788.940412:0:22612:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000db47a92/0xfac36e8915414a0f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788746788.940420:0:24131:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4483cbe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:22650:x1875636324138368:12345-0@lo:5:osp-pre-1-0.0 Request processed in 178596us (180417us total) trans 0 rc 0/0 00010000:00010000:2.0:1788746788.940422:0:22612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000db47a92/0xfac36e8915414a0f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788746788.940437:0:24131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:2.0:1788746788.940445:0:22612:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788746788.940449:0:22612:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788746788.940451:0:22612:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788746788.940634:0:22650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a4483cbd880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22650:1875636324138368:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1788746788.940651:0:22650:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x41:0x0] from OST, last_created [0x2c0000401:0x41:0x0]last_used is [0x2c0000401:0x22:0x0] 00000100:00100000:0.0:1788746788.940698:0:22650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a4483dd8e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22650:1875636324139264:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1788746788.940736:0:22650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746788.940764:0:22650:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a45875f4b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788746788.940786:0:24665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324139264 00000100:00100000:0.0:1788746788.940792:0:24665:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324139264 00000100:00100000:0.0:1788746788.940834:0:24665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788746788.940844:0:24665:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4483dd8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:22650:x1875636324139264:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:0.0:1788746788.940879:0:24665:0:(ofd_dev.c:1749:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 66 00000001:00080000:1.0:1788746788.944569:0:24125:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901890 is committed 00000001:00100000:1.0:1788746788.944617:0:24125:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:0.0:1788746788.945147:0:24665:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4483dd8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:22650:x1875636324139264:12345-0@lo:5:osp-pre-1-0.0 Request processed in 4299us (4407us total) trans 12884901890 rc 0/0 00000100:00100000:0.0:1788746788.945159:0:24665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788746788.945272:0:25016:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4483ddb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:22648:x1875636324139136:12345-0@lo:5:osp-pre-0-0.0 Request processed in 22006us (22117us total) trans 12884901890 rc 0/0 00000100:00100000:1.0:1788746788.945389:0:22650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a4483dd8e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22650:1875636324139264:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1788746788.945406:0:22650:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x41:0x0]-[0x2c0000401:0x61:0x0] 00000100:00100000:0.0:1788746788.945460:0:25016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788746788.945551:0:22648:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 12884901890 gen 2 00000100:00100000:0.0:1788746788.945557:0:22648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a4483dd9880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22648:1875636324139136:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1788746788.945565:0:22648:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x41:0x0]-[0x280000401:0x61:0x0] 10000000:01000000:1.0:1788746789.138846:0:22620:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788746789.138854:0:22620:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8a4582bdb800 from 14 10000000:01000000:1.0:1788746789.138877:0:22620:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788746789.138927:0:22620:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.139@tcp lock: ffff8a45b7f95200/0xfac36e8915414a16 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746789.138939:0:22620:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.139@tcp lock: ffff8a45b7f95200/0xfac36e8915414a16 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746789.138951:0:22620:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.139@tcp lock: ffff8a45b7f95200/0xfac36e8915414a16 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788746789.138978:0:22620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a45c0ea6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:41310026-2b0a-472c-80e6-fbabf81d5070:22620:1875636324139392:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788746789.139051:0:22620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746789.139102:0:22620:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a4590777180 going to sleep for 11 seconds 00000100:00100000:3.0:1788746789.139171:0:22618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324139392 00000100:00100000:3.0:1788746789.139181:0:22618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324139392 00000100:00100000:3.0:1788746789.139238:0:22618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1788746789.139248:0:22618:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4585854c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41310026-2b0a-472c-80e6-fbabf81d5070+22:22620:x1875636324139392:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788746789.139263:0:22618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788746789.139315:0:22618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a45c216da00/0xfac36e8915414a1d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xfac36e8915414a16 expref: -99 pid: 22618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746789.139341:0:22618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a45c216da00/0xfac36e8915414a1d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfac36e8915414a16 expref: 23 pid: 22618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746789.139353:0:22618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a45c216da00/0xfac36e8915414a1d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfac36e8915414a16 expref: 23 pid: 22618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746789.139361:0:22618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a45c216da00, rc 0) 00000100:00100000:3.0:1788746789.139403:0:22618:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4585854c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41310026-2b0a-472c-80e6-fbabf81d5070+23:22620:x1875636324139392:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 156us (351us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746789.139410:0:22618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1788746789.139499:0:22620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a45c0ea6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:41310026-2b0a-472c-80e6-fbabf81d5070:22620:1875636324139392:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788746789.139515:0:22620:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.139@tcp lock: ffff8a45b7f95200/0xfac36e8915414a16 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfac36e8915414a1d expref: -99 pid: 22620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746789.139525:0:22620:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.139@tcp lock: ffff8a45b7f95200/0xfac36e8915414a16 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xfac36e8915414a1d expref: -99 pid: 22620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788746789.139576:0:22620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a45c0ea6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:41310026-2b0a-472c-80e6-fbabf81d5070:22620:1875636324139520:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788746789.139621:0:22620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746789.139652:0:22620:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a4590777180 going to sleep for 11 seconds 00000100:00100000:2.0:1788746789.139942:0:22617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324139520 00000100:00100000:2.0:1788746789.139948:0:22617:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324139520 00000100:00100000:2.0:1788746789.139986:0:22617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1788746789.139994:0:22617:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4585856c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41310026-2b0a-472c-80e6-fbabf81d5070+23:22620:x1875636324139520:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788746789.140009:0:22617:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788746789.140026:0:22617:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788746789.140029:0:22617:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 14 00000100:00100000:2.0:1788746789.140118:0:22617:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4585856c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41310026-2b0a-472c-80e6-fbabf81d5070+23:22620:x1875636324139520:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 124us (497us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746789.140125:0:22617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1788746789.140328:0:22620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a45c0ea6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:41310026-2b0a-472c-80e6-fbabf81d5070:22620:1875636324139520:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788746789.140388:0:22620:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.139@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788746789.140396:0:22620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff8a45b7f95200/0xfac36e8915414a16 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfac36e8915414a1d expref: -99 pid: 22620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746789.140415:0:22620:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.139@tcp lock: ffff8a45b7f95200/0xfac36e8915414a16 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfac36e8915414a1d expref: -99 pid: 22620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788746789.140424:0:22620:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788746789.140426:0:22620:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8a45847a0000 from 14 10000000:01000000:1.0:1788746789.140428:0:22620:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788746789.140450:0:22620:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.139@tcp lock: ffff8a45b7f95800/0xfac36e8915414a24 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746789.140457:0:22620:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.139@tcp lock: ffff8a45b7f95800/0xfac36e8915414a24 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746789.140464:0:22620:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.139@tcp lock: ffff8a45b7f95800/0xfac36e8915414a24 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788746789.140477:0:22620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a45c0ea6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:41310026-2b0a-472c-80e6-fbabf81d5070:22620:1875636324139648:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788746789.140505:0:22620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746789.140582:0:22620:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a4590777180 going to sleep for 11 seconds 00000100:00100000:3.0:1788746789.147517:0:22618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324139648 00000100:00100000:3.0:1788746789.147534:0:22618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324139648 00000100:00100000:3.0:1788746789.147620:0:22618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1788746789.147632:0:22618:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4585855850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41310026-2b0a-472c-80e6-fbabf81d5070+23:22620:x1875636324139648:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788746789.147651:0:22618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788746789.147672:0:22618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a45c216d000/0xfac36e8915414a2b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xfac36e8915414a24 expref: -99 pid: 22618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746789.147700:0:22618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a45c216d000/0xfac36e8915414a2b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfac36e8915414a24 expref: 24 pid: 22618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746789.147711:0:22618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a45c216d000/0xfac36e8915414a2b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfac36e8915414a24 expref: 24 pid: 22618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746789.147719:0:22618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a45c216d000, rc 0) 00000100:00100000:3.0:1788746789.147804:0:22618:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4585855850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41310026-2b0a-472c-80e6-fbabf81d5070+24:22620:x1875636324139648:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 175us (7296us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746789.147811:0:22618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1788746789.147875:0:22620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a45c0ea6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:41310026-2b0a-472c-80e6-fbabf81d5070:22620:1875636324139648:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788746789.147895:0:22620:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.139@tcp lock: ffff8a45b7f95800/0xfac36e8915414a24 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfac36e8915414a2b expref: -99 pid: 22620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746789.147904:0:22620:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.139@tcp lock: ffff8a45b7f95800/0xfac36e8915414a24 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xfac36e8915414a2b expref: -99 pid: 22620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788746789.147977:0:22620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a448448b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:41310026-2b0a-472c-80e6-fbabf81d5070:22620:1875636324139776:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788746789.148021:0:22620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746789.148053:0:22620:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a4484498600 going to sleep for 11 seconds 00000100:00100000:3.0:1788746789.148068:0:22615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324139776 00000100:00100000:3.0:1788746789.148072:0:22615:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324139776 00000100:00100000:3.0:1788746789.148104:0:22615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1788746789.148111:0:22615:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4585857850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41310026-2b0a-472c-80e6-fbabf81d5070+24:22620:x1875636324139776:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788746789.148126:0:22615:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788746789.148142:0:22615:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788746789.148145:0:22615:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 14 00000100:00100000:3.0:1788746789.148224:0:22615:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4585857850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41310026-2b0a-472c-80e6-fbabf81d5070+24:22620:x1875636324139776:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 114us (203us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746789.148232:0:22615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1788746789.148261:0:22620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a448448b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:41310026-2b0a-472c-80e6-fbabf81d5070:22620:1875636324139776:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788746789.148346:0:22620:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.139@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788746789.148353:0:22620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff8a45b7f95800/0xfac36e8915414a24 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfac36e8915414a2b expref: -99 pid: 22620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746789.148361:0:22620:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.139@tcp lock: ffff8a45b7f95800/0xfac36e8915414a24 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfac36e8915414a2b expref: -99 pid: 22620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746789.779056:0:22611:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788746790.811405:0:22612:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788746791.826823:0:22611:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788746792.146477:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a45c0ea5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875636324139904:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788746792.146549:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746792.146621:0:22628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324139904 00000100:00100000:1.0:1788746792.146630:0:22628:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324139904 00000100:00100000:1.0:1788746792.146673:0:22628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788746792.146681:0:22628:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a45c0ea4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1875636324139904:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788746792.146713:0:22628:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788746792.146751:0:22628:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a45c0ea4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1875636324139904:12345-0@lo:41:osp-pre-1-0.0 Request processed in 70us (202us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746792.146769:0:22628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788746792.146816:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a45c0ea5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875636324139904:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788746792.146949:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788746792.146958:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a448448b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875636324140032:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788746792.146987:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746792.147014:0:24134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324140032 00000100:00100000:3.0:1788746792.147019:0:24134:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324140032 00000100:00100000:3.0:1788746792.147056:0:24134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788746792.147063:0:24134:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4484489500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875636324140032:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788746792.147080:0:24134:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788746792.147112:0:24134:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4484489500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875636324140032:12345-0@lo:13:osp-pre-0-1.0 Request processed in 49us (123us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746792.147125:0:24134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788746792.147157:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a448448b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875636324140032:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1788746792.147363:0:22619:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788746792.147529:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a4483dd9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875636324140160:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788746792.147557:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746792.147661:0:23652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324140160 00000100:00100000:0.0:1788746792.147667:0:23652:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324140160 00000100:00100000:0.0:1788746792.147699:0:23652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788746792.147707:0:23652:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a448448b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1875636324140160:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788746792.147728:0:23652:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1788746792.147772:0:23652:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a448448b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1875636324140160:12345-0@lo:41:osp-pre-0-1.0 Request processed in 66us (213us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746792.147778:0:23652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788746792.147850:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a4483dd9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875636324140160:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788746792.857700:0:22612:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788746793.874495:0:22611:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788746794.194675:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a4483dd9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875636324140672:0@lo:400:kworker.0 00000100:00100000:0.0:1788746794.194781:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746794.194827:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a4483dd8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875636324141184:0@lo:400:kworker.0 00000100:00100000:0.0:1788746794.194846:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746794.194859:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a4483dd9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3645:1875636324141696:0@lo:400:kworker.0 00000100:00100000:0.0:1788746794.194884:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746794.194909:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:0.0:1788746794.194915:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a4483ddad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:41310026-2b0a-472c-80e6-fbabf81d5070:3645:1875636324140288:0@lo:400:kworker.0 00000100:00100000:0.0:1788746794.194942:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746794.194963:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a4483dda300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875636324140800:0@lo:400:kworker.0 00000100:00100000:0.0:1788746794.194981:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746794.195008:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a4483ddb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875636324141312:0@lo:400:kworker.0 00000100:00100000:0.0:1788746794.195026:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746794.195041:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a45b0c52d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3645:1875636324141824:0@lo:400:kworker.0 00000100:00100000:0.0:1788746794.195062:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746794.195083:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a4483dd9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875636324140416:0@lo:400:kworker.0 00000100:00100000:0.0:1788746794.195105:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746794.195120:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a4483dd8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875636324140928:0@lo:400:kworker.0 00000100:00100000:0.0:1788746794.195136:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746794.195149:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a4483dd8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3643:1875636324141440:0@lo:400:kworker.0 00000100:00100000:0.0:1788746794.195166:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746794.195192:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1788746794.195198:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a4483dda680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875636324140544:0@lo:400:kworker.0 00000100:00100000:0.0:1788746794.195218:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746794.195235:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a4483ddbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875636324141056:0@lo:400:kworker.0 00000100:00100000:0.0:1788746794.195255:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746794.195269:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a4483dd9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3643:1875636324141568:0@lo:400:kworker.0 00000100:00100000:0.0:1788746794.195314:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746794.195342:0:22625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324141696 00000100:00100000:0.0:1788746794.195350:0:22625:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324141696 00000100:00100000:1.0:1788746794.195622:0:24129:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324140672 00000100:00100000:1.0:1788746794.195625:0:24129:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324140672 00000100:00100000:1.0:1788746794.195657:0:24129:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324141184 00000100:00100000:1.0:1788746794.195660:0:24129:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324141184 00000100:00100000:1.0:1788746794.195671:0:24129:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324140544 00000100:00100000:1.0:1788746794.195673:0:24129:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324140544 00000100:00100000:1.0:1788746794.195684:0:24129:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324141056 00000100:00100000:1.0:1788746794.195686:0:24129:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324141056 00000100:00100000:1.0:1788746794.195702:0:24129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788746794.195712:0:24129:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a45b0c53b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3645:x1875636324140672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788746794.195776:0:24129:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a45b0c53b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3645:x1875636324140672:12345-0@lo:400:kworker.0 Request processed in 65us (994us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746794.195783:0:24129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788746794.196050:0:24129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788746794.196056:0:24129:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a45b0c53480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875636324141184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788746794.196087:0:24129:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a45b0c53480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875636324141184:12345-0@lo:400:kworker.0 Request processed in 31us (1239us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746794.196093:0:24129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788746794.196104:0:24129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788746794.196110:0:24129:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a45b0c53800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1875636324140544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788746794.196137:0:24129:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a45b0c53800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1875636324140544:12345-0@lo:400:kworker.0 Request processed in 28us (918us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746794.196143:0:24129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788746794.196164:0:24129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788746794.196170:0:24129:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a45b0c50e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875636324141056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788746794.196212:0:24129:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a45b0c50e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875636324141056:12345-0@lo:400:kworker.0 Request processed in 42us (955us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746794.196218:0:24129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:1.0:1788746794.196281:0:22619:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788746794.196309:0:22619:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788746794.196312:0:22619:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788746794.196330:0:23652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324140416 00000100:00100000:1.0:1788746794.196336:0:23652:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324140416 00000100:00100000:1.0:1788746794.196363:0:23652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324140928 00000100:00100000:1.0:1788746794.196366:0:23652:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324140928 00000100:00100000:1.0:1788746794.196381:0:23652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788746794.196387:0:23652:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a45b0c52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875636324140416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788746794.197680:0:23652:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a45b0c52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875636324140416:12345-0@lo:400:kworker.0 Request processed in 1289us (2570us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746794.197693:0:23652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788746794.197724:0:23652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788746794.197732:0:23652:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a45b0c51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875636324140928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788746794.197764:0:23652:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a45b0c51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875636324140928:12345-0@lo:400:kworker.0 Request processed in 33us (2626us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746794.197771:0:23652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788746794.197798:0:22623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324140800 00000100:00100000:1.0:1788746794.197804:0:22623:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324140800 00000100:00100000:1.0:1788746794.197827:0:22623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324141312 00000100:00100000:1.0:1788746794.197830:0:22623:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324141312 00000100:00100000:1.0:1788746794.197839:0:22623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324141824 00000100:00100000:1.0:1788746794.197842:0:22623:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324141824 00000100:00100000:0.0:1788746794.197944:0:22625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324141440 00000100:00100000:0.0:1788746794.197948:0:22625:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324141440 00000100:00100000:1.0:1788746794.197987:0:22623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324141568 00000100:00100000:1.0:1788746794.197997:0:22623:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324141568 00000100:00080000:2.0:1788746794.198269:0:22619:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788746794.198274:0:22619:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788746794.198810:0:22625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788746794.198819:0:22625:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a45b0c51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875636324140800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788746794.198883:0:22625:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a45b0c51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875636324140800:12345-0@lo:400:kworker.0 Request processed in 65us (3900us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746794.198891:0:22625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788746794.198913:0:22625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788746794.198920:0:22625:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a45b0c51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875636324141312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788746794.198949:0:22625:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a45b0c51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875636324141312:12345-0@lo:400:kworker.0 Request processed in 30us (3922us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746794.198955:0:22625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788746794.198965:0:22625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788746794.198971:0:22625:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a45b0c50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1875636324141696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788746794.198998:0:22625:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a45b0c50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1875636324141696:12345-0@lo:400:kworker.0 Request processed in 27us (4113us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746794.199004:0:22625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788746794.199015:0:22625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788746794.199020:0:22625:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a45b0c52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875636324141824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788746794.199044:0:22625:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a45b0c52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875636324141824:12345-0@lo:400:kworker.0 Request processed in 24us (3981us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746794.199049:0:22625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788746794.199059:0:22625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788746794.199064:0:22625:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a45b0c53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875636324141440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788746794.199086:0:22625:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a45b0c53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875636324141440:12345-0@lo:400:kworker.0 Request processed in 23us (3920us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746794.199091:0:22625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788746794.199576:0:22623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788746794.199583:0:22623:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a45b0c50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875636324141568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788746794.199723:0:22623:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a45b0c50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875636324141568:12345-0@lo:400:kworker.0 Request processed in 140us (4409us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746794.199730:0:22623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788746794.199764:0:22615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324140288 00000100:00100000:1.0:1788746794.199773:0:22615:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324140288 00000100:00100000:1.0:1788746794.199806:0:22615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1788746794.199813:0:22615:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4585856050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41310026-2b0a-472c-80e6-fbabf81d5070+24:3645:x1875636324140288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788746794.199847:0:22615:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4585856050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41310026-2b0a-472c-80e6-fbabf81d5070+24:3645:x1875636324140288:12345-0@lo:400:kworker.0 Request processed in 35us (4905us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746794.199853:0:22615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1788746794.199980:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788746794.199995:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a45c0ea6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875636324142208:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788746794.200029:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746794.200066:0:24134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324142208 00000100:00100000:1.0:1788746794.200070:0:24134:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324142208 00000100:00100000:1.0:1788746794.200106:0:24134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788746794.200113:0:24134:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a45c0ea6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875636324142208:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788746794.200138:0:24134:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788746794.200188:0:24134:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a45c0ea6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875636324142208:12345-0@lo:13:osp-pre-0-0.0 Request processed in 75us (159us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746794.200195:0:24134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788746794.200215:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a45c0ea5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875636324141952:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788746794.200238:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a45c0ea6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875636324142208:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788746794.200239:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746794.200272:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a4483dda680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875636324140544:0@lo:400:kworker.0 00000100:00100000:2.0:1788746794.200313:0:24133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324141952 00000100:00100000:1.0:1788746794.200317:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a4483ddbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875636324141056:0@lo:400:kworker.0 00000100:00100000:2.0:1788746794.200318:0:24133:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324141952 00010000:00080000:1.0:1788746794.200331:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a4483dd9880 x1875636324141568/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788746810 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788746794.200341:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a4483dd9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3643:1875636324141568:0@lo:400:kworker.0 00000100:00100000:2.0:1788746794.200355:0:24133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788746794.200355:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a4483dd9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875636324140416:0@lo:400:kworker.0 00000100:00100000:2.0:1788746794.200362:0:24133:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a45b7ef0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875636324141952:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788746794.200367:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a4483dd8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875636324140928:0@lo:400:kworker.0 00010000:00080000:1.0:1788746794.200377:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a4483dd8a80 x1875636324141440/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788746810 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00002000:00000024:2.0:1788746794.200379:0:24133:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915849728 avail 3684327424 00000100:00100000:1.0:1788746794.200386:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a4483dd8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3643:1875636324141440:0@lo:400:kworker.0 00000100:00100000:2.0:1788746794.200421:0:24133:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a45b7ef0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875636324141952:12345-0@lo:13:osp-pre-1-1.0 Request processed in 60us (180us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746794.200427:0:24133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788746794.200906:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a45c0ea5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875636324141952:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788746794.200918:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788746794.200924:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a448446b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875636324142080:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788746794.200950:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746794.200971:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a4483ddad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:41310026-2b0a-472c-80e6-fbabf81d5070:3645:1875636324140288:0@lo:400:kworker.0 00010000:00080000:0.0:1788746794.200986:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a4483dda300 x1875636324140800/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788746810 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788746794.200995:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a4483dda300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875636324140800:0@lo:400:kworker.0 00010000:00080000:0.0:1788746794.201021:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a4483ddb100 x1875636324141312/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788746810 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788746794.201029:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a4483ddb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875636324141312:0@lo:400:kworker.0 00010000:00080000:0.0:1788746794.201039:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a45b0c52d80 x1875636324141824/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788746810 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788746794.201045:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a45b0c52d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3645:1875636324141824:0@lo:400:kworker.0 00000100:00100000:0.0:1788746794.201056:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a4483dd9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875636324140672:0@lo:400:kworker.0 00000100:00100000:0.0:1788746794.201065:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a4483dd8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875636324141184:0@lo:400:kworker.0 00010000:00080000:0.0:1788746794.201074:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a4483dd9c00 x1875636324141696/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788746810 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788746794.201081:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a4483dd9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3645:1875636324141696:0@lo:400:kworker.0 00000100:00100000:2.0:1788746794.201166:0:24133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324142080 00000100:00100000:2.0:1788746794.201170:0:24133:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324142080 00000100:00100000:2.0:1788746794.201216:0:24133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788746794.201224:0:24133:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a45b7ef0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3643:x1875636324142080:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788746794.201237:0:24133:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915849728 avail 3684327424 00000100:00100000:2.0:1788746794.201279:0:24133:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a45b7ef0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3643:x1875636324142080:12345-0@lo:13:osp-pre-1-0.0 Request processed in 57us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746794.201316:0:24133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788746794.201522:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a448446b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875636324142080:0@lo:13:osp-pre-1-0.0 00000001:00080000:0.0:1788746794.213647:0:24945:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901890 is committed 00000040:00080000:0.0:1788746794.334950:0:22657:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788746794.898511:0:22612:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788746794.898875:0:25301:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg439-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1788746795.928714:0:22611:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788746796.023905:0:25353:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788746796.024157:0:25353:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788746796.947550:0:22612:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788746797.146664:0:25403:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788746797.147640:0:25403:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1788746797.267484:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a4484469180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875636324142336:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788746797.267613:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788746797.267702:0:23652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324142336 00000100:00100000:2.0:1788746797.267711:0:23652:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324142336 00000100:00100000:2.0:1788746797.267764:0:23652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788746797.267775:0:23652:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a448446bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1875636324142336:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788746797.267818:0:23652:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788746797.268143:0:23652:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a448446bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1875636324142336:12345-0@lo:41:osp-pre-1-0.0 Request processed in 368us (528us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746797.268152:0:23652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788746797.268206:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a4484469180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875636324142336:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788746797.270527:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a45b0c52d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875636324142592:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788746797.270598:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746797.270661:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788746797.270670:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a45b7ef2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875636324142464:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788746797.270720:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746797.270770:0:22628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324142592 00000100:00100000:0.0:1788746797.270778:0:22628:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324142592 00000100:00100000:0.0:1788746797.270822:0:22628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788746797.270833:0:22628:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a45b0c52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875636324142592:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788746797.271053:0:22628:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1788746797.271151:0:22628:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a45b0c52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875636324142592:12345-0@lo:41:osp-pre-0-1.0 Request processed in 318us (552us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746797.271158:0:22628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788746797.271204:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a45b0c52d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875636324142592:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788746797.271328:0:24133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324142464 00000100:00100000:2.0:1788746797.271334:0:24133:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324142464 00000100:00100000:2.0:1788746797.271375:0:24133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788746797.271384:0:24133:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a45b0c51180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875636324142464:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788746797.271417:0:24133:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788746797.271452:0:24133:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a45b0c51180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875636324142464:12345-0@lo:13:osp-pre-0-1.0 Request processed in 70us (731us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746797.271457:0:24133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788746797.271490:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a45b7ef2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875636324142464:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1788746797.272199:0:22619:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788746797.482018:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788746797.482108:0:22617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636305150336 00000100:00100000:2.0:1788746797.482150:0:22617:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636305150336 00000100:00100000:3.0:1788746797.492381:0:22617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 116 00000100:00100000:3.0:1788746797.492394:0:22617:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4585855050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2398:x1875636305150336:12345-192.168.204.39@tcp:250:mount.lustre.0 00010000:00080000:3.0:1788746797.492431:0:22617:0:(ldlm_lib.c:1456:target_handle_connect()) MGS: connection from 0f755556-f1cd-4e4b-8ec3-48b3fc3a369c@192.168.204.39@tcp t0 exp 0000000000000000 cur 727 last 0 00000020:00000080:3.0:1788746797.492468:0:22617:0:(genops.c:1384:class_connect()) connect: client 0f755556-f1cd-4e4b-8ec3-48b3fc3a369c, cookie 0xfac36e8915414a32 00000100:00080000:3.0:1788746797.492628:0:22617:0:(import.c:65:import_set_state_nolock()) ffff8a45b878c000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788746797.492724:0:22617:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4585855050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f755556-f1cd-4e4b-8ec3-48b3fc3a369c+5:2398:x1875636305150336:12345-192.168.204.39@tcp:250:mount.lustre.0 Request processed in 330us (10723us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746797.493780:0:22617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 116 00000100:00100000:2.0:1788746797.505515:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788746797.505612:0:22618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636305150464 00000100:00100000:1.0:1788746797.505623:0:22618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636305150464 00000100:00100000:1.0:1788746797.505684:0:22618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 117 00000100:00100000:1.0:1788746797.505694:0:22618:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4585857050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f755556-f1cd-4e4b-8ec3-48b3fc3a369c+5:18021:x1875636305150464:12345-192.168.204.39@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788746797.505711:0:22618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788746797.505742:0:22618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a45b7f94600/0xfac36e8915414a39 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x4d2179c47f07880d expref: -99 pid: 22618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746797.505779:0:22618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a45b7f94600/0xfac36e8915414a39 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.204.39@tcp remote: 0x4d2179c47f07880d expref: 6 pid: 22618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746797.505810:0:22618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a45b7f94600/0xfac36e8915414a39 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.39@tcp remote: 0x4d2179c47f07880d expref: 6 pid: 22618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746797.505820:0:22618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a45b7f94600, rc 0) 00000100:00100000:1.0:1788746797.505895:0:22618:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4585857050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f755556-f1cd-4e4b-8ec3-48b3fc3a369c+6:18021:x1875636305150464:12345-192.168.204.39@tcp:101:mount.lustre.0 Request processed in 202us (391us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746797.505902:0:22618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 117 00000100:00100000:2.0:1788746797.513649:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788746797.513768:0:22615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636305150592 00000100:00100000:1.0:1788746797.513780:0:22615:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636305150592 00000100:00100000:1.0:1788746797.513838:0:22615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 118 00000100:00100000:1.0:1788746797.513848:0:22615:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4585854050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f755556-f1cd-4e4b-8ec3-48b3fc3a369c+6:18021:x1875636305150592:12345-192.168.204.39@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788746797.513991:0:22615:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4585854050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f755556-f1cd-4e4b-8ec3-48b3fc3a369c+6:18021:x1875636305150592:12345-192.168.204.39@tcp:501:mount.lustre.0 Request processed in 144us (355us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788746797.514000:0:22615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 118 00000100:00100000:0.0:1788746797.521850:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788746797.522023:0:22617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636305150720 00000100:00100000:3.0:1788746797.522040:0:22617:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636305150720 00000100:00100000:3.0:1788746797.522133:0:22617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 119 00000100:00100000:3.0:1788746797.522145:0:22617:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4585854850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f755556-f1cd-4e4b-8ec3-48b3fc3a369c+6:18021:x1875636305150720:12345-192.168.204.39@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788746797.522176:0:22617:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788746797.522199:0:22617:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a45c216c400/0xfac36e8915414a40 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x4d2179c47f078814 expref: -99 pid: 22617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746797.522231:0:22617:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a45c216c400/0xfac36e8915414a40 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.204.39@tcp remote: 0x4d2179c47f078814 expref: 7 pid: 22617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746797.522264:0:22617:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a45c216c400/0xfac36e8915414a40 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.204.39@tcp remote: 0x4d2179c47f078814 expref: 7 pid: 22617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746797.522274:0:22617:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a45c216c400, rc 0) 00000100:00100000:3.0:1788746797.522385:0:22617:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4585854850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f755556-f1cd-4e4b-8ec3-48b3fc3a369c+7:18021:x1875636305150720:12345-192.168.204.39@tcp:101:mount.lustre.0 Request processed in 241us (548us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746797.522392:0:22617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 119 00000100:00100000:2.0:1788746797.533258:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788746797.533667:0:22618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636305150848 00000100:00100000:3.0:1788746797.533680:0:22618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636305150848 00000100:00100000:0.0:1788746797.534151:0:22617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 120 00000100:00100000:0.0:1788746797.534181:0:22617:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4585854450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f755556-f1cd-4e4b-8ec3-48b3fc3a369c+7:18021:x1875636305150848:12345-192.168.204.39@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788746797.534376:0:22617:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4585854450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f755556-f1cd-4e4b-8ec3-48b3fc3a369c+8:18021:x1875636305150848:12345-192.168.204.39@tcp:501:mount.lustre.0 Request processed in 213us (1132us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746797.534385:0:22617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 120 00000100:00100000:0.0:1788746797.537443:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788746797.537528:0:22615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636305150976 00000100:00100000:1.0:1788746797.537538:0:22615:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636305150976 00000100:00100000:1.0:1788746797.537591:0:22615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 121 00000100:00100000:1.0:1788746797.537602:0:22615:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4585856450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f755556-f1cd-4e4b-8ec3-48b3fc3a369c+8:18021:x1875636305150976:12345-192.168.204.39@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788746797.538854:0:22615:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4585856450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f755556-f1cd-4e4b-8ec3-48b3fc3a369c+8:18021:x1875636305150976:12345-192.168.204.39@tcp:503:mount.lustre.0 Request processed in 1246us (1413us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746797.538866:0:22615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 121 00000100:00100000:1.0:1788746797.547432:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788746797.550223:0:22618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636305151104 00000100:00100000:3.0:1788746797.550241:0:22618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636305151104 00000100:00100000:3.0:1788746797.550322:0:22618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 122 00000100:00100000:3.0:1788746797.550334:0:22618:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4585857c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f755556-f1cd-4e4b-8ec3-48b3fc3a369c+8:18040:x1875636305151104:12345-192.168.204.39@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788746797.550985:0:22618:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4585857c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f755556-f1cd-4e4b-8ec3-48b3fc3a369c+8:18040:x1875636305151104:12345-192.168.204.39@tcp:502:llog_process_th.0 Request processed in 650us (3560us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746797.550994:0:22618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 122 00000100:00100000:1.0:1788746797.592556:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788746797.592698:0:22615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636305151232 00000100:00100000:3.0:1788746797.592709:0:22615:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636305151232 00000100:00100000:3.0:1788746797.592772:0:22615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 123 00000100:00100000:3.0:1788746797.592782:0:22615:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4585857450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f755556-f1cd-4e4b-8ec3-48b3fc3a369c+8:18040:x1875636305151232:12345-192.168.204.39@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788746797.592951:0:22615:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4585857450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f755556-f1cd-4e4b-8ec3-48b3fc3a369c+8:18040:x1875636305151232:12345-192.168.204.39@tcp:502:llog_process_th.0 Request processed in 170us (406us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746797.592959:0:22615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 123 00000100:00100000:1.0:1788746797.606134:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788746797.606362:0:22617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636305151360 00000100:00100000:0.0:1788746797.606372:0:22617:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636305151360 00000100:00100000:0.0:1788746797.606439:0:22617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 124 00000100:00100000:0.0:1788746797.606451:0:22617:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4584203850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f755556-f1cd-4e4b-8ec3-48b3fc3a369c+8:18040:x1875636305151360:12345-192.168.204.39@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788746797.606620:0:22617:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4584203850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f755556-f1cd-4e4b-8ec3-48b3fc3a369c+8:18040:x1875636305151360:12345-192.168.204.39@tcp:502:llog_process_th.0 Request processed in 171us (497us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746797.606638:0:22617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 124 00000100:00100000:0.0:1788746797.620960:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788746797.623785:0:22618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636305151488 00000100:00100000:1.0:1788746797.623819:0:22618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636305151488 00000100:00100000:1.0:1788746797.623955:0:22618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 125 00000100:00100000:1.0:1788746797.623966:0:22618:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4584202050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f755556-f1cd-4e4b-8ec3-48b3fc3a369c+8:18021:x1875636305151488:12345-192.168.204.39@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788746797.623983:0:22618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788746797.624002:0:22618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a45b7f95c00/0xfac36e8915414a47 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x4d2179c47f078845 expref: -99 pid: 22618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746797.624033:0:22618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a45b7f95c00/0xfac36e8915414a47 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.204.39@tcp remote: 0x4d2179c47f078845 expref: 9 pid: 22618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746797.624043:0:22618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a45b7f95c00/0xfac36e8915414a47 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.204.39@tcp remote: 0x4d2179c47f078845 expref: 9 pid: 22618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746797.624051:0:22618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a45b7f95c00, rc 0) 00000100:00100000:1.0:1788746797.624138:0:22618:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4584202050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f755556-f1cd-4e4b-8ec3-48b3fc3a369c+9:18021:x1875636305151488:12345-192.168.204.39@tcp:101:mount.lustre.0 Request processed in 170us (3187us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746797.624145:0:22618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 125 00000100:00100000:1.0:1788746797.642472:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788746797.644057:0:22615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636305151616 00000100:00100000:3.0:1788746797.644076:0:22615:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636305151616 00000100:00100000:3.0:1788746797.644507:0:22615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 126 00000100:00100000:3.0:1788746797.644520:0:22615:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4584201050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f755556-f1cd-4e4b-8ec3-48b3fc3a369c+9:18021:x1875636305151616:12345-192.168.204.39@tcp:256:mount.lustre.0 20000000:01000000:3.0:1788746797.644548:0:22615:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1788746797.644567:0:22615:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1788746797.644571:0:22615:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1788746797.644574:0:22615:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1788746797.644577:0:22615:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:3.0:1788746797.644579:0:22615:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 14 00000100:00100000:3.0:1788746797.647064:0:22615:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4584201050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f755556-f1cd-4e4b-8ec3-48b3fc3a369c+9:18021:x1875636305151616:12345-192.168.204.39@tcp:256:mount.lustre.0 Request processed in 2536us (4592us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746797.647079:0:22615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 126 00000100:00100000:1.0:1788746797.659797:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788746797.660248:0:22618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636305151744 00000100:00100000:3.0:1788746797.660259:0:22618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636305151744 00000100:00100000:3.0:1788746797.660340:0:22618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 127 00000100:00100000:3.0:1788746797.660352:0:22618:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4584203050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f755556-f1cd-4e4b-8ec3-48b3fc3a369c+9:18021:x1875636305151744:12345-192.168.204.39@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788746797.660369:0:22618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788746797.660386:0:22618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a45c216ca00/0xfac36e8915414a4e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x4d2179c47f07884c expref: -99 pid: 22618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746797.660415:0:22618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a45c216ca00/0xfac36e8915414a4e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.39@tcp remote: 0x4d2179c47f07884c expref: 10 pid: 22618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746797.660427:0:22618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a45c216ca00/0xfac36e8915414a4e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.39@tcp remote: 0x4d2179c47f07884c expref: 10 pid: 22618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746797.660435:0:22618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a45c216ca00, rc 0) 00000100:00100000:3.0:1788746797.660496:0:22618:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4584203050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f755556-f1cd-4e4b-8ec3-48b3fc3a369c+10:18021:x1875636305151744:12345-192.168.204.39@tcp:101:mount.lustre.0 Request processed in 147us (710us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746797.660524:0:22618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 127 00000100:00100000:1.0:1788746797.663249:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788746797.663482:0:22615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636305151872 00000100:00100000:3.0:1788746797.663493:0:22615:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636305151872 00000100:00100000:3.0:1788746797.663555:0:22615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 128 00000100:00100000:3.0:1788746797.663566:0:22615:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4483d5fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f755556-f1cd-4e4b-8ec3-48b3fc3a369c+10:18021:x1875636305151872:12345-192.168.204.39@tcp:501:mount.lustre.0 00000100:00100000:3.0:1788746797.663753:0:22615:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4483d5fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f755556-f1cd-4e4b-8ec3-48b3fc3a369c+10:18021:x1875636305151872:12345-192.168.204.39@tcp:501:mount.lustre.0 Request processed in 180us (513us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746797.663761:0:22615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 128 00000100:00100000:2.0:1788746797.673828:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788746797.673962:0:22617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636305152000 00000100:00100000:0.0:1788746797.673972:0:22617:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636305152000 00000100:00100000:0.0:1788746797.674033:0:22617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 129 00000100:00100000:0.0:1788746797.674045:0:22617:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4483d5c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f755556-f1cd-4e4b-8ec3-48b3fc3a369c+10:18021:x1875636305152000:12345-192.168.204.39@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788746797.674240:0:22617:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4483d5c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f755556-f1cd-4e4b-8ec3-48b3fc3a369c+10:18021:x1875636305152000:12345-192.168.204.39@tcp:503:mount.lustre.0 Request processed in 188us (413us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746797.674251:0:22617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 129 00000100:00100000:0.0:1788746797.676768:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788746797.677071:0:22618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636305152128 00000100:00100000:1.0:1788746797.677081:0:22618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636305152128 00000100:00100000:1.0:1788746797.677158:0:22618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 130 00000100:00100000:1.0:1788746797.677178:0:22618:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4483cddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f755556-f1cd-4e4b-8ec3-48b3fc3a369c+10:18046:x1875636305152128:12345-192.168.204.39@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788746797.677603:0:22618:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4483cddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f755556-f1cd-4e4b-8ec3-48b3fc3a369c+10:18046:x1875636305152128:12345-192.168.204.39@tcp:502:llog_process_th.0 Request processed in 426us (843us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746797.677611:0:22618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 130 00000100:00100000:1.0:1788746797.685402:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788746797.685536:0:22615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636305152256 00000100:00100000:3.0:1788746797.685547:0:22615:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636305152256 00000100:00100000:3.0:1788746797.685604:0:22615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 131 00000100:00100000:3.0:1788746797.685614:0:22615:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4483cdcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f755556-f1cd-4e4b-8ec3-48b3fc3a369c+10:18046:x1875636305152256:12345-192.168.204.39@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788746797.686090:0:22615:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4483cdcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f755556-f1cd-4e4b-8ec3-48b3fc3a369c+10:18046:x1875636305152256:12345-192.168.204.39@tcp:502:llog_process_th.0 Request processed in 474us (694us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746797.686099:0:22615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 131 00000100:00100000:3.0:1788746797.706004:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788746797.706469:0:22623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636305152384 00000100:00100000:1.0:1788746797.706479:0:22623:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636305152384 00000100:00100000:1.0:1788746797.706533:0:22623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 7 00000100:00100000:1.0:1788746797.706543:0:22623:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a448448a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2398:x1875636305152384:12345-192.168.204.39@tcp:38:mount.lustre.0 00010000:00080000:1.0:1788746797.706574:0:22623:0:(ldlm_lib.c:1456:target_handle_connect()) lustre-MDT0000: connection from bbae771a-9fe8-425e-89d3-e0a0b7b26f24@192.168.204.39@tcp t0 exp 0000000000000000 cur 727 last 0 00000020:00000080:1.0:1788746797.706627:0:22623:0:(genops.c:1384:class_connect()) connect: client bbae771a-9fe8-425e-89d3-e0a0b7b26f24, cookie 0xfac36e8915414a55 00000004:00100000:1.0:1788746797.706652:0:22623:0:(mdt_handler.c:7491:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1788746797.706869:0:22623:0:(import.c:65:import_set_state_nolock()) ffff8a45912b2000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788746797.706944:0:22623:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a448448a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bbae771a-9fe8-425e-89d3-e0a0b7b26f24+6:2398:x1875636305152384:12345-192.168.204.39@tcp:38:mount.lustre.0 Request processed in 401us (949us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746797.706951:0:22623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 7 00000100:00100000:0.0:1788746797.717262:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788746797.717343:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788746797.717594:0:22623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636305152512 00000100:00100000:2.0:1788746797.717604:0:22623:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636305152512 00000100:00100000:2.0:1788746797.717680:0:22623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636305152896 00000100:00100000:2.0:1788746797.717685:0:22623:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636305152896 00000100:00100000:2.0:1788746797.717706:0:22623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 8 00000100:00100000:2.0:1788746797.717715:0:22623:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a45b0c52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bbae771a-9fe8-425e-89d3-e0a0b7b26f24+7:2399:x1875636305152512:12345-192.168.204.39@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788746797.717745:0:22623:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1788746797.717841:0:22623:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a45b0c52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bbae771a-9fe8-425e-89d3-e0a0b7b26f24+7:2399:x1875636305152512:12345-192.168.204.39@tcp:41:mount.lustre.0 Request processed in 126us (588us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746797.717849:0:22623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 8 00000100:00100000:2.0:1788746797.717867:0:22623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 9 00000100:00100000:2.0:1788746797.717873:0:22623:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a45b0c50380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bbae771a-9fe8-425e-89d3-e0a0b7b26f24+6:18021:x1875636305152896:12345-192.168.204.39@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788746797.717884:0:22623:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1788746797.717906:0:22623:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a45b0c50380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bbae771a-9fe8-425e-89d3-e0a0b7b26f24+6:18021:x1875636305152896:12345-192.168.204.39@tcp:41:mount.lustre.0 Request processed in 33us (563us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746797.717912:0:22623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 9 00000100:00080000:0.0:1788746797.718390:0:22619:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788746797.719026:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788746797.719086:0:22623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636305152640 00000100:00100000:2.0:1788746797.719093:0:22623:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636305152640 00000100:00100000:2.0:1788746797.719173:0:22623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 10 00000100:00100000:2.0:1788746797.719179:0:22623:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4484488000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2398:x1875636305152640:12345-192.168.204.39@tcp:38:mount.lustre.0 00010000:00080000:2.0:1788746797.719206:0:22623:0:(ldlm_lib.c:1456:target_handle_connect()) lustre-MDT0001: connection from bbae771a-9fe8-425e-89d3-e0a0b7b26f24@192.168.204.39@tcp t0 exp 0000000000000000 cur 727 last 0 00000020:00000080:2.0:1788746797.719277:0:22623:0:(genops.c:1384:class_connect()) connect: client bbae771a-9fe8-425e-89d3-e0a0b7b26f24, cookie 0xfac36e8915414a5c 00000004:00100000:2.0:1788746797.719321:0:22623:0:(mdt_handler.c:7491:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:2.0:1788746797.719520:0:22623:0:(import.c:65:import_set_state_nolock()) ffff8a45b7eda000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788746797.719576:0:22623:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4484488000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bbae771a-9fe8-425e-89d3-e0a0b7b26f24+6:2398:x1875636305152640:12345-192.168.204.39@tcp:38:mount.lustre.0 Request processed in 395us (553us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746797.719584:0:22623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 10 00000100:00100000:3.0:1788746797.723705:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788746797.727458:0:22625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636305153024 00000100:00100000:1.0:1788746797.727474:0:22625:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636305153024 00000100:00100000:1.0:1788746797.727542:0:22625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 11 00000100:00100000:1.0:1788746797.727552:0:22625:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4484488a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbae771a-9fe8-425e-89d3-e0a0b7b26f24+6:18021:x1875636305153024:12345-192.168.204.39@tcp:40:mount.lustre.0 00000100:00100000:1.0:1788746797.727652:0:22625:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4484488a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbae771a-9fe8-425e-89d3-e0a0b7b26f24+6:18021:x1875636305153024:12345-192.168.204.39@tcp:40:mount.lustre.0 Request processed in 100us (3961us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746797.727659:0:22625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 11 00000100:00100000:0.0:1788746797.736630:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788746797.736833:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788746797.737420:0:24129:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636305153152 00000100:00100000:2.0:1788746797.737431:0:24129:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636305153152 00000100:00100000:2.0:1788746797.737491:0:24129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 17 00000100:00100000:2.0:1788746797.737501:0:24129:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a45b0c50700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2398:x1875636305153152:12345-192.168.204.39@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788746797.737563:0:24129:0:(ldlm_lib.c:1456:target_handle_connect()) lustre-OST0000: connection from bbae771a-9fe8-425e-89d3-e0a0b7b26f24@192.168.204.39@tcp t0 exp 0000000000000000 cur 727 last 0 00000020:00000080:2.0:1788746797.737606:0:24129:0:(genops.c:1384:class_connect()) connect: client bbae771a-9fe8-425e-89d3-e0a0b7b26f24, cookie 0xfac36e8915414a63 00002000:00100000:2.0:1788746797.737618:0:24129:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli bbae771a-9fe8-425e-89d3-e0a0b7b26f24/ffff8a45b879d000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788746797.737630:0:24129:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788746797.737872:0:24129:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788746797.737907:0:24129:0:(import.c:65:import_set_state_nolock()) ffff8a45b8799800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788746797.737979:0:24129:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a45b0c50700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bbae771a-9fe8-425e-89d3-e0a0b7b26f24+6:2398:x1875636305153152:12345-192.168.204.39@tcp:8:mount.lustre.0 Request processed in 477us (1146us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746797.737987:0:24129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 17 00000100:00100000:2.0:1788746797.740842:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788746797.740970:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788746797.741346:0:22635:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636305153408 00000100:00100000:0.0:1788746797.741358:0:22635:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636305153408 00000100:00100000:0.0:1788746797.741421:0:22635:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 3 00000100:00100000:0.0:1788746797.741432:0:22635:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4484469180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:bbae771a-9fe8-425e-89d3-e0a0b7b26f24+6:18021:x1875636305153408:12345-192.168.204.39@tcp:900:mount.lustre.0 00000100:00100000:0.0:1788746797.741509:0:22635:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4484469180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:bbae771a-9fe8-425e-89d3-e0a0b7b26f24+6:18021:x1875636305153408:12345-192.168.204.39@tcp:900:mount.lustre.0 Request processed in 79us (678us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746797.741517:0:22635:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 3 00000100:00100000:3.0:1788746797.741872:0:24665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636305153280 00000100:00100000:3.0:1788746797.741879:0:24665:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636305153280 00000100:00100000:3.0:1788746797.741907:0:24665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 18 00000100:00100000:3.0:1788746797.741913:0:24665:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a448446b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2398:x1875636305153280:12345-192.168.204.39@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788746797.741942:0:24665:0:(ldlm_lib.c:1456:target_handle_connect()) lustre-OST0001: connection from bbae771a-9fe8-425e-89d3-e0a0b7b26f24@192.168.204.39@tcp t0 exp 0000000000000000 cur 727 last 0 00000020:00000080:3.0:1788746797.741972:0:24665:0:(genops.c:1384:class_connect()) connect: client bbae771a-9fe8-425e-89d3-e0a0b7b26f24, cookie 0xfac36e8915414a6a 00002000:00100000:3.0:1788746797.741998:0:24665:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli bbae771a-9fe8-425e-89d3-e0a0b7b26f24/ffff8a45b878a000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788746797.742017:0:24665:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788746797.742221:0:24665:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788746797.742319:0:24665:0:(import.c:65:import_set_state_nolock()) ffff8a45b878e000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788746797.742366:0:24665:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a448446b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bbae771a-9fe8-425e-89d3-e0a0b7b26f24+6:2398:x1875636305153280:12345-192.168.204.39@tcp:8:mount.lustre.0 Request processed in 452us (1395us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746797.742373:0:24665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 18 00000100:00100000:1.0:1788746797.743379:0:22625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636305152768 00000100:00100000:1.0:1788746797.743388:0:22625:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636305152768 00000100:00100000:3.0:1788746797.744011:0:22625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 12 00000100:00100000:3.0:1788746797.744021:0:22625:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a45b0c51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbae771a-9fe8-425e-89d3-e0a0b7b26f24+6:0:x1875636305152768:12345-192.168.204.39@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788746797.744049:0:22625:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788746797.744157:0:22625:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a45b0c51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbae771a-9fe8-425e-89d3-e0a0b7b26f24+6:0:x1875636305152768:12345-192.168.204.39@tcp:41:mount.lustre.0 Request processed in 136us (7537us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746797.744164:0:22625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 12 00000100:00080000:0.0:1788746797.748660:0:22619:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788746797.751542:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788746797.757483:0:22626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636305153536 00000100:00100000:2.0:1788746797.757503:0:22626:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636305153536 00000100:00100000:2.0:1788746797.757661:0:22626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 0 00000100:00100000:2.0:1788746797.757674:0:22626:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a448446b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bbae771a-9fe8-425e-89d3-e0a0b7b26f24+6:18021:x1875636305153536:12345-192.168.204.39@tcp:33:mount.lustre.0 00000004:00080000:0.0:1788746797.765383:0:22626:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 7583us 00000004:00200000:2.0:1788746797.777515:0:22626:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1788746797.777654:0:22626:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a448446b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bbae771a-9fe8-425e-89d3-e0a0b7b26f24+6:18021:x1875636305153536:12345-192.168.204.39@tcp:33:mount.lustre.0 Request processed in 19976us (26117us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746797.777665:0:22626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 0 00000100:00100000:1.0:1788746797.964900:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788746797.965130:0:22624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636305153664 00000100:00100000:0.0:1788746797.965158:0:22624:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636305153664 00000100:00100000:0.0:1788746797.965216:0:22624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 13 00000100:00100000:0.0:1788746797.965227:0:22624:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a45b7ef3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bbae771a-9fe8-425e-89d3-e0a0b7b26f24+6:18069:x1875636305153664:12345-192.168.204.39@tcp:101:mkdir.0 00010000:00010000:0.0:1788746797.965245:0:22624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788746797.965271:0:22624:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a4580031600/0xfac36e8915414a71 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4d2179c47f07887d expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746797.965372:0:22624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a4580031400/0xfac36e8915414a78 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746797.965386:0:22624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a4580031400/0xfac36e8915414a78 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746797.965400:0:22624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a4580031400/0xfac36e8915414a78 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22624 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788746797.965456:0:22624:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788746797.965460:0:22624:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788746797.965494:0:22624:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a4580031400/0xfac36e8915414a78 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746797.965764:0:22624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a4580031600/0xfac36e8915414a71 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.39@tcp remote: 0x4d2179c47f07887d expref: 8 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746797.965793:0:22624:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a4580031400/0xfac36e8915414a78 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.39@tcp remote: 0x4d2179c47f07887d expref: 7 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746797.965801:0:22624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a4483589300) 00010000:00010000:0.0:1788746797.965804:0:22624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788746797.965807:0:22624:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a4580031400, rc 0) 00000100:00100000:0.0:1788746797.965971:0:22624:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a45b7ef3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bbae771a-9fe8-425e-89d3-e0a0b7b26f24+7:18069:x1875636305153664:12345-192.168.204.39@tcp:101:mkdir.0 Request processed in 745us (1080us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746797.965979:0:22624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 13 00010000:00010000:3.0:1788746797.970400:0:22611:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788746798.355225:0:23382:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788746798.994642:0:22612:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788746799.314548:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a45b7ef0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875636324142720:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788746799.314622:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746799.314676:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a45b7ef7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875636324142848:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788746799.314714:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788746799.314748:0:24133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324142720 00000100:00100000:2.0:1788746799.314756:0:24133:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324142720 00000100:00100000:0.0:1788746799.314769:0:24134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324142848 00000100:00100000:0.0:1788746799.314774:0:24134:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324142848 00000100:00100000:2.0:1788746799.314809:0:24133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788746799.314820:0:24133:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a45bca92300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875636324142720:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788746799.314863:0:24133:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3915849728 avail 3684327424 00000100:00100000:2.0:1788746799.314915:0:24133:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a45bca92300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875636324142720:12345-0@lo:13:osp-pre-1-1.0 Request processed in 97us (294us total) trans 0 rc 0/0 00000100:00080000:1.0:1788746799.314996:0:22619:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788746799.315000:0:22619:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788746799.315015:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a448448b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875636324143360:0@lo:400:kworker.0 00000100:00100000:1.0:1788746799.315049:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746799.315099:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788746799.315105:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a4484489180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875636324143232:0@lo:400:kworker.0 00000100:00100000:3.0:1788746799.315187:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a448448bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:41310026-2b0a-472c-80e6-fbabf81d5070:3643:1875636324142976:0@lo:400:kworker.0 00000100:00100000:3.0:1788746799.315228:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746799.315253:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a4484488700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875636324143488:0@lo:400:kworker.0 00000100:00100000:3.0:1788746799.315276:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746799.315312:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a448448b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3643:1875636324144000:0@lo:400:kworker.0 00000100:00100000:3.0:1788746799.315333:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746799.315352:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1788746799.315358:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a4484488e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875636324143104:0@lo:400:kworker.0 00000100:00100000:3.0:1788746799.315395:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746799.315412:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a45b7ef0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875636324143616:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788746799.315444:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746799.315455:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a45c0ea5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3643:1875636324144128:0@lo:400:kworker.0 00000100:00100000:3.0:1788746799.315472:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746799.315500:0:22629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324143488 00000100:00100000:3.0:1788746799.315504:0:22629:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324143488 00000100:00100000:3.0:1788746799.315555:0:22629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324143104 00000100:00100000:3.0:1788746799.315559:0:22629:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324143104 00000100:00100000:3.0:1788746799.315573:0:22629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788746799.315579:0:22629:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4483cbea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875636324143488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788746799.315633:0:22629:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4483cbea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875636324143488:12345-0@lo:400:kworker.0 Request processed in 53us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746799.315641:0:22629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788746799.315658:0:22629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788746799.315664:0:22629:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4483dfea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1875636324143104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788746799.315692:0:22629:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4483dfea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1875636324143104:12345-0@lo:400:kworker.0 Request processed in 28us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746799.315698:0:22629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788746799.315737:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a4484488e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875636324143104:0@lo:400:kworker.0 00000100:00100000:3.0:1788746799.315747:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a4484488700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875636324143488:0@lo:400:kworker.0 00000100:00100000:3.0:1788746799.315768:0:22624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324143360 00000100:00100000:3.0:1788746799.315771:0:22624:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324143360 00000100:00100000:3.0:1788746799.315788:0:22624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324144000 00000100:00100000:3.0:1788746799.315791:0:22624:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324144000 00000100:00100000:3.0:1788746799.315806:0:22624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324144128 00000100:00100000:3.0:1788746799.315808:0:22624:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324144128 00000100:00100000:3.0:1788746799.315822:0:22624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788746799.315828:0:22624:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a45b7ef2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875636324143360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788746799.315867:0:22624:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a45b7ef2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875636324143360:12345-0@lo:400:kworker.0 Request processed in 38us (817us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746799.315874:0:22624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788746799.315886:0:22624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788746799.315893:0:22624:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4483dfed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875636324144000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788746799.315922:0:22624:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4483dfed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875636324144000:12345-0@lo:400:kworker.0 Request processed in 30us (587us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746799.315928:0:22624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788746799.315938:0:22624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788746799.315944:0:22624:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4483dfd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875636324144128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788746799.315968:0:22624:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4483dfd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875636324144128:12345-0@lo:400:kworker.0 Request processed in 25us (495us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746799.315973:0:22624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:3.0:1788746799.315998:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a45c0ea5f80 x1875636324144128/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788746815 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788746799.316009:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a45c0ea5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3643:1875636324144128:0@lo:400:kworker.0 00000100:00100000:3.0:1788746799.316021:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a448448b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3643:1875636324144000:0@lo:400:kworker.0 00000100:00100000:3.0:1788746799.316043:0:22618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324142976 00000100:00100000:3.0:1788746799.316047:0:22618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324142976 00000100:00100000:3.0:1788746799.316072:0:22618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1788746799.316091:0:22618:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4483cde850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41310026-2b0a-472c-80e6-fbabf81d5070+24:3643:x1875636324142976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788746799.316124:0:22618:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4483cde850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41310026-2b0a-472c-80e6-fbabf81d5070+24:3643:x1875636324142976:12345-0@lo:400:kworker.0 Request processed in 46us (895us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746799.316130:0:22618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1788746799.316171:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a448448bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:41310026-2b0a-472c-80e6-fbabf81d5070:3643:1875636324142976:0@lo:400:kworker.0 00000100:00100000:3.0:1788746799.316208:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a448448ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875636324143744:0@lo:400:kworker.0 00000100:00080000:3.0:1788746799.316262:0:22619:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788746799.316266:0:22619:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788746799.316394:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746799.316439:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a448448b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875636324143360:0@lo:400:kworker.0 00000100:00100000:1.0:1788746799.316454:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a448448a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875636324143872:0@lo:400:kworker.0 00000100:00100000:1.0:1788746799.316477:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746799.316493:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a4483cbd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3646:1875636324144384:0@lo:400:kworker.0 00000100:00100000:1.0:1788746799.316512:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746799.316551:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746799.316568:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a45c0ea6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3645:1875636324144256:0@lo:400:kworker.0 00000100:00100000:1.0:1788746799.316591:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746799.316621:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a45b7ef0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875636324142720:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788746799.316640:0:22623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324143872 00000100:00100000:1.0:1788746799.316644:0:22623:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324143872 00000100:00100000:1.0:1788746799.316659:0:22623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324144384 00000100:00100000:1.0:1788746799.316662:0:22623:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324144384 00000100:00100000:1.0:1788746799.316678:0:22623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324144256 00000100:00100000:1.0:1788746799.316680:0:22623:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324144256 00000100:00100000:1.0:1788746799.316691:0:22623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788746799.316696:0:22623:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a45b7ef2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875636324143872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788746799.316729:0:22623:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a45b7ef2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875636324143872:12345-0@lo:400:kworker.0 Request processed in 33us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746799.316735:0:22623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788746799.316746:0:22623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788746799.316752:0:22623:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4483dd9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875636324144384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788746799.316776:0:22623:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4483dd9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875636324144384:12345-0@lo:400:kworker.0 Request processed in 24us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746799.316788:0:22623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788746799.316799:0:22623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788746799.316804:0:22623:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4483dd9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1875636324144256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788746799.316833:0:22623:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4483dd9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1875636324144256:12345-0@lo:400:kworker.0 Request processed in 30us (241us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746799.316839:0:22623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:1.0:1788746799.316851:0:22619:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788746799.316854:0:22619:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788746799.316869:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a45c0ea6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3645:1875636324144256:0@lo:400:kworker.0 00000100:00100000:1.0:1788746799.316891:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a448448a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875636324143872:0@lo:400:kworker.0 00010000:00080000:1.0:1788746799.316901:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a4483cbd880 x1875636324144384/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788746815 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788746799.316910:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a4483cbd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3646:1875636324144384:0@lo:400:kworker.0 00000100:00100000:3.0:1788746799.317439:0:25016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324143232 00000100:00100000:3.0:1788746799.317446:0:25016:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324143232 00000100:00100000:3.0:1788746799.317492:0:25016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324143744 00000100:00100000:3.0:1788746799.317495:0:25016:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324143744 00000100:00100000:3.0:1788746799.317518:0:25016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788746799.317525:0:25016:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a45b7ef1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3646:x1875636324143232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788746799.317652:0:25016:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a45b7ef1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3646:x1875636324143232:12345-0@lo:400:kworker.0 Request processed in 128us (1258us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746799.317660:0:25016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788746799.317674:0:25016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788746799.317680:0:25016:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4483dd8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3645:x1875636324143744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788746799.317709:0:25016:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4483dd8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3645:x1875636324143744:12345-0@lo:400:kworker.0 Request processed in 30us (1158us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746799.317714:0:25016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788746799.317750:0:3646:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 12884901890 gen 2 00000100:00100000:3.0:1788746799.317762:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a4484489180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875636324143232:0@lo:400:kworker.0 00000100:00080000:1.0:1788746799.317863:0:22619:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788746799.317867:0:22619:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788746799.317887:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a448448ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875636324143744:0@lo:400:kworker.0 00000100:00100000:0.0:1788746799.319870:0:24134:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:0.0:1788746799.319889:0:24134:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00000100:00100000:0.0:1788746799.320228:0:24134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324143616 00000100:00100000:0.0:1788746799.320239:0:24134:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324143616 00000100:00100000:2.0:1788746799.324426:0:24133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788746799.324487:0:24133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788746799.324512:0:24133:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a45b7ef4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875636324142848:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788746799.324560:0:24133:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788746799.324674:0:24133:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a45b7ef4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875636324142848:12345-0@lo:13:osp-pre-0-0.0 Request processed in 177us (9958us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746799.324682:0:24133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788746799.324697:0:24133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788746799.324704:0:24133:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4483dfc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875636324143616:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788746799.324716:0:24133:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3915849728 avail 3684327424 00000100:00100000:2.0:1788746799.324760:0:24133:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4483dfc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875636324143616:12345-0@lo:13:osp-pre-1-0.0 Request processed in 57us (9315us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746799.324782:0:24133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788746799.324895:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a45b7ef0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875636324143616:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788746799.324999:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a45b7ef7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875636324142848:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788746799.940624:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788746799.942586:0:22623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636305153792 00000100:00100000:1.0:1788746799.942610:0:22623:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636305153792 00000100:00100000:1.0:1788746799.942759:0:22623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 14 00000100:00100000:1.0:1788746799.942774:0:22623:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a45b7ef5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bbae771a-9fe8-425e-89d3-e0a0b7b26f24+7:18122:x1875636305153792:12345-192.168.204.39@tcp:41:lfs.0 00000004:00000024:1.0:1788746799.942845:0:22623:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1788746799.942983:0:22623:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a45b7ef5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bbae771a-9fe8-425e-89d3-e0a0b7b26f24+7:18122:x1875636305153792:12345-192.168.204.39@tcp:41:lfs.0 Request processed in 212us (2375us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746799.943010:0:22623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 14 00000100:00080000:3.0:1788746799.944964:0:22619:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788746799.945335:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788746799.945573:0:22625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636305153920 00000100:00100000:1.0:1788746799.945590:0:22625:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636305153920 00000100:00100000:1.0:1788746799.945698:0:22625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 15 00000100:00100000:1.0:1788746799.945712:0:22625:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a45bca90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbae771a-9fe8-425e-89d3-e0a0b7b26f24+6:18122:x1875636305153920:12345-192.168.204.39@tcp:41:lfs.0 00000004:00000024:1.0:1788746799.945769:0:22625:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788746799.945891:0:22625:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a45bca90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbae771a-9fe8-425e-89d3-e0a0b7b26f24+6:18122:x1875636305153920:12345-192.168.204.39@tcp:41:lfs.0 Request processed in 182us (566us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746799.945900:0:22625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 15 00000100:00080000:3.0:1788746799.945988:0:22619:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788746799.950493:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788746799.950618:0:24134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636305154048 00000100:00100000:0.0:1788746799.950631:0:24134:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636305154048 00000100:00100000:0.0:1788746799.950775:0:24134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 13 00000100:00100000:0.0:1788746799.950788:0:24134:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a45bca91880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:bbae771a-9fe8-425e-89d3-e0a0b7b26f24+6:18122:x1875636305154048:12345-192.168.204.39@tcp:13:lfs.0 00002000:00000024:0.0:1788746799.950823:0:24134:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788746799.950941:0:24134:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a45bca91880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:bbae771a-9fe8-425e-89d3-e0a0b7b26f24+6:18122:x1875636305154048:12345-192.168.204.39@tcp:13:lfs.0 Request processed in 155us (461us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746799.950950:0:24134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 13 00000100:00100000:0.0:1788746799.954408:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788746799.955016:0:25416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636305154176 00000100:00100000:1.0:1788746799.955031:0:25416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636305154176 00000100:00100000:1.0:1788746799.955667:0:25416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 14 00000100:00100000:1.0:1788746799.955677:0:25416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a45b7ef4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:bbae771a-9fe8-425e-89d3-e0a0b7b26f24+6:18122:x1875636305154176:12345-192.168.204.39@tcp:13:lfs.0 00002000:00000024:1.0:1788746799.955703:0:25416:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3915849728 avail 3684327424 00000100:00100000:1.0:1788746799.955810:0:25416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a45b7ef4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:bbae771a-9fe8-425e-89d3-e0a0b7b26f24+6:18122:x1875636305154176:12345-192.168.204.39@tcp:13:lfs.0 Request processed in 133us (1411us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746799.955817:0:25416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 14 00000100:00080000:3.0:1788746799.956373:0:22619:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788746799.956395:0:22619:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788746800.024264:0:22611:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788746800.213853:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788746800.213960:0:22615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636305154304 00000100:00100000:3.0:1788746800.213972:0:22615:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636305154304 00000100:00100000:3.0:1788746800.214052:0:22615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 133 00000100:00100000:3.0:1788746800.214074:0:22615:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4483cdc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f755556-f1cd-4e4b-8ec3-48b3fc3a369c+10:18152:x1875636305154304:12345-192.168.204.39@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788746800.214094:0:22615:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788746800.214115:0:22615:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a45c216c200/0xfac36e8915414a7f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x4d2179c47f078884 expref: -99 pid: 22615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746800.214148:0:22615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a45c216c200/0xfac36e8915414a7f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.204.39@tcp remote: 0x4d2179c47f078884 expref: 11 pid: 22615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746800.214160:0:22615:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a45c216c200/0xfac36e8915414a7f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.204.39@tcp remote: 0x4d2179c47f078884 expref: 11 pid: 22615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746800.214172:0:22615:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a45c216c200, rc 0) 00000100:00100000:3.0:1788746800.214233:0:22615:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4483cdc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f755556-f1cd-4e4b-8ec3-48b3fc3a369c+11:18152:x1875636305154304:12345-192.168.204.39@tcp:101:mount.lustre.0 Request processed in 172us (392us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746800.214241:0:22615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 133 00000100:00100000:1.0:1788746800.228128:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788746800.228229:0:22617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636305154432 00000100:00100000:3.0:1788746800.228241:0:22617:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636305154432 00000100:00100000:3.0:1788746800.228347:0:22617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 134 00000100:00100000:3.0:1788746800.228358:0:22617:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4483cdf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f755556-f1cd-4e4b-8ec3-48b3fc3a369c+11:18152:x1875636305154432:12345-192.168.204.39@tcp:501:mount.lustre.0 00000100:00100000:3.0:1788746800.228600:0:22617:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4483cdf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f755556-f1cd-4e4b-8ec3-48b3fc3a369c+11:18152:x1875636305154432:12345-192.168.204.39@tcp:501:mount.lustre.0 Request processed in 243us (483us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746800.228609:0:22617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 134 00000100:00100000:0.0:1788746800.233520:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788746800.233618:0:22618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636305154560 00000100:00100000:1.0:1788746800.233630:0:22618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636305154560 00000100:00100000:1.0:1788746800.233691:0:22618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 135 00000100:00100000:1.0:1788746800.233710:0:22618:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4483cdd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f755556-f1cd-4e4b-8ec3-48b3fc3a369c+11:18152:x1875636305154560:12345-192.168.204.39@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788746800.233880:0:22618:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4483cdd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f755556-f1cd-4e4b-8ec3-48b3fc3a369c+11:18152:x1875636305154560:12345-192.168.204.39@tcp:503:mount.lustre.0 Request processed in 179us (371us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746800.233897:0:22618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 135 00000100:00100000:2.0:1788746800.236782:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788746800.236939:0:22615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636305154688 00000100:00100000:1.0:1788746800.236948:0:22615:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636305154688 00000100:00100000:1.0:1788746800.237008:0:22615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 136 00000100:00100000:1.0:1788746800.237017:0:22615:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4483cdd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f755556-f1cd-4e4b-8ec3-48b3fc3a369c+11:18159:x1875636305154688:12345-192.168.204.39@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788746800.237184:0:22615:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4483cdd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f755556-f1cd-4e4b-8ec3-48b3fc3a369c+11:18159:x1875636305154688:12345-192.168.204.39@tcp:502:llog_process_th.0 Request processed in 167us (415us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746800.237191:0:22615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 136 00000100:00100000:2.0:1788746800.274947:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788746800.275042:0:22617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636305154816 00000100:00100000:3.0:1788746800.275054:0:22617:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636305154816 00000100:00100000:3.0:1788746800.275125:0:22617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 137 00000100:00100000:3.0:1788746800.275135:0:22617:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4483cdf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f755556-f1cd-4e4b-8ec3-48b3fc3a369c+11:18159:x1875636305154816:12345-192.168.204.39@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788746800.275347:0:22617:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4483cdf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f755556-f1cd-4e4b-8ec3-48b3fc3a369c+11:18159:x1875636305154816:12345-192.168.204.39@tcp:502:llog_process_th.0 Request processed in 212us (410us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746800.275355:0:22617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 137 00000100:00100000:0.0:1788746800.296634:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788746800.300259:0:22618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636305154944 00000100:00100000:3.0:1788746800.300276:0:22618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636305154944 00000100:00100000:3.0:1788746800.300438:0:22618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 138 00000100:00100000:3.0:1788746800.300450:0:22618:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4483cde450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f755556-f1cd-4e4b-8ec3-48b3fc3a369c+11:18159:x1875636305154944:12345-192.168.204.39@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788746800.300626:0:22618:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4483cde450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f755556-f1cd-4e4b-8ec3-48b3fc3a369c+11:18159:x1875636305154944:12345-192.168.204.39@tcp:502:llog_process_th.0 Request processed in 178us (4005us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746800.300633:0:22618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 138 00000100:00100000:2.0:1788746800.309195:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788746800.309368:0:22615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636305155072 00000100:00100000:1.0:1788746800.309384:0:22615:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636305155072 00000100:00100000:1.0:1788746800.309462:0:22615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 139 00000100:00100000:1.0:1788746800.309475:0:22615:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4483cdc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f755556-f1cd-4e4b-8ec3-48b3fc3a369c+11:18152:x1875636305155072:12345-192.168.204.39@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788746800.309499:0:22615:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788746800.309525:0:22615:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a45b7f95400/0xfac36e8915414a86 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x4d2179c47f0788b5 expref: -99 pid: 22615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746800.309568:0:22615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a45b7f95400/0xfac36e8915414a86 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.39@tcp remote: 0x4d2179c47f0788b5 expref: 12 pid: 22615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746800.309580:0:22615:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a45b7f95400/0xfac36e8915414a86 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.39@tcp remote: 0x4d2179c47f0788b5 expref: 12 pid: 22615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746800.309592:0:22615:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a45b7f95400, rc 0) 00000100:00100000:1.0:1788746800.309679:0:22615:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4483cdc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f755556-f1cd-4e4b-8ec3-48b3fc3a369c+12:18152:x1875636305155072:12345-192.168.204.39@tcp:101:mount.lustre.0 Request processed in 206us (510us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746800.309686:0:22615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 139 00000100:00100000:2.0:1788746800.317388:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788746800.317518:0:22618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636305155200 00000100:00100000:3.0:1788746800.317532:0:22618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636305155200 00000100:00100000:3.0:1788746800.317611:0:22618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 140 00000100:00100000:3.0:1788746800.317626:0:22618:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4483cdec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f755556-f1cd-4e4b-8ec3-48b3fc3a369c+12:18152:x1875636305155200:12345-192.168.204.39@tcp:256:mount.lustre.0 20000000:01000000:3.0:1788746800.317666:0:22618:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1788746800.317839:0:22618:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1788746800.317845:0:22618:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1788746800.317849:0:22618:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1788746800.317852:0:22618:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:3.0:1788746800.317855:0:22618:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 14 00000100:00100000:1.0:1788746800.325904:0:22618:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4483cdec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f755556-f1cd-4e4b-8ec3-48b3fc3a369c+12:18152:x1875636305155200:12345-192.168.204.39@tcp:256:mount.lustre.0 Request processed in 8265us (8665us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746800.325925:0:22618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 140 00000100:00100000:2.0:1788746800.329981:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788746800.330668:0:22617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636305155328 00000100:00100000:0.0:1788746800.330684:0:22617:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636305155328 00000100:00100000:0.0:1788746800.330890:0:22617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 141 00000100:00100000:0.0:1788746800.330905:0:22617:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4483cde050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f755556-f1cd-4e4b-8ec3-48b3fc3a369c+12:18152:x1875636305155328:12345-192.168.204.39@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788746800.330949:0:22617:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788746800.330975:0:22617:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a4580031600/0xfac36e8915414a8d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x4d2179c47f0788bc expref: -99 pid: 22617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746800.331016:0:22617:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a4580031600/0xfac36e8915414a8d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.204.39@tcp remote: 0x4d2179c47f0788bc expref: 13 pid: 22617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746800.331030:0:22617:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a4580031600/0xfac36e8915414a8d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.39@tcp remote: 0x4d2179c47f0788bc expref: 13 pid: 22617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746800.331042:0:22617:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a4580031600, rc 0) 00000100:00100000:0.0:1788746800.331159:0:22617:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4483cde050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f755556-f1cd-4e4b-8ec3-48b3fc3a369c+13:18152:x1875636305155328:12345-192.168.204.39@tcp:101:mount.lustre.0 Request processed in 256us (1195us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746800.331167:0:22617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 141 00000100:00100000:2.0:1788746800.334657:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788746800.335006:0:22618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636305155456 00000100:00100000:1.0:1788746800.335020:0:22618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636305155456 00000100:00100000:1.0:1788746800.335112:0:22618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 142 00000100:00100000:1.0:1788746800.335126:0:22618:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4483cdf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f755556-f1cd-4e4b-8ec3-48b3fc3a369c+13:18152:x1875636305155456:12345-192.168.204.39@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788746800.335661:0:22618:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4483cdf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f755556-f1cd-4e4b-8ec3-48b3fc3a369c+13:18152:x1875636305155456:12345-192.168.204.39@tcp:501:mount.lustre.0 Request processed in 536us (1019us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746800.335671:0:22618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 142 00000100:00100000:3.0:1788746800.339019:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788746800.339627:0:22617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636305155584 00000100:00100000:0.0:1788746800.339644:0:22617:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636305155584 00000100:00100000:2.0:1788746800.339963:0:22617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 143 00000100:00100000:2.0:1788746800.339978:0:22617:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4483cdc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f755556-f1cd-4e4b-8ec3-48b3fc3a369c+13:18152:x1875636305155584:12345-192.168.204.39@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788746800.341990:0:22617:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4483cdc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f755556-f1cd-4e4b-8ec3-48b3fc3a369c+13:18152:x1875636305155584:12345-192.168.204.39@tcp:503:mount.lustre.0 Request processed in 260us (1228us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746800.342018:0:22617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 143 00000100:00100000:2.0:1788746800.344843:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788746800.345391:0:22618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636305155712 00000100:00100000:1.0:1788746800.345406:0:22618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636305155712 00000100:00100000:1.0:1788746800.345484:0:22618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 144 00000100:00100000:1.0:1788746800.345498:0:22618:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4585541850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f755556-f1cd-4e4b-8ec3-48b3fc3a369c+13:18166:x1875636305155712:12345-192.168.204.39@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788746800.345729:0:22618:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4585541850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f755556-f1cd-4e4b-8ec3-48b3fc3a369c+13:18166:x1875636305155712:12345-192.168.204.39@tcp:502:llog_process_th.0 Request processed in 232us (898us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746800.345739:0:22618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 144 00000100:00100000:1.0:1788746800.360476:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788746800.360595:0:22617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636305155840 00000100:00100000:2.0:1788746800.360609:0:22617:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636305155840 00000100:00100000:2.0:1788746800.360713:0:22617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 145 00000100:00100000:2.0:1788746800.360727:0:22617:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4585543450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f755556-f1cd-4e4b-8ec3-48b3fc3a369c+13:18166:x1875636305155840:12345-192.168.204.39@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788746800.360974:0:22617:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4585543450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f755556-f1cd-4e4b-8ec3-48b3fc3a369c+13:18166:x1875636305155840:12345-192.168.204.39@tcp:502:llog_process_th.0 Request processed in 250us (511us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746800.360984:0:22617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 145 00000100:00100000:0.0:1788746800.367879:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788746800.370535:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788746800.370723:0:22623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636305155968 00000100:00100000:1.0:1788746800.370740:0:22623:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636305155968 00000100:00100000:1.0:1788746800.370811:0:22623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636305156224 00000100:00100000:1.0:1788746800.370816:0:22623:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636305156224 00000100:00100000:1.0:1788746800.370837:0:22623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 16 00000100:00100000:1.0:1788746800.370849:0:22623:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a45b7ef4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2398:x1875636305155968:12345-192.168.204.39@tcp:38:mount.lustre.0 00010000:00080000:1.0:1788746800.370901:0:22623:0:(ldlm_lib.c:1456:target_handle_connect()) lustre-MDT0000: connection from 7d8327c8-4436-4f17-b07d-03a96e9e6b73@192.168.204.39@tcp t0 exp 0000000000000000 cur 730 last 0 00000020:00000080:1.0:1788746800.370978:0:22623:0:(genops.c:1384:class_connect()) connect: client 7d8327c8-4436-4f17-b07d-03a96e9e6b73, cookie 0xfac36e8915414a94 00000004:00100000:1.0:1788746800.371046:0:22623:0:(mdt_handler.c:7491:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1788746800.371220:0:22623:0:(import.c:65:import_set_state_nolock()) ffff8a4588ad1000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788746800.372594:0:22623:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a45b7ef4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7d8327c8-4436-4f17-b07d-03a96e9e6b73+6:2398:x1875636305155968:12345-192.168.204.39@tcp:38:mount.lustre.0 Request processed in 1736us (4734us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746800.372609:0:22623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 16 00000100:00100000:1.0:1788746800.372655:0:22623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 17 00000100:00100000:1.0:1788746800.372663:0:22623:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a45b7ef5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2398:x1875636305156224:12345-192.168.204.39@tcp:38:mount.lustre.0 00010000:00080000:1.0:1788746800.372695:0:22623:0:(ldlm_lib.c:1456:target_handle_connect()) lustre-MDT0001: connection from 7d8327c8-4436-4f17-b07d-03a96e9e6b73@192.168.204.39@tcp t0 exp 0000000000000000 cur 730 last 0 00000020:00000080:1.0:1788746800.372766:0:22623:0:(genops.c:1384:class_connect()) connect: client 7d8327c8-4436-4f17-b07d-03a96e9e6b73, cookie 0xfac36e8915414a9b 00000004:00100000:1.0:1788746800.372799:0:22623:0:(mdt_handler.c:7491:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:1.0:1788746800.372906:0:22623:0:(import.c:65:import_set_state_nolock()) ffff8a4587678000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788746800.372937:0:22623:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a45b7ef5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7d8327c8-4436-4f17-b07d-03a96e9e6b73+6:2398:x1875636305156224:12345-192.168.204.39@tcp:38:mount.lustre.0 Request processed in 274us (2418us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746800.372945:0:22623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 17 00000100:00100000:3.0:1788746800.377793:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788746800.377969:0:22623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636305156480 00000100:00100000:1.0:1788746800.377983:0:22623:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636305156480 00000100:00100000:1.0:1788746800.378107:0:22623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 18 00000100:00100000:1.0:1788746800.378120:0:22623:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4483dfd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7d8327c8-4436-4f17-b07d-03a96e9e6b73+6:18152:x1875636305156480:12345-192.168.204.39@tcp:41:mount.lustre.0 00000100:00080000:3.0:1788746800.378345:0:22619:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00000024:1.0:1788746800.378869:0:22623:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1788746800.379028:0:22623:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4483dfd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7d8327c8-4436-4f17-b07d-03a96e9e6b73+6:18152:x1875636305156480:12345-192.168.204.39@tcp:41:mount.lustre.0 Request processed in 905us (1246us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746800.379041:0:22623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 18 00000100:00100000:0.0:1788746800.386681:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788746800.386891:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788746800.387071:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788746800.387782:0:22624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636305156352 00000100:00100000:2.0:1788746800.387800:0:22624:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636305156352 00000100:00100000:2.0:1788746800.387903:0:22624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636305156096 00000100:00100000:2.0:1788746800.387928:0:22624:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636305156096 00000100:00100000:2.0:1788746800.387962:0:22624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 19 00000100:00100000:2.0:1788746800.387976:0:22624:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a45b7ef6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7d8327c8-4436-4f17-b07d-03a96e9e6b73+6:0:x1875636305156352:12345-192.168.204.39@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788746800.388035:0:22624:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788746800.388207:0:22624:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a45b7ef6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7d8327c8-4436-4f17-b07d-03a96e9e6b73+6:0:x1875636305156352:12345-192.168.204.39@tcp:41:mount.lustre.0 Request processed in 233us (1551us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746800.388216:0:22624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 19 00000100:00100000:2.0:1788746800.388399:0:22624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 20 00000100:00100000:2.0:1788746800.388408:0:22624:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a45b7ef5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7d8327c8-4436-4f17-b07d-03a96e9e6b73+6:0:x1875636305156096:12345-192.168.204.39@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788746800.388423:0:22624:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1788746800.388458:0:22624:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a45b7ef5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7d8327c8-4436-4f17-b07d-03a96e9e6b73+6:0:x1875636305156096:12345-192.168.204.39@tcp:41:mount.lustre.0 Request processed in 53us (1568us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746800.388465:0:22624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 20 00000100:00080000:1.0:1788746800.389495:0:22619:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788746800.389814:0:22624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636305156608 00000100:00100000:1.0:1788746800.389825:0:22624:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636305156608 00000100:00100000:1.0:1788746800.389890:0:22624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 21 00000100:00100000:1.0:1788746800.389917:0:22624:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a45b7ef4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7d8327c8-4436-4f17-b07d-03a96e9e6b73+6:18152:x1875636305156608:12345-192.168.204.39@tcp:40:mount.lustre.0 00000100:00100000:1.0:1788746800.389998:0:22624:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a45b7ef4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7d8327c8-4436-4f17-b07d-03a96e9e6b73+6:18152:x1875636305156608:12345-192.168.204.39@tcp:40:mount.lustre.0 Request processed in 84us (2927us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746800.390005:0:22624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 21 00000100:00100000:1.0:1788746800.394535:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788746800.394863:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788746800.395220:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788746800.395585:0:24130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636305156736 00000100:00100000:0.0:1788746800.395599:0:24130:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636305156736 00000100:00100000:0.0:1788746800.395699:0:24130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636305156864 00000100:00100000:0.0:1788746800.395703:0:24130:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636305156864 00000100:00100000:2.0:1788746800.395737:0:22635:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636305156992 00000100:00100000:2.0:1788746800.395742:0:22635:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636305156992 00000100:00100000:2.0:1788746800.395797:0:22635:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 4 00000100:00100000:2.0:1788746800.395809:0:22635:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4483ddad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:7d8327c8-4436-4f17-b07d-03a96e9e6b73+6:18152:x1875636305156992:12345-192.168.204.39@tcp:900:mount.lustre.0 00000100:00100000:2.0:1788746800.395933:0:22635:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4483ddad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:7d8327c8-4436-4f17-b07d-03a96e9e6b73+6:18152:x1875636305156992:12345-192.168.204.39@tcp:900:mount.lustre.0 Request processed in 126us (713us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746800.395942:0:22635:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 4 00000100:00100000:3.0:1788746800.396347:0:25016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 19 00000100:00100000:3.0:1788746800.396356:0:25016:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4483ddb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:2398:x1875636305156736:12345-192.168.204.39@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788746800.396408:0:25016:0:(ldlm_lib.c:1456:target_handle_connect()) lustre-OST0000: connection from 7d8327c8-4436-4f17-b07d-03a96e9e6b73@192.168.204.39@tcp t0 exp 0000000000000000 cur 730 last 0 00000020:00000080:3.0:1788746800.396469:0:25016:0:(genops.c:1384:class_connect()) connect: client 7d8327c8-4436-4f17-b07d-03a96e9e6b73, cookie 0xfac36e8915414aa2 00002000:00100000:3.0:1788746800.396485:0:25016:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 7d8327c8-4436-4f17-b07d-03a96e9e6b73/ffff8a45b878d000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788746800.396502:0:25016:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788746800.396596:0:25016:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788746800.396636:0:25016:0:(import.c:65:import_set_state_nolock()) ffff8a45b8789800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788746800.396687:0:25016:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4483ddb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7d8327c8-4436-4f17-b07d-03a96e9e6b73+6:2398:x1875636305156736:12345-192.168.204.39@tcp:8:mount.lustre.0 Request processed in 330us (2166us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746800.396696:0:25016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 19 00000100:00100000:3.0:1788746800.396713:0:25016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 20 00000100:00100000:3.0:1788746800.396717:0:25016:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4483dda300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:2398:x1875636305156864:12345-192.168.204.39@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788746800.396735:0:25016:0:(ldlm_lib.c:1456:target_handle_connect()) lustre-OST0001: connection from 7d8327c8-4436-4f17-b07d-03a96e9e6b73@192.168.204.39@tcp t0 exp 0000000000000000 cur 730 last 0 00000020:00000080:3.0:1788746800.396756:0:25016:0:(genops.c:1384:class_connect()) connect: client 7d8327c8-4436-4f17-b07d-03a96e9e6b73, cookie 0xfac36e8915414aa9 00002000:00100000:3.0:1788746800.396761:0:25016:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 7d8327c8-4436-4f17-b07d-03a96e9e6b73/ffff8a45b878c800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788746800.396768:0:25016:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788746800.396805:0:25016:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788746800.396821:0:25016:0:(import.c:65:import_set_state_nolock()) ffff8a45b8788800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788746800.396846:0:25016:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4483dda300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7d8327c8-4436-4f17-b07d-03a96e9e6b73+6:2398:x1875636305156864:12345-192.168.204.39@tcp:8:mount.lustre.0 Request processed in 127us (1984us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746800.396855:0:25016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 20 00000100:00100000:0.0:1788746800.399845:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788746800.405453:0:22627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636305157120 00000100:00100000:2.0:1788746800.405490:0:22627:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636305157120 00000100:00100000:2.0:1788746800.405588:0:22627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1 00000100:00100000:2.0:1788746800.405603:0:22627:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a45b7ef7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7d8327c8-4436-4f17-b07d-03a96e9e6b73+6:18152:x1875636305157120:12345-192.168.204.39@tcp:33:mount.lustre.0 00000004:00200000:2.0:1788746800.405770:0:22627:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1788746800.406217:0:22627:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a45b7ef7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7d8327c8-4436-4f17-b07d-03a96e9e6b73+6:18152:x1875636305157120:12345-192.168.204.39@tcp:33:mount.lustre.0 Request processed in 613us (6386us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746800.406228:0:22627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1 00000100:00100000:2.0:1788746800.534543:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788746800.534624:0:22624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636305157248 00000100:00100000:1.0:1788746800.534833:0:22624:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636305157248 00000100:00100000:1.0:1788746800.534921:0:22624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 22 00000100:00100000:1.0:1788746800.534935:0:22624:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a45bca92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7d8327c8-4436-4f17-b07d-03a96e9e6b73+6:18189:x1875636305157248:12345-192.168.204.39@tcp:101:mkdir.0 00010000:00010000:1.0:1788746800.534966:0:22624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788746800.535003:0:22624:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a45b7f94e00/0xfac36e8915414ab0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4d2179c47f0788ed expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746800.535120:0:22624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a45b7f95600/0xfac36e8915414ab7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746800.535141:0:22624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a45b7f95600/0xfac36e8915414ab7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746800.535159:0:22624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a45b7f95600/0xfac36e8915414ab7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22624 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788746800.535251:0:22624:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788746800.535257:0:22624:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788746800.535445:0:22624:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a45b7f95600/0xfac36e8915414ab7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746800.535507:0:22624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a45b7f94e00/0xfac36e8915414ab0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.39@tcp remote: 0x4d2179c47f0788ed expref: 8 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746800.535529:0:22624:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a45b7f95600/0xfac36e8915414ab7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.39@tcp remote: 0x4d2179c47f0788ed expref: 7 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746800.535539:0:22624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a4483589300) 00010000:00010000:1.0:1788746800.535542:0:22624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788746800.535548:0:22624:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a45b7f95600, rc 0) 00000100:00100000:1.0:1788746800.535649:0:22624:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a45bca92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7d8327c8-4436-4f17-b07d-03a96e9e6b73+7:18189:x1875636305157248:12345-192.168.204.39@tcp:101:mkdir.0 Request processed in 717us (1122us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746800.535659:0:22624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 22 00010000:00010000:2.0:1788746801.042539:0:22612:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788746802.074137:0:22611:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788746802.386814:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a45b7ef7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875636324144512:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788746802.386814:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a45b7ef6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875636324144640:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788746802.386935:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788746802.386945:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a4483dd8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875636324144768:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788746802.394551:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746802.394652:0:22629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324144512 00000100:00100000:0.0:1788746802.394666:0:22629:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324144512 00000100:00100000:2.0:1788746802.394971:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746802.395097:0:22629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324144640 00000100:00100000:0.0:1788746802.395118:0:22629:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324144640 00000100:00100000:0.0:1788746802.395144:0:22629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788746802.395153:0:22629:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4483dff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875636324144512:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788746802.395182:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00000024:0.0:1788746802.395192:0:22629:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1788746802.395220:0:24133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324144768 00000100:00100000:1.0:1788746802.395224:0:24133:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324144768 00000100:00100000:0.0:1788746802.395244:0:22629:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4483dff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875636324144512:12345-0@lo:41:osp-pre-0-1.0 Request processed in 92us (701us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746802.395251:0:22629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788746802.395260:0:24133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788746802.395267:0:24133:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4483dd8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875636324144768:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788746802.395269:0:22629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788746802.395275:0:22629:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a45bca91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875636324144640:12345-0@lo:41:osp-pre-1-0.0 00002000:00000024:1.0:1788746802.395305:0:24133:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000004:00000024:0.0:1788746802.395311:0:22629:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00080000:3.0:1788746802.395346:0:22619:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788746802.395346:0:24133:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4483dd8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875636324144768:12345-0@lo:13:osp-pre-0-1.0 Request processed in 77us (443us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746802.395346:0:22629:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a45bca91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875636324144640:12345-0@lo:41:osp-pre-1-0.0 Request processed in 69us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746802.395357:0:24133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788746802.395357:0:22629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788746802.395404:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a45b7ef7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875636324144512:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788746802.395407:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a4483dd8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875636324144768:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788746802.395408:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a45b7ef6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875636324144640:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788746803.091793:0:22612:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788746803.414734:0:24945:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 7d8327c8-4436-4f17-b07d-03a96e9e6b73 00000001:00100000:3.0:1788746803.414749:0:24945:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of bbae771a-9fe8-425e-89d3-e0a0b7b26f24 00000001:00100000:1.0:1788746803.418173:0:23357:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 7d8327c8-4436-4f17-b07d-03a96e9e6b73 00000001:00100000:1.0:1788746803.418213:0:23357:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of bbae771a-9fe8-425e-89d3-e0a0b7b26f24 00000001:00100000:2.0:1788746803.418811:0:22603:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 7d8327c8-4436-4f17-b07d-03a96e9e6b73 00000001:00100000:2.0:1788746803.418818:0:22603:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of bbae771a-9fe8-425e-89d3-e0a0b7b26f24 00000001:00100000:0.0:1788746803.419510:0:24125:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 7d8327c8-4436-4f17-b07d-03a96e9e6b73 00000001:00100000:0.0:1788746803.419518:0:24125:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of bbae771a-9fe8-425e-89d3-e0a0b7b26f24 00000001:02000400:2.0:1788746803.653036:0:25502:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:3.0:1788746804.114628:0:22611:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788746804.434657:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a4483dd8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875636324144896:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788746804.434741:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746804.435013:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788746804.435024:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a4483dff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875636324145024:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788746804.435054:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746804.435085:0:25416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324144896 00000100:00100000:3.0:1788746804.435092:0:25416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324144896 00000100:00100000:3.0:1788746804.435144:0:25416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324145024 00000100:00100000:3.0:1788746804.435148:0:25416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324145024 00000100:00100000:3.0:1788746804.435165:0:25416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788746804.435175:0:25416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4483dd9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875636324144896:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788746804.435204:0:25416:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788746804.435246:0:25416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4483dd9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875636324144896:12345-0@lo:13:osp-pre-0-0.0 Request processed in 73us (505us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746804.435253:0:25416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788746804.435269:0:25416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788746804.435275:0:25416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4483dfdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875636324145024:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788746804.435315:0:25416:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915849728 avail 3684327424 00000100:00100000:3.0:1788746804.435350:0:25416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4483dfdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875636324145024:12345-0@lo:13:osp-pre-1-1.0 Request processed in 75us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746804.435356:0:25416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:3.0:1788746804.435372:0:22619:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788746804.435376:0:22619:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788746804.435409:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a4483dff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875636324145024:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788746804.436955:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a45bca91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:41310026-2b0a-472c-80e6-fbabf81d5070:3644:1875636324145152:0@lo:400:kworker.0 00000100:00100000:2.0:1788746804.437034:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788746804.437065:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a4481b66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875636324145664:0@lo:400:kworker.0 00000100:00100000:2.0:1788746804.437093:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788746804.437113:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a4481b64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3644:1875636324146176:0@lo:400:kworker.0 00000100:00100000:2.0:1788746804.437137:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788746804.437158:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1788746804.437163:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a4481b65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875636324145536:0@lo:400:kworker.0 00000100:00100000:2.0:1788746804.437182:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788746804.437198:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a4481b66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3644:1875636324146048:0@lo:400:kworker.0 00000100:00100000:2.0:1788746804.437216:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788746804.437243:0:23652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324145664 00000100:00100000:2.0:1788746804.437250:0:23652:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324145664 00000100:00100000:2.0:1788746804.437311:0:23652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788746804.437320:0:23652:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4481b66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1875636324145664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788746804.437372:0:23652:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4481b66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1875636324145664:12345-0@lo:400:kworker.0 Request processed in 54us (278us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746804.437399:0:23652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788746804.437426:0:22623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324146176 00000100:00100000:2.0:1788746804.437430:0:22623:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324146176 00000100:00100000:2.0:1788746804.437454:0:22623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324145536 00000100:00100000:2.0:1788746804.437457:0:22623:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324145536 00000100:00100000:2.0:1788746804.437466:0:22623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324146048 00000100:00100000:2.0:1788746804.437469:0:22623:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324146048 00000100:00100000:2.0:1788746804.437481:0:22623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788746804.437486:0:22623:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4481b64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875636324146176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788746804.437516:0:22623:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4481b64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875636324146176:12345-0@lo:400:kworker.0 Request processed in 30us (379us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746804.437521:0:22623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788746804.437532:0:22623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788746804.437537:0:22623:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4481b67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875636324145536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788746804.437579:0:22623:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4481b67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875636324145536:12345-0@lo:400:kworker.0 Request processed in 42us (396us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746804.437584:0:22623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788746804.437596:0:22623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788746804.437602:0:22623:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4481b65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875636324146048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788746804.437833:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a4481b65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875636324145280:0@lo:400:kworker.0 00000100:00100000:0.0:1788746804.437864:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746804.437886:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a4481b67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875636324145792:0@lo:400:kworker.0 00000100:00100000:0.0:1788746804.437906:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746804.437921:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a4481b67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3645:1875636324146304:0@lo:400:kworker.0 00000100:00100000:0.0:1788746804.437940:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746804.437952:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1788746804.437957:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a4481b65c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875636324145408:0@lo:400:kworker.0 00000100:00100000:0.0:1788746804.438003:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746804.438018:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a4481b64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875636324145920:0@lo:400:kworker.0 00000100:00100000:0.0:1788746804.438039:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746804.438048:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a4481b66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3645:1875636324146432:0@lo:400:kworker.0 00000100:00100000:0.0:1788746804.438065:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746804.438085:0:22628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324145280 00000100:00100000:0.0:1788746804.438089:0:22628:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324145280 00000100:00100000:0.0:1788746804.438116:0:22628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788746804.438122:0:22628:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a45b7ef7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875636324145280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788746804.438156:0:22628:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a45b7ef7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875636324145280:12345-0@lo:400:kworker.0 Request processed in 35us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746804.438162:0:22628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788746804.438197:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a4481b65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875636324145280:0@lo:400:kworker.0 00000100:00100000:0.0:1788746804.438245:0:22624:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1788746804.438253:0:22624:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:0.0:1788746804.438283:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a4481b65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875636324145536:0@lo:400:kworker.0 00000100:00100000:0.0:1788746804.438317:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a4481b66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875636324145664:0@lo:400:kworker.0 00010000:00080000:0.0:1788746804.438329:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a4481b64000 x1875636324146176/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788746820 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788746804.438340:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a4481b64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3644:1875636324146176:0@lo:400:kworker.0 00000100:00100000:2.0:1788746804.438442:0:22623:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4481b65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875636324146048:12345-0@lo:400:kworker.0 Request processed in 839us (1223us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746804.438449:0:22623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788746804.438460:0:22623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324146304 00000100:00100000:2.0:1788746804.438463:0:22623:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324146304 00000100:00100000:2.0:1788746804.438479:0:22623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324145920 00000100:00100000:2.0:1788746804.438481:0:22623:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324145920 00000100:00100000:2.0:1788746804.438491:0:22623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324146432 00000100:00100000:2.0:1788746804.438501:0:22623:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324146432 00000100:00100000:2.0:1788746804.438518:0:22623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788746804.438523:0:22623:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a45b7ef7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1875636324146304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788746804.438558:0:22623:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a45b7ef7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1875636324146304:12345-0@lo:400:kworker.0 Request processed in 36us (618us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746804.438564:0:22623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788746804.438575:0:22623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788746804.438580:0:22623:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a45b7ef6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875636324145920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788746804.438604:0:22623:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a45b7ef6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875636324145920:12345-0@lo:400:kworker.0 Request processed in 25us (564us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746804.438609:0:22623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788746804.438772:0:22615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324145152 00000100:00100000:3.0:1788746804.438783:0:22615:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324145152 00000100:00100000:3.0:1788746804.438825:0:22615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1788746804.438832:0:22615:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4585542050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41310026-2b0a-472c-80e6-fbabf81d5070+24:3644:x1875636324145152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788746804.438866:0:22615:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4585542050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41310026-2b0a-472c-80e6-fbabf81d5070+24:3644:x1875636324145152:12345-0@lo:400:kworker.0 Request processed in 36us (1833us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746804.438871:0:22615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1788746804.438901:0:22625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788746804.438908:0:22625:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a45b7ef5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875636324146432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788746804.438934:0:22625:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a45b7ef5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875636324146432:12345-0@lo:400:kworker.0 Request processed in 27us (868us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746804.438940:0:22625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788746804.438958:0:24129:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324145792 00000100:00100000:3.0:1788746804.438962:0:24129:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324145792 00000100:00100000:3.0:1788746804.439001:0:24129:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324145408 00000100:00100000:3.0:1788746804.439005:0:24129:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324145408 00000100:00100000:3.0:1788746804.439028:0:24129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788746804.439034:0:24129:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a45b7ef4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875636324145792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788746804.439064:0:24129:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a45b7ef4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875636324145792:12345-0@lo:400:kworker.0 Request processed in 31us (1157us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746804.439070:0:24129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788746804.439079:0:24129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788746804.439085:0:24129:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a45b7ef6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875636324145408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788746804.439111:0:24129:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a45b7ef6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875636324145408:12345-0@lo:400:kworker.0 Request processed in 26us (1107us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746804.439116:0:24129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:3.0:1788746804.439133:0:22619:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788746804.439136:0:22619:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788746804.439145:0:22619:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788746804.439147:0:22619:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788746804.439185:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a4481b65c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875636324145408:0@lo:400:kworker.0 00000100:00100000:3.0:1788746804.439196:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a4481b64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875636324145920:0@lo:400:kworker.0 00010000:00080000:3.0:1788746804.439211:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a4481b66a00 x1875636324146432/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788746820 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788746804.439220:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a4481b66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3645:1875636324146432:0@lo:400:kworker.0 00000100:00100000:3.0:1788746804.439228:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a4481b67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875636324145792:0@lo:400:kworker.0 00000100:00100000:3.0:1788746804.439239:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a4481b67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3645:1875636324146304:0@lo:400:kworker.0 00000100:00100000:1.0:1788746804.439860:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a4483dff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875636324146560:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788746804.439910:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746804.440100:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a4483dd8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875636324144896:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788746804.440308:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a4481b66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3644:1875636324146048:0@lo:400:kworker.0 00000100:00100000:0.0:1788746804.440320:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a45bca91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:41310026-2b0a-472c-80e6-fbabf81d5070:3644:1875636324145152:0@lo:400:kworker.0 00000100:00100000:3.0:1788746804.445054:0:25416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324146560 00000100:00100000:3.0:1788746804.445072:0:25416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324146560 00000100:00100000:3.0:1788746804.445145:0:25416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788746804.445157:0:25416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4483dd9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875636324146560:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788746804.445209:0:25416:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915849728 avail 3684327424 00000100:00100000:3.0:1788746804.445357:0:25416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4483dd9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875636324146560:12345-0@lo:13:osp-pre-1-0.0 Request processed in 201us (5444us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746804.445364:0:25416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788746804.445520:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a4483dff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875636324146560:0@lo:13:osp-pre-1-0.0 00000040:00080000:0.0:1788746804.564521:0:22657:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788746805.139475:0:22612:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788746805.602446:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788746805.602501:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788746805.602536:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788746805.602561:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788746805.602583:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788746805.602605:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788746805.602626:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788746805.602646:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788746805.602670:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788746805.602705:0:22625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636305157632 00000100:00100000:0.0:1788746805.602717:0:22625:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636305157632 00000100:00100000:0.0:1788746805.602783:0:22625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636305158144 00000100:00100000:0.0:1788746805.602787:0:22625:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636305158144 00000100:00100000:0.0:1788746805.602802:0:22625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636305157504 00000100:00100000:0.0:1788746805.602804:0:22625:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636305157504 00000100:00100000:0.0:1788746805.602817:0:22625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636305158016 00000100:00100000:0.0:1788746805.602819:0:22625:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636305158016 00000100:00100000:0.0:1788746805.602836:0:22625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 51 00000100:00100000:0.0:1788746805.602847:0:22625:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a45b7ef5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbae771a-9fe8-425e-89d3-e0a0b7b26f24+5:2399:x1875636305157632:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:0.0:1788746805.602945:0:22625:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a45b7ef5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbae771a-9fe8-425e-89d3-e0a0b7b26f24+5:2399:x1875636305157632:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 99us (443us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746805.602953:0:22625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 51 00000100:00100000:1.0:1788746805.603102:0:22618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636305157376 00000100:00100000:1.0:1788746805.603108:0:22618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636305157376 00000100:00100000:1.0:1788746805.603148:0:22618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 147 00000100:00100000:1.0:1788746805.603156:0:22618:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4585543850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f755556-f1cd-4e4b-8ec3-48b3fc3a369c+13:2399:x1875636305157376:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:1.0:1788746805.603188:0:22618:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4585543850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f755556-f1cd-4e4b-8ec3-48b3fc3a369c+13:2399:x1875636305157376:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 33us (763us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746805.603195:0:22618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 147 00000100:00100000:1.0:1788746805.609973:0:25514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 52 00000100:00100000:1.0:1788746805.610008:0:25514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a45b7ef7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7d8327c8-4436-4f17-b07d-03a96e9e6b73+5:2399:x1875636305158144:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:1.0:1788746805.610204:0:25514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a45b7ef7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7d8327c8-4436-4f17-b07d-03a96e9e6b73+5:2399:x1875636305158144:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 214us (7640us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746805.610214:0:25514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 52 00000100:00100000:1.0:1788746805.610260:0:25514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 53 00000100:00100000:1.0:1788746805.610269:0:25514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a45bfe98a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bbae771a-9fe8-425e-89d3-e0a0b7b26f24+6:2399:x1875636305157504:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:1.0:1788746805.610512:0:25514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a45bfe98a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bbae771a-9fe8-425e-89d3-e0a0b7b26f24+6:2399:x1875636305157504:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 244us (7905us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746805.610520:0:25514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 53 00000100:00100000:1.0:1788746805.610848:0:25514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 54 00000100:00100000:1.0:1788746805.610857:0:25514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a45bfe98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7d8327c8-4436-4f17-b07d-03a96e9e6b73+6:2399:x1875636305158016:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:1.0:1788746805.610893:0:25514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a45bfe98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7d8327c8-4436-4f17-b07d-03a96e9e6b73+6:2399:x1875636305158016:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 38us (8246us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746805.610899:0:25514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 54 00000100:00100000:0.0:1788746805.616674:0:24130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636305157888 00000100:00100000:0.0:1788746805.616699:0:24130:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636305157888 00000100:00100000:0.0:1788746805.616788:0:24130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636305158400 00000100:00100000:0.0:1788746805.616792:0:24130:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636305158400 00000100:00100000:0.0:1788746805.616810:0:24130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636305157760 00000100:00100000:0.0:1788746805.616813:0:24130:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636305157760 00000100:00100000:0.0:1788746805.616843:0:24130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636305158272 00000100:00100000:0.0:1788746805.616846:0:24130:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636305158272 00000100:00100000:0.0:1788746805.616871:0:24130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 11 00000100:00100000:0.0:1788746805.616884:0:24130:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a45b7ef6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bbae771a-9fe8-425e-89d3-e0a0b7b26f24+5:2399:x1875636305157888:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:0.0:1788746805.617023:0:24130:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a45b7ef6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bbae771a-9fe8-425e-89d3-e0a0b7b26f24+5:2399:x1875636305157888:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 141us (14485us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746805.617031:0:24130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 11 00000100:00100000:0.0:1788746805.617052:0:24130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 12 00000100:00100000:0.0:1788746805.617059:0:24130:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a45bca91500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7d8327c8-4436-4f17-b07d-03a96e9e6b73+5:2399:x1875636305158400:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:0.0:1788746805.617084:0:24130:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a45bca91500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7d8327c8-4436-4f17-b07d-03a96e9e6b73+5:2399:x1875636305158400:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 26us (14500us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746805.617091:0:24130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 12 00000100:00100000:0.0:1788746805.617103:0:24130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 13 00000100:00100000:0.0:1788746805.617109:0:24130:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a45bfe98700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bbae771a-9fe8-425e-89d3-e0a0b7b26f24+5:2399:x1875636305157760:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:0.0:1788746805.617132:0:24130:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a45bfe98700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bbae771a-9fe8-425e-89d3-e0a0b7b26f24+5:2399:x1875636305157760:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 24us (14506us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746805.617139:0:24130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 13 00000100:00100000:0.0:1788746805.617161:0:24130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 14 00000100:00100000:0.0:1788746805.617169:0:24130:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a45bfe98380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7d8327c8-4436-4f17-b07d-03a96e9e6b73+5:2399:x1875636305158272:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:0.0:1788746805.617189:0:24130:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a45bfe98380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7d8327c8-4436-4f17-b07d-03a96e9e6b73+5:2399:x1875636305158272:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 21us (14518us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746805.617195:0:24130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 14 00000100:00080000:0.0:1788746805.617241:0:22619:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788746805.617245:0:22619:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788746805.617256:0:22619:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788746805.617260:0:22619:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1788746806.162482:0:22611:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788746807.188731:0:22612:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788746807.507085:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788746807.507118:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a4483dd8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875636324146688:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788746807.507216:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788746807.507364:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788746807.507374:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a4481b67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875636324146816:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788746807.507408:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788746807.507442:0:22629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324146816 00000100:00100000:2.0:1788746807.507451:0:22629:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324146816 00000100:00100000:2.0:1788746807.507508:0:22629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788746807.507517:0:22629:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4481b65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875636324146816:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788746807.507561:0:22629:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788746807.507613:0:22629:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4481b65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875636324146816:12345-0@lo:41:osp-pre-1-0.0 Request processed in 96us (204us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746807.507641:0:22629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788746807.507702:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a4481b67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875636324146816:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788746807.508338:0:24134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324146688 00000100:00100000:1.0:1788746807.508346:0:24134:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324146688 00000100:00100000:1.0:1788746807.508407:0:24134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788746807.508416:0:24134:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4481b64700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875636324146688:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788746807.508446:0:24134:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788746807.508504:0:24134:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4481b64700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875636324146688:12345-0@lo:13:osp-pre-0-1.0 Request processed in 90us (1289us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746807.508510:0:24134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:1.0:1788746807.508531:0:22619:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788746807.509004:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a4483ddbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875636324146944:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788746807.509056:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746807.509140:0:23652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324146944 00000100:00100000:1.0:1788746807.509146:0:23652:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324146944 00000100:00100000:1.0:1788746807.509190:0:23652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788746807.509197:0:23652:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a45bfe9a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1875636324146944:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788746807.509227:0:23652:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1788746807.509267:0:23652:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a45bfe9a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1875636324146944:12345-0@lo:41:osp-pre-0-1.0 Request processed in 71us (210us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746807.509274:0:23652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788746807.510061:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a4483ddbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875636324146944:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788746807.513723:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a4483dd8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875636324146688:0@lo:13:osp-pre-0-1.0 00000020:00000080:1.0:1788746807.811792:0:25651:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffec7a5dc80 20000000:00000080:1.0:1788746807.811824:0:25651:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8a4587579800 uarg=0000000000000000 20000000:01000000:1.0:1788746807.811927:0:25651:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1788746807.811935:0:25651:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1788746807.811941:0:25651:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1788746807.812787:0:25652:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 13 20000000:00000400:1.0:1788746807.813003:0:25651:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:1.0:1788746807.819818:0:25651:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1788746807.819858:0:25651:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a45b7f95e00/0xfac36e8915414abe lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746807.819882:0:25651:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a4581526200/0xfac36e891541471b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfac36e8915414714 expref: 23 pid: 22618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746807.819892:0:25651:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a4581526800/0xfac36e8915414729 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfac36e8915414722 expref: 23 pid: 22617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746807.819899:0:25651:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a45c216c000/0xfac36e8915414768 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfac36e8915414761 expref: 23 pid: 22617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746807.819906:0:25651:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a4581527c00/0xfac36e8915414802 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfac36e89154147fb expref: 23 pid: 22618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746807.822635:0:25651:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a45c216ca00/0xfac36e8915414a4e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.204.39@tcp remote: 0x4d2179c47f07884c expref: 12 pid: 22618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746807.822655:0:25651:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a4580031600/0xfac36e8915414a8d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.204.39@tcp remote: 0x4d2179c47f0788bc expref: 12 pid: 22617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746807.822664:0:25651:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a45b7f95e00/0xfac36e8915414abe lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 25651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746807.822725:0:25651:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a4580031600/0xfac36e8915414a8d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.204.39@tcp remote: 0x4d2179c47f0788bc expref: 12 pid: 22617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746807.822744:0:25651:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a4580031600/0xfac36e8915414a8d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.204.39@tcp remote: 0x4d2179c47f0788bc expref: 12 pid: 22617 timeout: 837 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788746807.823136:0:25651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a4483dda680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25651:1875636324147072:192.168.204.39@tcp:104: 00010000:00010000:1.0:1788746807.823241:0:25651:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a45c216ca00/0xfac36e8915414a4e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.204.39@tcp remote: 0x4d2179c47f07884c expref: 12 pid: 22618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746807.828466:0:25651:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a45c216ca00/0xfac36e8915414a4e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.204.39@tcp remote: 0x4d2179c47f07884c expref: 12 pid: 22618 timeout: 837 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788746807.828485:0:25651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a4483dd8a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25651:1875636324147200:192.168.204.39@tcp:104: 00010000:00010000:1.0:1788746807.828600:0:25651:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a4581527c00/0xfac36e8915414802 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xfac36e89154147fb expref: 23 pid: 22618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746807.828611:0:25651:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a4581527c00/0xfac36e8915414802 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xfac36e89154147fb expref: 23 pid: 22618 timeout: 837 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788746807.828621:0:25651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a4483ddbb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25651:1875636324147328:0@lo:104: 00000100:00100000:0.0:1788746807.829116:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788746807.829780:0:22609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636305158528 00000100:00100000:0.0:1788746807.829791:0:22609:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636305158528 00010000:00010000:0.0:1788746807.829832:0:22609:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a4580031600/0xfac36e8915414a8d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.204.39@tcp remote: 0x4d2179c47f0788bc expref: 13 pid: 22617 timeout: 837 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788746807.830067:0:22609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 9 00000100:00100000:0.0:1788746807.830079:0:22609:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a45bfe99f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0f755556-f1cd-4e4b-8ec3-48b3fc3a369c+13:2400:x1875636305158528:12345-192.168.204.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788746807.830140:0:22609:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788746807.830152:0:22609:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a4580031600/0xfac36e8915414a8d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 192.168.204.39@tcp remote: 0x4d2179c47f0788bc expref: 13 pid: 22617 timeout: 837 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746807.830165:0:22609:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a4580031600/0xfac36e8915414a8d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 192.168.204.39@tcp remote: 0x4d2179c47f0788bc expref: 13 pid: 22617 timeout: 837 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746807.830184:0:22609:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788746807.836069:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788746807.836557:0:22610:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1788746807.836579:0:22610:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:0.0:1788746807.837241:0:22609:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a45bfe99f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0f755556-f1cd-4e4b-8ec3-48b3fc3a369c+13:2400:x1875636305158528:12345-192.168.204.39@tcp:103:ldlm_bl.0 Request processed in 7157us (8577us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746807.837256:0:22609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 9 00000100:00100000:0.0:1788746807.837306:0:22609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636305158656 00000100:00100000:0.0:1788746807.837316:0:22609:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636305158656 00010000:00010000:0.0:1788746807.837348:0:22609:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a45c216ca00/0xfac36e8915414a4e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.204.39@tcp remote: 0x4d2179c47f07884c expref: 13 pid: 22618 timeout: 837 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788746807.837398:0:22609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 10 00000100:00100000:0.0:1788746807.837407:0:22609:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4481b67800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0f755556-f1cd-4e4b-8ec3-48b3fc3a369c+13:2399:x1875636305158656:12345-192.168.204.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788746807.837422:0:22609:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788746807.837430:0:22609:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a45c216ca00/0xfac36e8915414a4e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 192.168.204.39@tcp remote: 0x4d2179c47f07884c expref: 13 pid: 22618 timeout: 837 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746807.837442:0:22609:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a45c216ca00/0xfac36e8915414a4e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 192.168.204.39@tcp remote: 0x4d2179c47f07884c expref: 13 pid: 22618 timeout: 837 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746807.837463:0:22609:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788746807.837516:0:22609:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4481b67800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0f755556-f1cd-4e4b-8ec3-48b3fc3a369c+13:2399:x1875636305158656:12345-192.168.204.39@tcp:103:ldlm_bl.0 Request processed in 110us (1458us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746807.837523:0:22609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 10 00000100:00100000:2.0:1788746807.839399:0:25651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788746807.839508:0:25651:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a45c216c000/0xfac36e8915414768 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xfac36e8915414761 expref: 23 pid: 22617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746807.839528:0:25651:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a45c216c000/0xfac36e8915414768 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xfac36e8915414761 expref: 23 pid: 22617 timeout: 837 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788746807.839548:0:25651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a4481b66300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25651:1875636324147456:0@lo:104: 00000100:00100000:2.0:1788746807.839600:0:25651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788746807.839626:0:25651:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a4581526800/0xfac36e8915414729 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xfac36e8915414722 expref: 23 pid: 22617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746807.839636:0:25651:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a4581526800/0xfac36e8915414729 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xfac36e8915414722 expref: 23 pid: 22617 timeout: 837 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788746807.839645:0:25651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a4481b67480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25651:1875636324147584:0@lo:104: 00000100:00100000:2.0:1788746807.839665:0:25651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788746807.839681:0:25651:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a4581526200/0xfac36e891541471b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xfac36e8915414714 expref: 23 pid: 22618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746807.839690:0:25651:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a4581526200/0xfac36e891541471b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xfac36e8915414714 expref: 23 pid: 22618 timeout: 837 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788746807.839698:0:25651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a4481b64380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25651:1875636324147712:0@lo:104: 00000100:00100000:2.0:1788746807.839740:0:25651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788746807.839751:0:25651:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a4482545d80 going to sleep for 11 seconds 00010000:00010000:2.0:1788746807.839787:0:25651:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a4580031600/0xfac36e8915414a8d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 192.168.204.39@tcp remote: 0x4d2179c47f0788bc expref: 12 pid: 22617 timeout: 837 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788746807.839806:0:25651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a4483dda680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25651:1875636324147072:192.168.204.39@tcp:104: 00010000:00010000:2.0:1788746807.839819:0:25651:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a45c216ca00/0xfac36e8915414a4e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 192.168.204.39@tcp remote: 0x4d2179c47f07884c expref: 11 pid: 22618 timeout: 837 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788746807.839829:0:25651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a4483dd8a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25651:1875636324147200:192.168.204.39@tcp:104: 00000100:00100000:1.0:1788746807.840201:0:22606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324147328 00000100:00100000:1.0:1788746807.840215:0:22606:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324147328 00000100:00100000:1.0:1788746807.840273:0:22606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324147456 00000100:00100000:1.0:1788746807.840276:0:22606:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324147456 00000100:00100000:1.0:1788746807.840301:0:22606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324147584 00000100:00100000:1.0:1788746807.840304:0:22606:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324147584 00000100:00100000:1.0:1788746807.840312:0:22606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324147712 00000100:00100000:1.0:1788746807.840315:0:22606:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324147712 00000100:00100000:1.0:1788746807.840328:0:22606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788746807.840336:0:22606:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4481b64a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:41310026-2b0a-472c-80e6-fbabf81d5070+6:25651:x1875636324147328:12345-0@lo:104: 00010000:00010000:1.0:1788746807.840354:0:22606:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.139@tcp lock: ffff8a4581526400/0xfac36e89154147fb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xfac36e8915414802 expref: -99 pid: 24944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746807.840642:0:22606:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788746807.840648:0:22606:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4481b64a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:41310026-2b0a-472c-80e6-fbabf81d5070+6:25651:x1875636324147328:12345-0@lo:104: Request processed in 313us (1259us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746807.840656:0:22606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788746807.840674:0:22606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788746807.840679:0:22606:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4481b67b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:41310026-2b0a-472c-80e6-fbabf81d5070+5:25651:x1875636324147456:12345-0@lo:104: 00010000:00010000:1.0:1788746807.840687:0:22606:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.139@tcp lock: ffff8a4581527200/0xfac36e8915414761 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xfac36e8915414768 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746807.841075:0:22611:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788746807.841089:0:22611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.139@tcp lock: ffff8a4581526400/0xfac36e89154147fb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xfac36e8915414802 expref: -99 pid: 24944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746807.841102:0:22611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a4581526400 already unused, calling callback (ffffffffc1180c20) 00010000:00010000:1.0:1788746807.841102:0:22606:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 10000000:00010000:2.0:1788746807.841114:0:22611:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.139@tcp lock: ffff8a4581526400/0xfac36e89154147fb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xfac36e8915414802 expref: -99 pid: 24944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788746807.841117:0:22606:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4481b67b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:41310026-2b0a-472c-80e6-fbabf81d5070+5:25651:x1875636324147456:12345-0@lo:104: Request processed in 435us (1514us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746807.841149:0:22606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:2.0:1788746807.841152:0:22611:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.139@tcp lock: ffff8a4581526400/0xfac36e89154147fb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xfac36e8915414802 expref: -99 pid: 24944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788746807.841164:0:22611:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.139@tcp lock: ffff8a4581526400/0xfac36e89154147fb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xfac36e8915414802 expref: -99 pid: 24944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788746807.841173:0:22606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 10000000:01000000:2.0:1788746807.841174:0:22611:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:1.0:1788746807.841185:0:22606:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4481b66a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:41310026-2b0a-472c-80e6-fbabf81d5070+4:25651:x1875636324147584:12345-0@lo:104: 00010000:00010000:1.0:1788746807.841196:0:22606:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.139@tcp lock: ffff8a45ae45ee00/0xfac36e8915414722 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xfac36e8915414729 expref: -99 pid: 22620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746807.841235:0:22611:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.139@tcp lock: ffff8a4581526400/0xfac36e89154147fb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfac36e8915414802 expref: -99 pid: 24944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746807.841240:0:22606:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00010000:00010000:2.0:1788746807.841251:0:22611:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1788746807.841253:0:22606:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4481b66a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:41310026-2b0a-472c-80e6-fbabf81d5070+4:25651:x1875636324147584:12345-0@lo:104: Request processed in 72us (1587us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746807.841260:0:22606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788746807.841537:0:22606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788746807.841552:0:22606:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4481b65c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:41310026-2b0a-472c-80e6-fbabf81d5070+3:25651:x1875636324147712:12345-0@lo:104: 00010000:00010000:1.0:1788746807.841563:0:22606:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.139@tcp lock: ffff8a45ae45fe00/0xfac36e8915414714 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xfac36e891541471b expref: -99 pid: 22620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746807.841613:0:22606:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1788746807.841620:0:22606:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4481b65c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:41310026-2b0a-472c-80e6-fbabf81d5070+3:25651:x1875636324147712:12345-0@lo:104: Request processed in 74us (1877us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746807.841629:0:22606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788746807.842427:0:25651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a4483ddbb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25651:1875636324147328:0@lo:104: 00000100:00100000:0.0:1788746807.842452:0:25651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a4481b66300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25651:1875636324147456:0@lo:104: 00000100:00100000:0.0:1788746807.842467:0:25651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a4481b67480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25651:1875636324147584:0@lo:104: 00000100:00100000:0.0:1788746807.842482:0:25651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a4481b64380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25651:1875636324147712:0@lo:104: 00010000:00010000:3.0:1788746807.842514:0:22612:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788746807.842544:0:25651:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a45b7f95e00/0xfac36e8915414abe lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 25651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788746807.844017:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:2.0:1788746807.844565:0:22611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.139@tcp lock: ffff8a4581526400/0xfac36e89154147fb lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfac36e8915414802 expref: -99 pid: 24944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746807.844597:0:22611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.139@tcp lock: ffff8a4581526400/0xfac36e89154147fb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfac36e8915414802 expref: -99 pid: 24944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746807.844617:0:22611:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788746807.844623:0:22611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.139@tcp lock: ffff8a45ae45ee00/0xfac36e8915414722 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xfac36e8915414729 expref: -99 pid: 22620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746807.844630:0:22611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a45ae45ee00 already unused, calling callback (ffffffffc1180c20) 10000000:00010000:2.0:1788746807.844634:0:22611:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.139@tcp lock: ffff8a45ae45ee00/0xfac36e8915414722 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xfac36e8915414729 expref: -99 pid: 22620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746807.844645:0:22611:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.139@tcp lock: ffff8a45ae45ee00/0xfac36e8915414722 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xfac36e8915414729 expref: -99 pid: 22620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788746807.844652:0:22611:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.139@tcp lock: ffff8a45ae45ee00/0xfac36e8915414722 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xfac36e8915414729 expref: -99 pid: 22620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788746807.844659:0:22611:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788746807.844725:0:22611:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.139@tcp lock: ffff8a45ae45ee00/0xfac36e8915414722 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfac36e8915414729 expref: -99 pid: 22620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746807.844732:0:22611:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1788746807.846704:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a4481b66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:41310026-2b0a-472c-80e6-fbabf81d5070:3644:1875636324147968:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788746807.846825:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746807.846886:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a4481b64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:41310026-2b0a-472c-80e6-fbabf81d5070:3644:1875636324147840:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788746807.846908:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746807.847119:0:22609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324147968 00000100:00100000:1.0:1788746807.847136:0:22609:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324147968 00010000:00010000:1.0:1788746807.847185:0:22609:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a4581526800/0xfac36e8915414729 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfac36e8915414722 expref: 24 pid: 22617 timeout: 837 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788746807.847235:0:22609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324147840 00000100:00100000:1.0:1788746807.847238:0:22609:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324147840 00010000:00010000:1.0:1788746807.847344:0:22609:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a4581527c00/0xfac36e8915414802 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfac36e89154147fb expref: 25 pid: 22618 timeout: 837 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788746807.847374:0:22609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788746807.847384:0:22609:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a45bfe9ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41310026-2b0a-472c-80e6-fbabf81d5070+25:3644:x1875636324147968:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788746807.847411:0:22609:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788746807.847417:0:22609:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a4581526800/0xfac36e8915414729 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfac36e8915414722 expref: 25 pid: 22617 timeout: 837 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746807.847428:0:22609:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a4581526800/0xfac36e8915414729 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xfac36e8915414722 expref: 25 pid: 22617 timeout: 837 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746807.847458:0:22609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a4581526800/0xfac36e8915414729 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xfac36e8915414722 expref: 25 pid: 22617 timeout: 837 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746807.847479:0:22609:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788746807.847893:0:22609:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a45bfe9ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41310026-2b0a-472c-80e6-fbabf81d5070+24:3644:x1875636324147968:12345-0@lo:103:ldlm_bl.0 Request processed in 509us (1067us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746807.847927:0:22609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788746807.847948:0:22609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788746807.847954:0:22609:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a45bfe99180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41310026-2b0a-472c-80e6-fbabf81d5070+23:3644:x1875636324147840:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788746807.847974:0:22609:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788746807.847979:0:22609:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a4581527c00/0xfac36e8915414802 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfac36e89154147fb expref: 23 pid: 22618 timeout: 837 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746807.847988:0:22609:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a4581527c00/0xfac36e8915414802 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xfac36e89154147fb expref: 23 pid: 22618 timeout: 837 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746807.847999:0:22609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a4581527c00/0xfac36e8915414802 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xfac36e89154147fb expref: 23 pid: 22618 timeout: 837 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746807.848009:0:22609:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788746807.848032:0:22609:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a45bfe99180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41310026-2b0a-472c-80e6-fbabf81d5070+22:3644:x1875636324147840:12345-0@lo:103:ldlm_bl.0 Request processed in 79us (1124us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746807.848038:0:22609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788746807.848779:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a4481b66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:41310026-2b0a-472c-80e6-fbabf81d5070:3644:1875636324147968:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788746807.848797:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a4481b64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:41310026-2b0a-472c-80e6-fbabf81d5070:3644:1875636324147840:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788746807.849909:0:25654:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788746807.849953:0:22612:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.139@tcp lock: ffff8a4581527200/0xfac36e8915414761 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xfac36e8915414768 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746807.849968:0:22612:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a4581527200 already unused, calling callback (ffffffffc1180c20) 10000000:00010000:3.0:1788746807.849988:0:22612:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.139@tcp lock: ffff8a4581527200/0xfac36e8915414761 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xfac36e8915414768 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746807.849998:0:22612:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.139@tcp lock: ffff8a4581527200/0xfac36e8915414761 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xfac36e8915414768 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788746807.850005:0:22612:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.139@tcp lock: ffff8a4581527200/0xfac36e8915414761 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xfac36e8915414768 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788746807.850010:0:22612:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788746807.850061:0:22612:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.139@tcp lock: ffff8a4581527200/0xfac36e8915414761 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfac36e8915414768 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746807.850068:0:22612:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788746807.850095:0:22612:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.139@tcp lock: ffff8a4581527200/0xfac36e8915414761 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfac36e8915414768 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746807.850102:0:22612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.139@tcp lock: ffff8a4581527200/0xfac36e8915414761 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfac36e8915414768 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746807.850121:0:22612:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788746807.850124:0:22612:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788746807.850126:0:22612:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788746807.850145:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a4483dff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:41310026-2b0a-472c-80e6-fbabf81d5070:3645:1875636324148096:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788746807.850216:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746807.850338:0:22609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324148096 00000100:00100000:1.0:1788746807.850347:0:22609:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324148096 00010000:00010000:1.0:1788746807.850374:0:22609:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a45c216c000/0xfac36e8915414768 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfac36e8915414761 expref: 22 pid: 22617 timeout: 837 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788746807.850410:0:22609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788746807.850420:0:22609:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4584202450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41310026-2b0a-472c-80e6-fbabf81d5070+22:3645:x1875636324148096:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788746807.850432:0:22609:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788746807.850437:0:22609:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a45c216c000/0xfac36e8915414768 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfac36e8915414761 expref: 22 pid: 22617 timeout: 837 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746807.850459:0:22609:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a45c216c000/0xfac36e8915414768 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xfac36e8915414761 expref: 22 pid: 22617 timeout: 837 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746807.850472:0:22609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a45c216c000/0xfac36e8915414768 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xfac36e8915414761 expref: 22 pid: 22617 timeout: 837 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746807.850485:0:22609:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788746807.850529:0:22609:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4584202450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41310026-2b0a-472c-80e6-fbabf81d5070+21:3645:x1875636324148096:12345-0@lo:103:ldlm_bl.0 Request processed in 110us (314us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746807.850536:0:22609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788746807.850600:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a4483dff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:41310026-2b0a-472c-80e6-fbabf81d5070:3645:1875636324148096:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788746807.850834:0:25655:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788746807.850837:0:25655:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788746807.850839:0:25655:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788746807.850964:0:25654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.139@tcp lock: ffff8a45ae45fe00/0xfac36e8915414714 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xfac36e891541471b expref: -99 pid: 22620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746807.850973:0:25654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a45ae45fe00 already unused, calling callback (ffffffffc1180c20) 10000000:00010000:0.0:1788746807.850975:0:25654:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.139@tcp lock: ffff8a45ae45fe00/0xfac36e8915414714 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xfac36e891541471b expref: -99 pid: 22620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746807.850983:0:25654:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.139@tcp lock: ffff8a45ae45fe00/0xfac36e8915414714 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xfac36e891541471b expref: -99 pid: 22620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788746807.850988:0:25654:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.139@tcp lock: ffff8a45ae45fe00/0xfac36e8915414714 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xfac36e891541471b expref: -99 pid: 22620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788746807.850993:0:25654:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788746807.851023:0:25654:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.139@tcp lock: ffff8a45ae45fe00/0xfac36e8915414714 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfac36e891541471b expref: -99 pid: 22620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746807.851029:0:25654:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788746807.851043:0:25654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.139@tcp lock: ffff8a45ae45fe00/0xfac36e8915414714 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfac36e891541471b expref: -99 pid: 22620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746807.851049:0:25654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.139@tcp lock: ffff8a45ae45fe00/0xfac36e8915414714 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfac36e891541471b expref: -99 pid: 22620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746807.851059:0:25654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788746807.851060:0:25654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788746807.851062:0:25654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788746807.851428:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a45bfe99880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:41310026-2b0a-472c-80e6-fbabf81d5070:3646:1875636324148224:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788746807.851506:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746807.851630:0:22610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324148224 00010000:00010000:2.0:1788746807.851651:0:22611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.139@tcp lock: ffff8a45ae45ee00/0xfac36e8915414722 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfac36e8915414729 expref: -99 pid: 22620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788746807.851653:0:22610:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324148224 00010000:00010000:2.0:1788746807.851666:0:22611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.139@tcp lock: ffff8a45ae45ee00/0xfac36e8915414722 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfac36e8915414729 expref: -99 pid: 22620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746807.851686:0:22610:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a4581526200/0xfac36e891541471b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfac36e8915414714 expref: 21 pid: 22618 timeout: 837 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746807.851696:0:22611:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788746807.851716:0:22611:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788746807.851720:0:22611:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788746807.851723:0:22610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788746807.851736:0:22610:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4483dff480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41310026-2b0a-472c-80e6-fbabf81d5070+21:3646:x1875636324148224:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788746807.851748:0:22610:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788746807.851753:0:22610:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a4581526200/0xfac36e891541471b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfac36e8915414714 expref: 21 pid: 22618 timeout: 837 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746807.851774:0:22610:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a4581526200/0xfac36e891541471b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xfac36e8915414714 expref: 21 pid: 22618 timeout: 837 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746807.851789:0:22610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a4581526200/0xfac36e891541471b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xfac36e8915414714 expref: 21 pid: 22618 timeout: 837 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746807.851805:0:22610:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a45b7f95e00/0xfac36e8915414abe lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 25651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746807.851814:0:22610:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a45b7f95e00/0xfac36e8915414abe lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 25651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746807.851829:0:22610:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a45b7f95e00/0xfac36e8915414abe lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 25651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746807.851835:0:22610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a45b7f95e00/0xfac36e8915414abe lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 25651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746807.851842:0:22610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a45b7f95e00/0xfac36e8915414abe lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 25651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746807.851848:0:22610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a45b7f95e00/0xfac36e8915414abe lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 25651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746807.851862:0:22610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a45b7f95e00 already unused, calling callback (ffffffffc0b5a8d0) 00010000:00010000:0.0:1788746807.851866:0:22610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a45b7f95e00/0xfac36e8915414abe lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 25651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746807.851873:0:22610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a45b7f95e00/0xfac36e8915414abe lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 25651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746807.851896:0:22610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a45b7f95e00/0xfac36e8915414abe lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746807.851907:0:22610:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788746807.851988:0:22610:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4483dff480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41310026-2b0a-472c-80e6-fbabf81d5070+20:3646:x1875636324148224:12345-0@lo:103:ldlm_bl.0 Request processed in 256us (482us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746807.851995:0:22610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788746807.852153:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a45bfe99880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:41310026-2b0a-472c-80e6-fbabf81d5070:3646:1875636324148224:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788746807.853240:0:25651:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a45b7f95e00/0xfac36e8915414abe lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746807.853258:0:25651:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a45b7f95e00/0xfac36e8915414abe lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746807.853264:0:25651:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a45b7f95e00/0xfac36e8915414abe lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746808.211326:0:22612:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788746808.596628:0:23382:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788746809.234844:0:25655:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788746809.368261:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788746809.368431:0:25514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636305158784 00000100:00100000:1.0:1788746809.368443:0:25514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636305158784 00000100:00100000:1.0:1788746809.368528:0:25514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 23 00000100:00100000:1.0:1788746809.368539:0:25514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4483dfc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bbae771a-9fe8-425e-89d3-e0a0b7b26f24+6:18658:x1875636305158784:12345-192.168.204.39@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788746809.368559:0:25514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788746809.368581:0:25514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a45b7f94000/0xfac36e8915414ac5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4d2179c47f0788f4 expref: -99 pid: 25514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746809.368651:0:25514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a45b7f94a00/0xfac36e8915414acc lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746809.368666:0:25514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a45b7f94a00/0xfac36e8915414acc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746809.368680:0:25514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a45b7f94a00/0xfac36e8915414acc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746809.368712:0:25514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a45b7f94400/0xfac36e8915414ad3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746809.368720:0:25514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a45b7f94400/0xfac36e8915414ad3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746809.368728:0:25514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a45b7f94400/0xfac36e8915414ad3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746809.368808:0:25514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a45b7f94800/0xfac36e8915414ada lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746809.368818:0:25514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a45b7f94800/0xfac36e8915414ada lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746809.368825:0:25514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a45b7f94800/0xfac36e8915414ada lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788746809.368856:0:25514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788746809.368860:0:25514:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788746809.368915:0:25514:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a45b7f94800/0xfac36e8915414ada lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746809.368926:0:25514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a45b7f94a00/0xfac36e8915414acc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746809.368933:0:25514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a45b7f94a00/0xfac36e8915414acc lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746809.368940:0:25514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a45b7f94a00/0xfac36e8915414acc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746809.368956:0:25514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a45b7f94a00 already unused, calling callback (ffffffffc17914f0) 00010000:00010000:1.0:1788746809.368961:0:25514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a45b7f94a00/0xfac36e8915414acc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746809.368967:0:25514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a45b7f94a00/0xfac36e8915414acc lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746809.368978:0:25514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a4483589300) 00010000:00010000:1.0:1788746809.368981:0:25514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788746809.368986:0:25514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a45b7f94a00/0xfac36e8915414acc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746809.368993:0:25514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a45b7f94a00/0xfac36e8915414acc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746809.369007:0:25514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a45b7f94400/0xfac36e8915414ad3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746809.369013:0:25514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a45b7f94400/0xfac36e8915414ad3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746809.369019:0:25514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a45b7f94400/0xfac36e8915414ad3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746809.369023:0:25514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a45b7f94400 already unused, calling callback (ffffffffc17914f0) 00010000:00010000:1.0:1788746809.369026:0:25514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a45b7f94400/0xfac36e8915414ad3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746809.369031:0:25514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a45b7f94400/0xfac36e8915414ad3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746809.369048:0:25514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff8a45b59cac00) 00010000:00010000:1.0:1788746809.369050:0:25514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788746809.369053:0:25514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a45b7f94400/0xfac36e8915414ad3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746809.369059:0:25514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a45b7f94400/0xfac36e8915414ad3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746809.369092:0:25514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a45b7f94000/0xfac36e8915414ac5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.39@tcp remote: 0x4d2179c47f0788f4 expref: 8 pid: 25514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746809.369104:0:25514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a45b7f94800/0xfac36e8915414ada lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.39@tcp remote: 0x4d2179c47f0788f4 expref: 7 pid: 25514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746809.369110:0:25514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8a45b59ca700) 00010000:00010000:1.0:1788746809.369113:0:25514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788746809.369114:0:25514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a45b7f94800, rc 0) 00000100:00080000:0.0:1788746809.370136:0:22619:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788746809.370237:0:25514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4483dfc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bbae771a-9fe8-425e-89d3-e0a0b7b26f24+7:18658:x1875636305158784:12345-192.168.204.39@tcp:101:lhsmtool_posix.0 Request processed in 1695us (1980us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746809.370248:0:25514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 23 00000100:00100000:0.0:1788746809.377646:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788746809.377846:0:22634:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636305158912 00000100:00100000:2.0:1788746809.377857:0:22634:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636305158912 00000100:00100000:2.0:1788746809.377933:0:22634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 5 00000100:00100000:2.0:1788746809.377943:0:22634:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a45bfe9b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:bbae771a-9fe8-425e-89d3-e0a0b7b26f24+7:18658:x1875636305158912:12345-192.168.204.39@tcp:900:lhsmtool_posix.0 00000100:00100000:2.0:1788746809.378020:0:22634:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a45bfe9b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:bbae771a-9fe8-425e-89d3-e0a0b7b26f24+7:18658:x1875636305158912:12345-192.168.204.39@tcp:900:lhsmtool_posix.0 Request processed in 78us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746809.378028:0:22634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 5 00000100:00100000:0.0:1788746809.381756:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788746809.381951:0:22623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636305159168 00000100:00100000:2.0:1788746809.381966:0:22623:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636305159168 00000100:00100000:2.0:1788746809.382053:0:22623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 24 00000100:00100000:2.0:1788746809.382067:0:22623:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a45bfe99c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bbae771a-9fe8-425e-89d3-e0a0b7b26f24+7:18658:x1875636305159168:12345-192.168.204.39@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788746809.382096:0:22623:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788746809.382130:0:22623:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a4581689600/0xfac36e8915414ae1 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4d2179c47f0788fb expref: -99 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746809.382244:0:22623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a4581688200/0xfac36e8915414ae8 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746809.382328:0:22623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a4581688200/0xfac36e8915414ae8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746809.382348:0:22623:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a4581688200/0xfac36e8915414ae8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746809.382368:0:22623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a4581688c00/0xfac36e8915414aef lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746809.382377:0:22623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a4581688c00/0xfac36e8915414aef lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746809.382384:0:22623:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a4581688c00/0xfac36e8915414aef lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746809.389207:0:22623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a4581689e00/0xfac36e8915414af6 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746809.389231:0:22623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a4581689e00/0xfac36e8915414af6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746809.389244:0:22623:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a4581689e00/0xfac36e8915414af6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788746809.389258:0:22623:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:2.0:1788746809.389454:0:22623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a4581688200/0xfac36e8915414ae8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746809.389462:0:22623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a4581688200/0xfac36e8915414ae8 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746809.389469:0:22623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a4581688200/0xfac36e8915414ae8 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746809.389482:0:22623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a4581688200 already unused, calling callback (ffffffffc17914f0) 00010000:00010000:2.0:1788746809.389486:0:22623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a4581688200/0xfac36e8915414ae8 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746809.389492:0:22623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a4581688200/0xfac36e8915414ae8 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746809.389504:0:22623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8a45b59ca700) 00010000:00010000:2.0:1788746809.389508:0:22623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788746809.389512:0:22623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a4581688200/0xfac36e8915414ae8 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746809.389518:0:22623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a4581688200/0xfac36e8915414ae8 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746809.389534:0:22623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a4581688c00/0xfac36e8915414aef lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746809.389539:0:22623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a4581688c00/0xfac36e8915414aef lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746809.389545:0:22623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a4581688c00/0xfac36e8915414aef lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746809.389550:0:22623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a4581688c00 already unused, calling callback (ffffffffc17914f0) 00010000:00010000:2.0:1788746809.389553:0:22623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a4581688c00/0xfac36e8915414aef lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746809.389558:0:22623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a4581688c00/0xfac36e8915414aef lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746809.389578:0:22623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8a4483586000) 00010000:00010000:2.0:1788746809.389581:0:22623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788746809.389583:0:22623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a4581688c00/0xfac36e8915414aef lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746809.389589:0:22623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a4581688c00/0xfac36e8915414aef lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746809.397713:0:22623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a4581689600/0xfac36e8915414ae1 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.39@tcp remote: 0x4d2179c47f0788fb expref: 10 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746809.397743:0:22623:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a4581689e00/0xfac36e8915414af6 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.39@tcp remote: 0x4d2179c47f0788fb expref: 9 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746809.397753:0:22623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8a4483586a00) 00010000:00010000:2.0:1788746809.397756:0:22623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788746809.397759:0:22623:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a4581689e00, rc 0) 00000100:00100000:2.0:1788746809.397844:0:22623:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a45bfe99c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bbae771a-9fe8-425e-89d3-e0a0b7b26f24+9:18658:x1875636305159168:12345-192.168.204.39@tcp:101:lhsmtool_posix.0 Request processed in 15779us (16103us total) trans 12884901889 rc 0/0 00000100:00100000:2.0:1788746809.397853:0:22623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 24 00000100:00100000:0.0:1788746809.410511:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788746809.410857:0:22625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636305159296 00000100:00100000:3.0:1788746809.410873:0:22625:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636305159296 00000100:00100000:3.0:1788746809.410965:0:22625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 25 00000100:00100000:3.0:1788746809.410976:0:22625:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a45bfe9aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbae771a-9fe8-425e-89d3-e0a0b7b26f24+9:18658:x1875636305159296:12345-192.168.204.39@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1788746809.411098:0:22625:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a45bfe9aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbae771a-9fe8-425e-89d3-e0a0b7b26f24+9:18658:x1875636305159296:12345-192.168.204.39@tcp:59:lhsmtool_posix.0 Request processed in 124us (604us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746809.411107:0:22625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 25 00000100:00100000:0.0:1788746809.419342:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788746809.422897:0:22624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636305159424 00000100:00100000:2.0:1788746809.422914:0:22624:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636305159424 00000100:00100000:2.0:1788746809.423025:0:22624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 26 00000100:00100000:2.0:1788746809.423041:0:22624:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a45bfe9bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bbae771a-9fe8-425e-89d3-e0a0b7b26f24+5:18658:x1875636305159424:12345-192.168.204.39@tcp:59:lhsmtool_posix.0 00000100:00080000:0.0:1788746809.423230:0:22619:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000004:00080000:0.0:1788746809.425479:0:22624:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 2391us 00000100:00100000:3.0:1788746809.462811:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788746809.462916:0:22625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636305159552 00000100:00100000:1.0:1788746809.462926:0:22625:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636305159552 00000100:00100000:1.0:1788746809.463340:0:22625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 27 00000100:00100000:1.0:1788746809.463353:0:22625:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4483dfdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbae771a-9fe8-425e-89d3-e0a0b7b26f24+9:18664:x1875636305159552:12345-192.168.204.39@tcp:101:lfs.0 00010000:00010000:1.0:1788746809.463379:0:22625:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788746809.463404:0:22625:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a45b7f94000/0xfac36e8915414b04 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4d2179c47f078902 expref: -99 pid: 22625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746809.463500:0:22625:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a45b7f94400/0xfac36e8915414b0b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746809.463516:0:22625:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a45b7f94400/0xfac36e8915414b0b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746809.463528:0:22625:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a45b7f94400/0xfac36e8915414b0b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746809.463594:0:22625:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a45b7f94a00/0xfac36e8915414b12 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746809.463602:0:22625:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a45b7f94a00/0xfac36e8915414b12 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746809.463609:0:22625:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a45b7f94a00/0xfac36e8915414b12 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746809.463650:0:22625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a45b7f94400/0xfac36e8915414b0b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746809.463657:0:22625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a45b7f94400/0xfac36e8915414b0b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746809.463662:0:22625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a45b7f94400/0xfac36e8915414b0b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746809.463668:0:22625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a45b7f94400 already unused, calling callback (ffffffffc17914f0) 00010000:00010000:1.0:1788746809.463672:0:22625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a45b7f94400/0xfac36e8915414b0b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746809.463690:0:22625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a45b7f94400/0xfac36e8915414b0b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746809.463703:0:22625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a4483589300) 00010000:00010000:1.0:1788746809.463706:0:22625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788746809.463711:0:22625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a45b7f94400/0xfac36e8915414b0b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746809.463716:0:22625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a45b7f94400/0xfac36e8915414b0b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746809.463726:0:22625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a45b7f94a00/0xfac36e8915414b12 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746809.463732:0:22625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a45b7f94a00/0xfac36e8915414b12 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746809.463737:0:22625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a45b7f94a00/0xfac36e8915414b12 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746809.463743:0:22625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a45b7f94a00 already unused, calling callback (ffffffffc17914f0) 00010000:00010000:1.0:1788746809.463746:0:22625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a45b7f94a00/0xfac36e8915414b12 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746809.463752:0:22625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a45b7f94a00/0xfac36e8915414b12 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746809.463760:0:22625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff8a45b59cac00) 00010000:00010000:1.0:1788746809.463762:0:22625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788746809.463765:0:22625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a45b7f94a00/0xfac36e8915414b12 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746809.463780:0:22625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a45b7f94a00/0xfac36e8915414b12 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746809.463815:0:22625:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a45b7f94000/0xfac36e8915414b04 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.39@tcp remote: 0x4d2179c47f078902 expref: 10 pid: 22625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746809.463826:0:22625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a4483589300) 00010000:00010000:1.0:1788746809.463828:0:22625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788746809.463832:0:22625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a45b7f94000/0xfac36e8915414b04 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.39@tcp remote: 0x4d2179c47f078902 expref: 10 pid: 22625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746809.463840:0:22625:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a45b7f94000, rc 0) 00000100:00100000:1.0:1788746809.463913:0:22625:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4483dfdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbae771a-9fe8-425e-89d3-e0a0b7b26f24+9:18664:x1875636305159552:12345-192.168.204.39@tcp:101:lfs.0 Request processed in 563us (1111us total) trans 0 rc 301/301 00000100:00100000:1.0:1788746809.463923:0:22625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 27 00000100:00100000:3.0:1788746809.469276:0:22624:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a45bfe9bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bbae771a-9fe8-425e-89d3-e0a0b7b26f24+5:18658:x1875636305159424:12345-192.168.204.39@tcp:59:lhsmtool_posix.0 Request processed in 46232us (49981us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746809.469306:0:22624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 26 00000100:00100000:3.0:1788746809.475491:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788746809.475902:0:22632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636305159680 00000100:00100000:0.0:1788746809.475912:0:22632:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636305159680 00000100:00100000:0.0:1788746809.476207:0:22632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 0 00000100:00100000:0.0:1788746809.476218:0:22632:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4483dfd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:bbae771a-9fe8-425e-89d3-e0a0b7b26f24+9:18664:x1875636305159680:12345-192.168.204.39@tcp:700:lfs.0 00000100:00100000:0.0:1788746809.476326:0:22632:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4483dfd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:bbae771a-9fe8-425e-89d3-e0a0b7b26f24+9:18664:x1875636305159680:12345-192.168.204.39@tcp:700:lfs.0 Request processed in 110us (844us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746809.476347:0:22632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 0 00000100:00100000:1.0:1788746809.479505:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788746809.485166:0:22623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636305159936 00000100:00100000:3.0:1788746809.485184:0:22623:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636305159936 00000100:00100000:0.0:1788746809.485354:0:22623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 28 00000100:00100000:0.0:1788746809.485364:0:22623:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4483dd8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bbae771a-9fe8-425e-89d3-e0a0b7b26f24+9:18664:x1875636305159936:12345-192.168.204.39@tcp:36:lfs.0 00010000:00010000:0.0:1788746809.485425:0:22623:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788746809.485452:0:22623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a4580031400/0xfac36e8915414a78 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.39@tcp remote: 0x4d2179c47f07887d expref: 9 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746809.485475:0:22623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a4483589300) 00010000:00010000:0.0:1788746809.485480:0:22623:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788746809.485555:0:22623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a4580030e00/0xfac36e8915414b19 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746809.485570:0:22623:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a45b7f95600/0xfac36e8915414ab7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.39@tcp remote: 0x4d2179c47f0788ed expref: 5 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746809.485579:0:22623:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a4580030e00/0xfac36e8915414b19 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746809.485615:0:22623:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a45b7f95600/0xfac36e8915414ab7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.39@tcp remote: 0x4d2179c47f0788ed expref: 5 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746809.485628:0:22623:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a45b7f95600/0xfac36e8915414ab7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.39@tcp remote: 0x4d2179c47f0788ed expref: 5 pid: 22624 timeout: 839 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788746809.485643:0:22623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a45bfe9a680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22623:1875636324148352:192.168.204.39@tcp:104: 00000100:00100000:0.0:1788746809.485737:0:22623:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a45833e73c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788746809.488549:0:22623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a45bfe9a680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22623:1875636324148352:192.168.204.39@tcp:104: 00010000:00010000:0.0:1788746809.488595:0:22623:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a4580030e00/0xfac36e8915414b19 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788746809.490401:0:22620:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788746809.490408:0:22620:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8a45b49b3000 from 13 10000000:01000000:1.0:1788746809.490413:0:22620:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788746809.490474:0:22620:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.139@tcp lock: ffff8a45b7f94000/0xfac36e8915414b20 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746809.490485:0:22620:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.139@tcp lock: ffff8a45b7f94000/0xfac36e8915414b20 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746809.490498:0:22620:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.139@tcp lock: ffff8a45b7f94000/0xfac36e8915414b20 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788746809.490534:0:22620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a4483ddbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:41310026-2b0a-472c-80e6-fbabf81d5070:22620:1875636324148480:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788746809.490632:0:22620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746809.490679:0:22620:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a4482545300 going to sleep for 11 seconds 00000100:00100000:3.0:1788746809.491426:0:22617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324148480 00000100:00100000:3.0:1788746809.491435:0:22617:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324148480 00000100:00100000:3.0:1788746809.491482:0:22617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1788746809.491492:0:22617:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4585543c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41310026-2b0a-472c-80e6-fbabf81d5070+20:22620:x1875636324148480:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788746809.491505:0:22617:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788746809.491635:0:22617:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a45c216ce00/0xfac36e8915414b27 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xfac36e8915414b20 expref: -99 pid: 22617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746809.491662:0:22617:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a45c216ce00/0xfac36e8915414b27 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfac36e8915414b20 expref: 21 pid: 22617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746809.491674:0:22617:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a45c216ce00/0xfac36e8915414b27 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfac36e8915414b20 expref: 21 pid: 22617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746809.491691:0:22617:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a45c216ce00, rc 0) 00000100:00100000:3.0:1788746809.494704:0:22617:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4585543c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41310026-2b0a-472c-80e6-fbabf81d5070+21:22620:x1875636324148480:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 3204us (4062us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746809.494718:0:22617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1788746809.496901:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788746809.496989:0:22609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636305160064 00000100:00100000:0.0:1788746809.497012:0:22609:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636305160064 00010000:00010000:0.0:1788746809.497104:0:22609:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a45b7f95600/0xfac36e8915414ab7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.39@tcp remote: 0x4d2179c47f0788ed expref: 6 pid: 22624 timeout: 839 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788746809.497124:0:22619:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788746809.497166:0:22609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 15 00000100:00100000:0.0:1788746809.497180:0:22609:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4481b65180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7d8327c8-4436-4f17-b07d-03a96e9e6b73+6:2400:x1875636305160064:12345-192.168.204.39@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1788746809.497185:0:22620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a4483ddbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:41310026-2b0a-472c-80e6-fbabf81d5070:22620:1875636324148480:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788746809.497204:0:22609:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788746809.497219:0:22609:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a45b7f95600/0xfac36e8915414ab7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.39@tcp remote: 0x4d2179c47f0788ed expref: 6 pid: 22624 timeout: 839 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746809.497220:0:22620:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.139@tcp lock: ffff8a45b7f94000/0xfac36e8915414b20 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfac36e8915414b27 expref: -99 pid: 22620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746809.497261:0:22620:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.139@tcp lock: ffff8a45b7f94000/0xfac36e8915414b20 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xfac36e8915414b27 expref: -99 pid: 22620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746809.497268:0:22609:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a45b7f95600/0xfac36e8915414ab7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.39@tcp remote: 0x4d2179c47f0788ed expref: 6 pid: 22624 timeout: 839 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746809.497326:0:22609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a45b7f95600/0xfac36e8915414ab7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.39@tcp remote: 0x4d2179c47f0788ed expref: 6 pid: 22624 timeout: 839 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746809.497346:0:22609:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a4483589300) 00010000:00010000:0.0:1788746809.497352:0:22609:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8a4580030e00/0xfac36e8915414b19 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746809.497362:0:22609:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a4580030e00/0xfac36e8915414b19 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746809.497370:0:22609:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a4580030e00/0xfac36e8915414b19 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746809.497424:0:22609:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788746809.497482:0:22623:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a4580030e00/0xfac36e8915414b19 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788746809.497504:0:22609:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4481b65180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7d8327c8-4436-4f17-b07d-03a96e9e6b73+5:2400:x1875636305160064:12345-192.168.204.39@tcp:103:ldlm_bl.0 Request processed in 323us (618us total) trans 0 rc 0/0 00010000:00010000:2.0:1788746809.497525:0:22623:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a4580030e00/0xfac36e8915414b19 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788746809.497542:0:22609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 15 00010000:00010000:2.0:1788746809.497555:0:22623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a4581689600/0xfac36e8915414b2e lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746809.497569:0:22623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a4581689600/0xfac36e8915414b2e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746809.497579:0:22623:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a4581689600/0xfac36e8915414b2e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788746809.497941:0:22620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a4483ddbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:41310026-2b0a-472c-80e6-fbabf81d5070:22620:1875636324148608:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788746809.498206:0:22620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746809.498249:0:22620:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a4482545300 going to sleep for 11 seconds 00000100:00100000:0.0:1788746809.498274:0:22615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324148608 00000100:00100000:0.0:1788746809.498284:0:22615:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324148608 00000100:00100000:0.0:1788746809.498356:0:22615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1788746809.498365:0:22615:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4585540850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41310026-2b0a-472c-80e6-fbabf81d5070+21:22620:x1875636324148608:12345-0@lo:501:ll_cfg_requeue.0 00010000:00010000:2.0:1788746809.499841:0:22623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a4581688c00/0xfac36e8915414b35 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746809.499860:0:22623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a4581688c00/0xfac36e8915414b35 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746809.499871:0:22623:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a4581688c00/0xfac36e8915414b35 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788746809.499903:0:22623:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 0000000084361947 reply state 00000000ba7fae49 transno 12884901890 ns: mdt-lustre-MDT0000_UUID lock: ffff8a4581688c00/0xfac36e8915414b35 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746809.499916:0:22623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a4581688c00/0xfac36e8915414b35 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746809.499924:0:22623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8a4483586100) 00010000:00010000:2.0:1788746809.499930:0:22623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788746809.499935:0:22623:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1788746809.499942:0:22623:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1788746809.499961:0:22623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a4580030e00/0xfac36e8915414b19 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746809.499968:0:22623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a4580030e00/0xfac36e8915414b19 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746809.499974:0:22623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a4580030e00/0xfac36e8915414b19 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746809.499981:0:22623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a4580030e00 already unused, calling callback (ffffffffc17914f0) 00010000:00010000:2.0:1788746809.499986:0:22623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a4580030e00/0xfac36e8915414b19 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746809.499993:0:22623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a4580030e00/0xfac36e8915414b19 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746809.500003:0:22623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a4483589300) 00010000:00010000:2.0:1788746809.500006:0:22623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788746809.500082:0:22623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a4580030e00/0xfac36e8915414b19 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746809.500089:0:22623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a4580030e00/0xfac36e8915414b19 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788746809.500116:0:22623:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 0000000084361947 reply state 00000000ba7fae49 transno 12884901890 ns: mdt-lustre-MDT0000_UUID lock: ffff8a4581689600/0xfac36e8915414b2e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746809.500126:0:22623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a4581689600/0xfac36e8915414b2e lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746809.500134:0:22623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff8a4483586000) 00010000:00010000:2.0:1788746809.500137:0:22623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788746809.500146:0:22623:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:0.0:1788746809.500248:0:22615:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4585540850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41310026-2b0a-472c-80e6-fbabf81d5070+21:22620:x1875636324148608:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1879us (2037us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746809.500261:0:22615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1788746809.500325:0:22620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a4483ddbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:41310026-2b0a-472c-80e6-fbabf81d5070:22620:1875636324148608:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788746809.500411:0:22620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a4483dfc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:41310026-2b0a-472c-80e6-fbabf81d5070:22620:1875636324148736:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788746809.500473:0:22620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746809.500563:0:22617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324148736 00000100:00100000:0.0:1788746809.500572:0:22617:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324148736 00000100:00100000:3.0:1788746809.500594:0:22620:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a458736e300 going to sleep for 11 seconds 00000100:00100000:0.0:1788746809.500634:0:22617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1788746809.500645:0:22617:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4585542450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41310026-2b0a-472c-80e6-fbabf81d5070+21:22620:x1875636324148736:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788746809.500732:0:22623:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4483dd8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bbae771a-9fe8-425e-89d3-e0a0b7b26f24+10:18664:x1875636305159936:12345-192.168.204.39@tcp:36:lfs.0 Request processed in 15365us (21234us total) trans 12884901890 rc 0/0 00000100:00100000:2.0:1788746809.500741:0:22623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 28 00000100:00100000:0.0:1788746809.500841:0:22617:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4585542450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41310026-2b0a-472c-80e6-fbabf81d5070+21:22620:x1875636324148736:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 196us (366us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746809.500850:0:22617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1788746809.501334:0:22620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a4483dfc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:41310026-2b0a-472c-80e6-fbabf81d5070:22620:1875636324148736:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788746809.503727:0:25668:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1788746809.503903:0:22620:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1788746809.504745:0:22620:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.139@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788746809.504762:0:22620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff8a45b7f94000/0xfac36e8915414b20 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfac36e8915414b27 expref: -99 pid: 22620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746809.504775:0:22620:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.139@tcp lock: ffff8a45b7f94000/0xfac36e8915414b20 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfac36e8915414b27 expref: -99 pid: 22620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788746809.504786:0:22620:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788746809.504789:0:22620:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8a45bc9b7000 from 13 10000000:01000000:2.0:1788746809.504792:0:22620:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788746809.504836:0:22620:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.139@tcp lock: ffff8a4581688200/0xfac36e8915414b3c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746809.504845:0:22620:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.139@tcp lock: ffff8a4581688200/0xfac36e8915414b3c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746809.504856:0:22620:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.139@tcp lock: ffff8a4581688200/0xfac36e8915414b3c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788746809.504897:0:22620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a4481b65f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:41310026-2b0a-472c-80e6-fbabf81d5070:22620:1875636324148864:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788746809.504968:0:22620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788746809.505280:0:22620:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a45c0c95300 going to sleep for 11 seconds 00000100:00100000:0.0:1788746809.505504:0:22615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324148864 00000100:00100000:0.0:1788746809.505512:0:22615:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324148864 00000100:00100000:0.0:1788746809.505673:0:22615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1788746809.505683:0:22615:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4585540c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41310026-2b0a-472c-80e6-fbabf81d5070+21:22620:x1875636324148864:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788746809.505699:0:22615:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788746809.505712:0:22615:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a4580031400/0xfac36e8915414b43 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xfac36e8915414b3c expref: -99 pid: 22615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746809.505757:0:22615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a4580031400/0xfac36e8915414b43 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfac36e8915414b3c expref: 22 pid: 22615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746809.505768:0:22615:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a4580031400/0xfac36e8915414b43 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfac36e8915414b3c expref: 22 pid: 22615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746809.505776:0:22615:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a4580031400, rc 0) 00000100:00100000:0.0:1788746809.505831:0:22615:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4585540c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41310026-2b0a-472c-80e6-fbabf81d5070+22:22620:x1875636324148864:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 149us (862us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746809.505838:0:22615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1788746809.505919:0:22620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a4481b65f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:41310026-2b0a-472c-80e6-fbabf81d5070:22620:1875636324148864:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788746809.505944:0:22620:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.139@tcp lock: ffff8a4581688200/0xfac36e8915414b3c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfac36e8915414b43 expref: -99 pid: 22620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746809.505952:0:22620:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.139@tcp lock: ffff8a4581688200/0xfac36e8915414b3c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xfac36e8915414b43 expref: -99 pid: 22620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788746809.506034:0:22620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a4481b65f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:41310026-2b0a-472c-80e6-fbabf81d5070:22620:1875636324148992:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788746809.506061:0:22620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788746809.506653:0:22620:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a45c0c95300 going to sleep for 11 seconds 00000100:00100000:3.0:1788746809.506822:0:22617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324148992 00000100:00100000:3.0:1788746809.506829:0:22617:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324148992 00000100:00100000:3.0:1788746809.506863:0:22617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1788746809.506870:0:22617:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4585541c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41310026-2b0a-472c-80e6-fbabf81d5070+22:22620:x1875636324148992:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788746809.507218:0:22620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a4481b65f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:41310026-2b0a-472c-80e6-fbabf81d5070:22620:1875636324148992:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788746809.507253:0:22620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a4481b65f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:41310026-2b0a-472c-80e6-fbabf81d5070:22620:1875636324149120:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788746809.507443:0:22620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788746809.507472:0:22620:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a45c0c95300 going to sleep for 11 seconds 00000100:00100000:0.0:1788746809.507517:0:22615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324149120 00000100:00100000:0.0:1788746809.507530:0:22615:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324149120 00000100:00100000:0.0:1788746809.507550:0:22615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1788746809.507556:0:22615:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4585543050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41310026-2b0a-472c-80e6-fbabf81d5070+23:22620:x1875636324149120:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788746809.507646:0:22615:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4585543050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41310026-2b0a-472c-80e6-fbabf81d5070+23:22620:x1875636324149120:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 89us (201us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746809.507652:0:22615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1788746809.507789:0:22620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a4481b65f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:41310026-2b0a-472c-80e6-fbabf81d5070:22620:1875636324149120:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788746809.508194:0:22617:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4585541c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41310026-2b0a-472c-80e6-fbabf81d5070+22:22620:x1875636324148992:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1322us (2130us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746809.508202:0:22617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000040:00080000:2.0:1788746809.508965:0:25669:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1788746809.509587:0:22620:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1788746809.509613:0:22620:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.139@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788746809.509624:0:22620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff8a4581688200/0xfac36e8915414b3c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfac36e8915414b43 expref: -99 pid: 22620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746809.509636:0:22620:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.139@tcp lock: ffff8a4581688200/0xfac36e8915414b3c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfac36e8915414b43 expref: -99 pid: 22620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788746809.509648:0:22620:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788746809.509650:0:22620:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8a4582bdb800 from 13 10000000:01000000:0.0:1788746809.509668:0:22620:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788746809.509701:0:22620:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.139@tcp lock: ffff8a4580031a00/0xfac36e8915414b4a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746809.509710:0:22620:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.139@tcp lock: ffff8a4580031a00/0xfac36e8915414b4a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746809.509719:0:22620:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.139@tcp lock: ffff8a4580031a00/0xfac36e8915414b4a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788746809.509741:0:22620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a45bfe9a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:41310026-2b0a-472c-80e6-fbabf81d5070:22620:1875636324149248:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788746809.509795:0:22620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746809.509867:0:22620:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a45875f40c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788746809.509947:0:22615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324149248 00000100:00100000:1.0:1788746809.509954:0:22615:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324149248 00000100:00100000:1.0:1788746809.510147:0:22615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1788746809.510158:0:22615:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4585540450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41310026-2b0a-472c-80e6-fbabf81d5070+22:22620:x1875636324149248:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788746809.510170:0:22615:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788746809.510182:0:22615:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a45b7f94a00/0xfac36e8915414b51 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xfac36e8915414b4a expref: -99 pid: 22615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746809.510204:0:22615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a45b7f94a00/0xfac36e8915414b51 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfac36e8915414b4a expref: 23 pid: 22615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746809.510216:0:22615:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a45b7f94a00/0xfac36e8915414b51 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfac36e8915414b4a expref: 23 pid: 22615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746809.510225:0:22615:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a45b7f94a00, rc 0) 00000100:00100000:1.0:1788746809.510271:0:22615:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4585540450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41310026-2b0a-472c-80e6-fbabf81d5070+23:22620:x1875636324149248:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 115us (476us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746809.510400:0:22620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a45bfe9a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:41310026-2b0a-472c-80e6-fbabf81d5070:22620:1875636324149248:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788746809.510415:0:22620:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.139@tcp lock: ffff8a4580031a00/0xfac36e8915414b4a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xfac36e8915414b51 expref: -99 pid: 22620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746809.510423:0:22620:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.139@tcp lock: ffff8a4580031a00/0xfac36e8915414b4a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xfac36e8915414b51 expref: -99 pid: 22620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788746809.510494:0:22620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a45bfe9a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:41310026-2b0a-472c-80e6-fbabf81d5070:22620:1875636324149376:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788746809.510530:0:22620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746809.510565:0:22615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1788746809.510722:0:22620:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a45875f40c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788746809.510927:0:22615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324149376 00000100:00100000:1.0:1788746809.510932:0:22615:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324149376 00000100:00100000:1.0:1788746809.510951:0:22615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1788746809.510957:0:22615:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4585540050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41310026-2b0a-472c-80e6-fbabf81d5070+23:22620:x1875636324149376:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788746809.511077:0:22615:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4585540050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41310026-2b0a-472c-80e6-fbabf81d5070+23:22620:x1875636324149376:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 119us (545us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746809.511084:0:22615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1788746809.511416:0:22620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a45bfe9a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:41310026-2b0a-472c-80e6-fbabf81d5070:22620:1875636324149376:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788746809.511453:0:22620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a45bfe9a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:41310026-2b0a-472c-80e6-fbabf81d5070:22620:1875636324149504:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788746809.511498:0:22620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746809.511536:0:22620:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a45875f40c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788746809.512677:0:22615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324149504 00000100:00100000:1.0:1788746809.512686:0:22615:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324149504 00000100:00100000:1.0:1788746809.512727:0:22615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1788746809.512735:0:22615:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4585542c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41310026-2b0a-472c-80e6-fbabf81d5070+23:22620:x1875636324149504:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788746809.512875:0:22615:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4585542c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41310026-2b0a-472c-80e6-fbabf81d5070+23:22620:x1875636324149504:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 140us (1375us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746809.512895:0:22615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1788746809.513215:0:22620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a45bfe9a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:41310026-2b0a-472c-80e6-fbabf81d5070:22620:1875636324149504:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788746809.515198:0:25670:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1788746809.515421:0:22620:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1788746809.515446:0:22620:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.139@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788746809.515458:0:22620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff8a4580031a00/0xfac36e8915414b4a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xfac36e8915414b51 expref: -99 pid: 22620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746809.515469:0:22620:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.139@tcp lock: ffff8a4580031a00/0xfac36e8915414b4a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xfac36e8915414b51 expref: -99 pid: 22620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788746809.515479:0:22620:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788746809.515481:0:22620:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8a45847a0000 from 13 10000000:01000000:0.0:1788746809.515484:0:22620:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788746809.515522:0:22620:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.139@tcp lock: ffff8a4580030a00/0xfac36e8915414b58 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746809.515529:0:22620:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.139@tcp lock: ffff8a4580030a00/0xfac36e8915414b58 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746809.515539:0:22620:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.139@tcp lock: ffff8a4580030a00/0xfac36e8915414b58 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788746809.515561:0:22620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a45bfe9a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:41310026-2b0a-472c-80e6-fbabf81d5070:22620:1875636324149632:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788746809.515623:0:22620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746809.515665:0:22620:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a45875f40c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788746809.516244:0:22615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324149632 00000100:00100000:2.0:1788746809.516253:0:22615:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324149632 00000100:00100000:2.0:1788746809.516432:0:22615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1788746809.516445:0:22615:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4585541050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41310026-2b0a-472c-80e6-fbabf81d5070+23:22620:x1875636324149632:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788746809.516459:0:22615:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788746809.516474:0:22615:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a4581688400/0xfac36e8915414b5f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xfac36e8915414b58 expref: -99 pid: 22615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746809.516498:0:22615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a4581688400/0xfac36e8915414b5f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfac36e8915414b58 expref: 24 pid: 22615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746809.516509:0:22615:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a4581688400/0xfac36e8915414b5f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfac36e8915414b58 expref: 24 pid: 22615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746809.516533:0:22615:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a4581688400, rc 0) 00000100:00100000:2.0:1788746809.516587:0:22615:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4585541050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41310026-2b0a-472c-80e6-fbabf81d5070+24:22620:x1875636324149632:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 145us (963us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746809.517252:0:22620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a45bfe9a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:41310026-2b0a-472c-80e6-fbabf81d5070:22620:1875636324149632:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788746809.517271:0:22620:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.139@tcp lock: ffff8a4580030a00/0xfac36e8915414b58 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xfac36e8915414b5f expref: -99 pid: 22620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746809.517281:0:22620:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.139@tcp lock: ffff8a4580030a00/0xfac36e8915414b58 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xfac36e8915414b5f expref: -99 pid: 22620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788746809.517418:0:22615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1788746809.517654:0:22620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a45bfe9a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:41310026-2b0a-472c-80e6-fbabf81d5070:22620:1875636324149760:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788746809.517923:0:22620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788746809.518179:0:22617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324149760 00000100:00100000:2.0:1788746809.518185:0:22617:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324149760 00000100:00100000:0.0:1788746809.518487:0:22620:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a45875f40c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788746809.518662:0:22617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1788746809.518675:0:22617:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a45af2a5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41310026-2b0a-472c-80e6-fbabf81d5070+24:22620:x1875636324149760:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788746809.518835:0:22617:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a45af2a5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41310026-2b0a-472c-80e6-fbabf81d5070+24:22620:x1875636324149760:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 163us (911us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746809.518964:0:22620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a45bfe9a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:41310026-2b0a-472c-80e6-fbabf81d5070:22620:1875636324149760:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788746809.519019:0:22620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a45bfe9a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:41310026-2b0a-472c-80e6-fbabf81d5070:22620:1875636324149888:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788746809.519066:0:22620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746809.519092:0:22615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324149888 00000100:00100000:0.0:1788746809.519096:0:22615:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324149888 00000100:00100000:2.0:1788746809.520254:0:22617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1788746809.520427:0:22620:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a45875f40c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788746809.520618:0:22615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1788746809.520631:0:22615:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a45af2a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41310026-2b0a-472c-80e6-fbabf81d5070+24:22620:x1875636324149888:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788746809.521237:0:22615:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a45af2a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41310026-2b0a-472c-80e6-fbabf81d5070+24:22620:x1875636324149888:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 609us (2169us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746809.521246:0:22615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1788746809.521460:0:22620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a45bfe9a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:41310026-2b0a-472c-80e6-fbabf81d5070:22620:1875636324149888:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788746809.524664:0:25671:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1788746809.525219:0:22620:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1788746809.525247:0:22620:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.139@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788746809.525258:0:22620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff8a4580030a00/0xfac36e8915414b58 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xfac36e8915414b5f expref: -99 pid: 22620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746809.525269:0:22620:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.139@tcp lock: ffff8a4580030a00/0xfac36e8915414b58 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xfac36e8915414b5f expref: -99 pid: 22620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788746809.555757:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a4483dd8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875636324150016:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788746809.555828:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746809.555876:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788746809.555894:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a4483dfca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875636324150144:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788746809.555919:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746809.555961:0:25416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324150016 00000100:00100000:3.0:1788746809.555969:0:25416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324150016 00000100:00100000:3.0:1788746809.556096:0:25416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324150144 00000100:00100000:3.0:1788746809.556179:0:25416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324150144 00000100:00100000:3.0:1788746809.556203:0:25416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788746809.556212:0:25416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4483dfe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875636324150016:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788746809.556240:0:25416:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788746809.556282:0:25416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4483dfe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875636324150016:12345-0@lo:13:osp-pre-0-0.0 Request processed in 72us (455us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746809.556282:0:24134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788746809.556308:0:25416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788746809.556310:0:24134:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4483dfe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875636324150144:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788746809.556331:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a4481b65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875636324150272:0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788746809.556337:0:24134:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915849728 avail 3684327424 00000100:00100000:3.0:1788746809.556356:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788746809.556365:0:24134:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4483dfe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875636324150144:12345-0@lo:13:osp-pre-1-0.0 Request processed in 59us (445us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746809.556371:0:24134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788746809.556382:0:24134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324150272 00000100:00100000:2.0:1788746809.556385:0:24134:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324150272 00000100:00100000:3.0:1788746809.556402:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a4483dfca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875636324150144:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788746809.556402:0:24134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788746809.556407:0:24134:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4483dffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875636324150272:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788746809.556414:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a4483dd8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875636324150016:0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788746809.556416:0:24134:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915849728 avail 3684327424 00000100:00100000:2.0:1788746809.556448:0:24134:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4483dffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875636324150272:12345-0@lo:13:osp-pre-1-1.0 Request processed in 40us (92us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746809.556454:0:24134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788746809.556468:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a4481b65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875636324150272:0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1788746809.556477:0:22619:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788746809.556481:0:22619:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788746809.556962:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a45bfe9b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875636324150656:0@lo:400:kworker.0 00000100:00100000:0.0:1788746809.556998:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746809.557080:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a45bfe9a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875636324150400:0@lo:400:kworker.0 00000100:00100000:3.0:1788746809.557185:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a45bfe9b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875636324150784:0@lo:400:kworker.0 00000100:00100000:3.0:1788746809.557212:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746809.557235:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a45bfe9ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3645:1875636324151296:0@lo:400:kworker.0 00000100:00100000:3.0:1788746809.557258:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746809.557306:0:24130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324150784 00000100:00100000:3.0:1788746809.557311:0:24130:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324150784 00000100:00100000:3.0:1788746809.557349:0:24130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788746809.557356:0:24130:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4483dfca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875636324150784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788746809.557399:0:24130:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4483dfca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875636324150784:12345-0@lo:400:kworker.0 Request processed in 44us (186us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746809.557406:0:24130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788746809.557433:0:22624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324151296 00000100:00100000:3.0:1788746809.557436:0:22624:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324151296 00000100:00100000:0.0:1788746809.557438:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a45bfe99f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3644:1875636324151168:0@lo:400:kworker.0 00000100:00100000:3.0:1788746809.557461:0:22624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788746809.557462:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746809.557467:0:22624:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4483dfce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1875636324151296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788746809.557477:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1788746809.557483:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a45bfe99500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875636324150528:0@lo:400:kworker.0 00000100:00100000:1.0:1788746809.557554:0:22625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324151168 00000100:00100000:1.0:1788746809.557559:0:22625:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324151168 00000100:00100000:1.0:1788746809.557587:0:22625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788746809.557593:0:22625:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4483c65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875636324151168:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1788746809.557672:0:22619:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788746809.557684:0:22619:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788746809.557687:0:22619:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788746809.561718:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746809.561779:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a45bfe99880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3644:1875636324151040:0@lo:400:kworker.0 00000100:00100000:0.0:1788746809.561811:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746809.561868:0:22628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324150656 00000100:00100000:0.0:1788746809.561876:0:22628:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324150656 00000100:00100000:0.0:1788746809.562153:0:22628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788746809.562162:0:22628:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4483c67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875636324150656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788746809.562228:0:22628:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4483c67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875636324150656:12345-0@lo:400:kworker.0 Request processed in 67us (5228us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746809.562235:0:22628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788746809.562265:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746809.562308:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a45bfe98e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875636324150912:0@lo:400:kworker.0 00000100:00100000:0.0:1788746809.562332:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746809.562343:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a45bfe99180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3646:1875636324151424:0@lo:400:kworker.0 00000100:00100000:0.0:1788746809.562364:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746809.562390:0:22629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324150400 00000100:00100000:0.0:1788746809.562394:0:22629:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324150400 00000100:00100000:0.0:1788746809.562417:0:22629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788746809.562423:0:22629:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4483c64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875636324150400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788746809.562460:0:22629:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4483c64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875636324150400:12345-0@lo:400:kworker.0 Request processed in 37us (194us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746809.562466:0:22629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788746809.562523:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a45bfe9a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875636324150400:0@lo:400:kworker.0 00000100:00100000:0.0:1788746809.562557:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a45bfe9b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875636324150656:0@lo:400:kworker.0 00000100:00100000:2.0:1788746809.562657:0:22623:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:2.0:1788746809.562668:0:22623:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:2.0:1788746809.562690:0:25514:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:2.0:1788746809.562697:0:25514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324150528 00000100:00100000:2.0:1788746809.562700:0:25514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324150528 00000100:00100000:2.0:1788746809.562721:0:25514:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:2.0:1788746809.562726:0:25514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324151040 00000100:00100000:2.0:1788746809.562729:0:25514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324151040 00000100:00100000:2.0:1788746809.562752:0:25514:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:2.0:1788746809.562757:0:25514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324150912 00000100:00100000:2.0:1788746809.562759:0:25514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324150912 00000100:00100000:2.0:1788746809.562769:0:25514:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:2.0:1788746809.562773:0:25514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324151424 00000100:00100000:2.0:1788746809.562775:0:25514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324151424 00000100:00100000:2.0:1788746809.562789:0:25514:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:2.0:1788746809.562795:0:25514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788746809.562801:0:25514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4483c66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875636324150528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788746809.562842:0:25514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4483c66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875636324150528:12345-0@lo:400:kworker.0 Request processed in 41us (1134us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746809.562843:0:22625:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4483c65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875636324151168:12345-0@lo:400:kworker.0 Request processed in 5250us (5380us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746809.562848:0:25514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788746809.562851:0:22625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788746809.562860:0:25514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788746809.562865:0:22625:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:2.0:1788746809.562866:0:25514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4483c64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875636324151040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788746809.562878:0:22625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788746809.562896:0:22625:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4483c67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875636324150912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788746809.562908:0:25514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4483c64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875636324151040:12345-0@lo:400:kworker.0 Request processed in 43us (1097us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746809.562914:0:25514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788746809.562924:0:25514:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:1.0:1788746809.562928:0:22625:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4483c67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875636324150912:12345-0@lo:400:kworker.0 Request processed in 34us (596us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746809.562935:0:25514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788746809.562941:0:25514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4483c64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875636324151424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788746809.562947:0:22625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788746809.562981:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a45bfe98e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875636324150912:0@lo:400:kworker.0 00000100:00100000:2.0:1788746809.563205:0:25514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4483c64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875636324151424:12345-0@lo:400:kworker.0 Request processed in 264us (839us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746809.563212:0:25514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00080000:2.0:1788746809.563233:0:22619:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788746809.563237:0:22619:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788746809.563325:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a45bfe99180 x1875636324151424/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788746825 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788746809.563337:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a45bfe99180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3646:1875636324151424:0@lo:400:kworker.0 00000100:00100000:0.0:1788746809.563698:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a45bfe99500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875636324150528:0@lo:400:kworker.0 00000100:00100000:0.0:1788746809.563710:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a45bfe99880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3644:1875636324151040:0@lo:400:kworker.0 00010000:00080000:0.0:1788746809.563721:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a45bfe99f80 x1875636324151168/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788746825 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788746809.563731:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a45bfe99f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3644:1875636324151168:0@lo:400:kworker.0 00000100:00100000:3.0:1788746809.567649:0:22624:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4483dfce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1875636324151296:12345-0@lo:400:kworker.0 Request processed in 10172us (10380us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746809.567666:0:22624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788746809.568132:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a45bfe9b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875636324150784:0@lo:400:kworker.0 00000100:00100000:2.0:1788746809.568146:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a45bfe9ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3645:1875636324151296:0@lo:400:kworker.0 00000100:00100000:2.0:1788746809.584114:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788746809.584273:0:22625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636305160192 00000100:00100000:1.0:1788746809.584320:0:22625:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636305160192 00000100:00100000:1.0:1788746809.584385:0:22625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 29 00000100:00100000:1.0:1788746809.584397:0:22625:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4481b65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbae771a-9fe8-425e-89d3-e0a0b7b26f24+10:18672:x1875636305160192:12345-192.168.204.39@tcp:101:lctl.0 00010000:00010000:1.0:1788746809.584423:0:22625:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788746809.584445:0:22625:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a45b7f94400/0xfac36e8915414b66 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4d2179c47f078909 expref: -99 pid: 22625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746809.584510:0:22625:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a45b7f94e00/0xfac36e8915414b6d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746809.584524:0:22625:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a45b7f94e00/0xfac36e8915414b6d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746809.584535:0:22625:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a45b7f94e00/0xfac36e8915414b6d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22625 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788746809.584579:0:22625:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788746809.584601:0:22625:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788746809.584644:0:22625:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a45b7f94e00/0xfac36e8915414b6d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746809.584669:0:22625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a45b7f94400/0xfac36e8915414b66 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.39@tcp remote: 0x4d2179c47f078909 expref: 12 pid: 22625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746809.584689:0:22625:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a45b7f94e00/0xfac36e8915414b6d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.39@tcp remote: 0x4d2179c47f078909 expref: 11 pid: 22625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746809.584697:0:22625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a45b59ca400) 00010000:00010000:1.0:1788746809.584700:0:22625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788746809.584704:0:22625:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a45b7f94e00, rc 0) 00000100:00100000:1.0:1788746809.584768:0:22625:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4481b65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbae771a-9fe8-425e-89d3-e0a0b7b26f24+11:18672:x1875636305160192:12345-192.168.204.39@tcp:101:lctl.0 Request processed in 372us (661us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746809.584775:0:22625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 29 00000100:00100000:3.0:1788746809.603652:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788746809.603791:0:22624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636305160320 00000100:00100000:0.0:1788746809.603802:0:22624:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636305160320 00000100:00100000:0.0:1788746809.603863:0:22624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 30 00000100:00100000:0.0:1788746809.603874:0:22624:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4483dfc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7d8327c8-4436-4f17-b07d-03a96e9e6b73+5:18673:x1875636305160320:12345-192.168.204.39@tcp:101:lfs.0 00010000:00010000:0.0:1788746809.603914:0:22624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788746809.603937:0:22624:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a4580030000/0xfac36e8915414b74 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4d2179c47f078910 expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746809.603998:0:22624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a4580030800/0xfac36e8915414b7b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746809.604019:0:22624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a4580030800/0xfac36e8915414b7b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746809.604032:0:22624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a4580030800/0xfac36e8915414b7b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22624 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788746809.604074:0:22624:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788746809.604078:0:22624:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788746809.604128:0:22624:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a4580030800/0xfac36e8915414b7b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746809.604154:0:22624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a4580030000/0xfac36e8915414b74 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.39@tcp remote: 0x4d2179c47f078910 expref: 7 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746809.604174:0:22624:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a4580030800/0xfac36e8915414b7b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.39@tcp remote: 0x4d2179c47f078910 expref: 6 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746809.604182:0:22624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a45b59ca400) 00010000:00010000:0.0:1788746809.604185:0:22624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788746809.604189:0:22624:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a4580030800, rc 0) 00000100:00100000:0.0:1788746809.604252:0:22624:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4483dfc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7d8327c8-4436-4f17-b07d-03a96e9e6b73+6:18673:x1875636305160320:12345-192.168.204.39@tcp:101:lfs.0 Request processed in 379us (609us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746809.604259:0:22624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 30 00000100:00100000:3.0:1788746809.610123:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788746809.610345:0:25672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636305160448 00000100:00100000:1.0:1788746809.610355:0:25672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636305160448 00000100:00100000:1.0:1788746809.610424:0:25672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 31 00000100:00100000:1.0:1788746809.610435:0:25672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4483dff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7d8327c8-4436-4f17-b07d-03a96e9e6b73+6:18673:x1875636305160448:12345-192.168.204.39@tcp:101:lfs.0 00010000:00010000:1.0:1788746809.610457:0:25672:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788746809.610477:0:25672:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a45b7f94400/0xfac36e8915414b82 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4d2179c47f078917 expref: -99 pid: 25672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746809.610544:0:25672:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a45b7f95600/0xfac36e8915414b89 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746809.610558:0:25672:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a45b7f95600/0xfac36e8915414b89 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746809.610590:0:25672:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a45b7f95600/0xfac36e8915414b89 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746809.610603:0:25672:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a45b7f95000/0xfac36e8915414b90 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 25672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746809.610611:0:25672:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a45b7f95000/0xfac36e8915414b90 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746809.610619:0:25672:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a45b7f95000/0xfac36e8915414b90 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746809.610702:0:25672:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a45b7f95e00/0xfac36e8915414b97 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 25672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746809.610710:0:25672:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a45b7f95e00/0xfac36e8915414b97 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746809.610717:0:25672:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a45b7f95e00/0xfac36e8915414b97 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25672 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788746809.610759:0:25672:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788746809.610763:0:25672:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788746809.610784:0:25672:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a45b7f95e00/0xfac36e8915414b97 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746809.610795:0:25672:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a45b7f95600/0xfac36e8915414b89 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746809.610802:0:25672:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a45b7f95600/0xfac36e8915414b89 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746809.610820:0:25672:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a45b7f95600/0xfac36e8915414b89 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746809.610826:0:25672:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a45b7f95600 already unused, calling callback (ffffffffc17914f0) 00010000:00010000:1.0:1788746809.610830:0:25672:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a45b7f95600/0xfac36e8915414b89 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746809.610838:0:25672:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a45b7f95600/0xfac36e8915414b89 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746809.610850:0:25672:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a45b59ca400) 00010000:00010000:1.0:1788746809.610854:0:25672:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788746809.610858:0:25672:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a45b7f95600/0xfac36e8915414b89 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746809.610865:0:25672:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a45b7f95600/0xfac36e8915414b89 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746809.610896:0:25672:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a45b7f95000/0xfac36e8915414b90 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746809.610904:0:25672:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a45b7f95000/0xfac36e8915414b90 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 25672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746809.610909:0:25672:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a45b7f95000/0xfac36e8915414b90 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746809.610913:0:25672:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a45b7f95000 already unused, calling callback (ffffffffc17914f0) 00010000:00010000:1.0:1788746809.610916:0:25672:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a45b7f95000/0xfac36e8915414b90 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746809.610932:0:25672:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a45b7f95000/0xfac36e8915414b90 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 25672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746809.610940:0:25672:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff8a4483586000) 00010000:00010000:1.0:1788746809.610942:0:25672:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788746809.610956:0:25672:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a45b7f95000/0xfac36e8915414b90 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746809.610962:0:25672:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a45b7f95000/0xfac36e8915414b90 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746809.610988:0:25672:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a45b7f94400/0xfac36e8915414b82 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.39@tcp remote: 0x4d2179c47f078917 expref: 8 pid: 25672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746809.611000:0:25672:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a45b7f95e00/0xfac36e8915414b97 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.39@tcp remote: 0x4d2179c47f078917 expref: 7 pid: 25672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746809.611006:0:25672:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8a4483586100) 00010000:00010000:1.0:1788746809.611009:0:25672:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788746809.611011:0:25672:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a45b7f95e00, rc 0) 00000100:00100000:1.0:1788746809.611078:0:25672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4483dff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7d8327c8-4436-4f17-b07d-03a96e9e6b73+7:18673:x1875636305160448:12345-192.168.204.39@tcp:101:lfs.0 Request processed in 644us (964us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746809.611086:0:25672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 31 00000100:00100000:2.0:1788746809.622947:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788746809.623166:0:22634:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636305160576 00000100:00100000:0.0:1788746809.623177:0:22634:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636305160576 00000100:00100000:0.0:1788746809.623257:0:22634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 6 00000100:00100000:0.0:1788746809.623268:0:22634:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4481b67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:7d8327c8-4436-4f17-b07d-03a96e9e6b73+5:18673:x1875636305160576:12345-192.168.204.39@tcp:900:lfs.0 00000100:00100000:0.0:1788746809.623387:0:22634:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4481b67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:7d8327c8-4436-4f17-b07d-03a96e9e6b73+5:18673:x1875636305160576:12345-192.168.204.39@tcp:900:lfs.0 Request processed in 120us (448us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746809.623395:0:22634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 6 00000040:00080000:1.0:1788746809.624103:0:23382:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00080000:2.0:1788746809.624657:0:22619:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788746809.637458:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788746809.637552:0:22617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636305160704 00000100:00100000:0.0:1788746809.637566:0:22617:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636305160704 00000100:00100000:0.0:1788746809.637621:0:22617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 160 00000100:00100000:0.0:1788746809.637632:0:22617:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a45af2a7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f755556-f1cd-4e4b-8ec3-48b3fc3a369c+11:18035:x1875636305160704:12345-192.168.204.39@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788746809.637649:0:22617:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788746809.637682:0:22617:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a4580030000/0xfac36e8915414b9e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x4d2179c47f07891e expref: -99 pid: 22617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746809.637713:0:22617:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a4580030000/0xfac36e8915414b9e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.39@tcp remote: 0x4d2179c47f07891e expref: 12 pid: 22617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746809.637725:0:22617:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a4580030000/0xfac36e8915414b9e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.39@tcp remote: 0x4d2179c47f07891e expref: 12 pid: 22617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746809.637735:0:22617:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a4580030000, rc 0) 00000100:00100000:0.0:1788746809.637803:0:22617:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a45af2a7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f755556-f1cd-4e4b-8ec3-48b3fc3a369c+12:18035:x1875636305160704:12345-192.168.204.39@tcp:101:ll_cfg_requeue.0 Request processed in 172us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746809.637810:0:22617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 160 00000100:00100000:1.0:1788746809.640825:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788746809.640931:0:25514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636305160960 00000100:00100000:2.0:1788746809.640940:0:25514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636305160960 00000100:00100000:2.0:1788746809.641023:0:25514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 32 00000100:00100000:2.0:1788746809.641033:0:25514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4483dda680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7d8327c8-4436-4f17-b07d-03a96e9e6b73+7:18673:x1875636305160960:12345-192.168.204.39@tcp:101:lfs.0 00010000:00010000:2.0:1788746809.641053:0:25514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788746809.641071:0:25514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a4581688800/0xfac36e8915414ba5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4d2179c47f078925 expref: -99 pid: 25514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788746809.641170:0:25514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1788746809.641266:0:25514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a4581688800/0xfac36e8915414ba5 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.39@tcp remote: 0x4d2179c47f078925 expref: 9 pid: 25514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746809.641279:0:25514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a45b59ca400) 00010000:00010000:2.0:1788746809.641282:0:25514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788746809.641358:0:25514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a4581688800/0xfac36e8915414ba5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.39@tcp remote: 0x4d2179c47f078925 expref: 9 pid: 25514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746809.641374:0:25514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a4581688800, rc 0) 00000100:00100000:2.0:1788746809.641444:0:25514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4483dda680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7d8327c8-4436-4f17-b07d-03a96e9e6b73+8:18673:x1875636305160960:12345-192.168.204.39@tcp:101:lfs.0 Request processed in 412us (628us total) trans 12884901891 rc 301/301 00000100:00100000:2.0:1788746809.641452:0:25514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 32 00000100:00100000:1.0:1788746809.642161:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788746809.642462:0:22618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636305161088 00000100:00100000:2.0:1788746809.642470:0:22618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636305161088 00000100:00100000:2.0:1788746809.642560:0:22618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 161 00000100:00100000:2.0:1788746809.642569:0:22618:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a45af2a4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f755556-f1cd-4e4b-8ec3-48b3fc3a369c+12:18035:x1875636305161088:12345-192.168.204.39@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788746809.642687:0:22618:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a45af2a4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f755556-f1cd-4e4b-8ec3-48b3fc3a369c+12:18035:x1875636305161088:12345-192.168.204.39@tcp:501:ll_cfg_requeue.0 Request processed in 118us (526us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746809.642694:0:22618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 161 00000100:00100000:0.0:1788746809.645873:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788746809.647365:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788746809.647395:0:22624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636305161472 00000100:00100000:0.0:1788746809.647406:0:22624:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636305161472 00000100:00100000:0.0:1788746809.647465:0:22624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 33 00000100:00100000:0.0:1788746809.647476:0:22624:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4483c64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7d8327c8-4436-4f17-b07d-03a96e9e6b73+8:18673:x1875636305161472:12345-192.168.204.39@tcp:36:lfs.0 00010000:00010000:0.0:1788746809.647540:0:22624:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788746809.647570:0:22624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a45b7f95e00/0xfac36e8915414b97 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.39@tcp remote: 0x4d2179c47f078917 expref: 8 pid: 25672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746809.647594:0:22624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8a4483586100) 00010000:00010000:0.0:1788746809.647599:0:22624:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788746809.647615:0:22617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636305161216 00000100:00100000:3.0:1788746809.647622:0:22617:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636305161216 00010000:00010000:0.0:1788746809.647622:0:22624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a4580031000/0xfac36e8915414bb3 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746809.647637:0:22624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a4580031000/0xfac36e8915414bb3 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22624 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788746809.647657:0:22617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 162 00010000:00010000:0.0:1788746809.647666:0:22624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a4580031000/0xfac36e8915414bb3 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22624 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788746809.647668:0:22617:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a45af2a5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f755556-f1cd-4e4b-8ec3-48b3fc3a369c+12:18035:x1875636305161216:12345-192.168.204.39@tcp:503:ll_cfg_requeue.0 00000004:00010000:0.0:1788746809.647898:0:22624:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 000000002d49ef41 reply state 00000000ef6e1872 transno 12884901892 ns: mdt-lustre-MDT0000_UUID lock: ffff8a4580031000/0xfac36e8915414bb3 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746809.647912:0:22624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a4580031000/0xfac36e8915414bb3 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746809.647919:0:22624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8a4483586100) 00010000:00010000:0.0:1788746809.647921:0:22624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:0.0:1788746809.647924:0:22624:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1788746809.647932:0:22624:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1788746809.648668:0:22617:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a45af2a5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f755556-f1cd-4e4b-8ec3-48b3fc3a369c+12:18035:x1875636305161216:12345-192.168.204.39@tcp:503:ll_cfg_requeue.0 Request processed in 996us (2801us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746809.648679:0:22617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 162 00000100:00100000:0.0:1788746809.650674:0:22624:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4483c64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7d8327c8-4436-4f17-b07d-03a96e9e6b73+9:18673:x1875636305161472:12345-192.168.204.39@tcp:36:lfs.0 Request processed in 3190us (3306us total) trans 12884901892 rc 0/0 00000100:00100000:0.0:1788746809.650687:0:22624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 33 00000100:00100000:2.0:1788746809.658984:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788746809.660695:0:22617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636305161600 00000100:00100000:3.0:1788746809.660711:0:22617:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636305161600 00000100:00100000:3.0:1788746809.660787:0:22617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 163 00000100:00100000:3.0:1788746809.660797:0:22617:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a45af2a6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f755556-f1cd-4e4b-8ec3-48b3fc3a369c+12:18035:x1875636305161600:12345-192.168.204.39@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788746809.660815:0:22617:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788746809.660835:0:22617:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a45c216d400/0xfac36e8915414bba lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x4d2179c47f07892c expref: -99 pid: 22617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788746809.660851:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00010000:00010000:3.0:1788746809.660865:0:22617:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a45c216d400/0xfac36e8915414bba lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.204.39@tcp remote: 0x4d2179c47f07892c expref: 13 pid: 22617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746809.660913:0:22617:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a45c216d400/0xfac36e8915414bba lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.39@tcp remote: 0x4d2179c47f07892c expref: 13 pid: 22617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746809.660923:0:22617:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a45c216d400, rc 0) 00000100:00100000:3.0:1788746809.660989:0:22617:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a45af2a6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f755556-f1cd-4e4b-8ec3-48b3fc3a369c+13:18035:x1875636305161600:12345-192.168.204.39@tcp:101:ll_cfg_requeue.0 Request processed in 193us (2018us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746809.660997:0:22617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 163 00000100:00100000:1.0:1788746809.661250:0:22627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636305161856 00000100:00100000:1.0:1788746809.661256:0:22627:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636305161856 00000100:00100000:1.0:1788746809.661315:0:22627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 2 00000100:00100000:1.0:1788746809.661332:0:22627:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4483c65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7d8327c8-4436-4f17-b07d-03a96e9e6b73+9:18673:x1875636305161856:12345-192.168.204.39@tcp:35:lfs.0 00000100:00100000:1.0:1788746809.661562:0:22627:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4483c65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7d8327c8-4436-4f17-b07d-03a96e9e6b73+10:18673:x1875636305161856:12345-192.168.204.39@tcp:35:lfs.0 Request processed in 239us (710us total) trans 12884901893 rc 0/0 00000100:00100000:1.0:1788746809.661570:0:22627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 2 00000100:00100000:0.0:1788746809.666666:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788746809.666852:0:22615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636305161984 00000100:00100000:1.0:1788746809.666863:0:22615:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636305161984 00000100:00100000:1.0:1788746809.666991:0:22615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 164 00000100:00100000:1.0:1788746809.667002:0:22615:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a45af2a6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f755556-f1cd-4e4b-8ec3-48b3fc3a369c+13:18035:x1875636305161984:12345-192.168.204.39@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788746809.667179:0:22615:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a45af2a6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f755556-f1cd-4e4b-8ec3-48b3fc3a369c+13:18035:x1875636305161984:12345-192.168.204.39@tcp:501:ll_cfg_requeue.0 Request processed in 178us (523us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746809.667187:0:22615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 164 00000100:00100000:0.0:1788746809.669719:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788746809.669870:0:22625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636305162240 00000100:00100000:2.0:1788746809.669889:0:22625:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636305162240 00000100:00100000:2.0:1788746809.669954:0:22625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 34 00000100:00100000:2.0:1788746809.669964:0:22625:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4483c66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7d8327c8-4436-4f17-b07d-03a96e9e6b73+10:18673:x1875636305162240:12345-192.168.204.39@tcp:101:lfs.0 00010000:00010000:2.0:1788746809.669987:0:22625:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788746809.670023:0:22625:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a4581688800/0xfac36e8915414bc1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4d2179c47f078933 expref: -99 pid: 22625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746809.670098:0:22625:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a4581689200/0xfac36e8915414bc8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746809.670113:0:22625:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a4581689200/0xfac36e8915414bc8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746809.670142:0:22625:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a4581689200/0xfac36e8915414bc8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746809.670155:0:22625:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a4483ed7200/0xfac36e8915414bcf lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746809.670163:0:22625:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a4483ed7200/0xfac36e8915414bcf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746809.670169:0:22625:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a4483ed7200/0xfac36e8915414bcf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22625 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788746809.670270:0:22625:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1788746809.670389:0:22625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a4581689200/0xfac36e8915414bc8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746809.670397:0:22625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a4581689200/0xfac36e8915414bc8 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746809.670404:0:22625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a4581689200/0xfac36e8915414bc8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746809.670410:0:22625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a4581689200 already unused, calling callback (ffffffffc17914f0) 00010000:00010000:2.0:1788746809.670414:0:22625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a4581689200/0xfac36e8915414bc8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746809.670421:0:22625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a4581689200/0xfac36e8915414bc8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746809.670432:0:22625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a45b59ca400) 00010000:00010000:2.0:1788746809.670435:0:22625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788746809.670447:0:22625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a4581689200/0xfac36e8915414bc8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746809.670453:0:22625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a4581689200/0xfac36e8915414bc8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746809.670470:0:22625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a4483ed7200/0xfac36e8915414bcf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746809.670477:0:22625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a4483ed7200/0xfac36e8915414bcf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746809.670483:0:22625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a4483ed7200/0xfac36e8915414bcf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746809.670488:0:22625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a4483ed7200 already unused, calling callback (ffffffffc17914f0) 00010000:00010000:2.0:1788746809.670490:0:22625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a4483ed7200/0xfac36e8915414bcf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746809.670496:0:22625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a4483ed7200/0xfac36e8915414bcf lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746809.670503:0:22625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff8a4483586000) 00010000:00010000:2.0:1788746809.670506:0:22625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788746809.670509:0:22625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a4483ed7200/0xfac36e8915414bcf lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746809.670683:0:22625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a4483ed7200/0xfac36e8915414bcf lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746809.670723:0:22625:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a4581688800/0xfac36e8915414bc1 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.39@tcp remote: 0x4d2179c47f078933 expref: 12 pid: 22625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746809.670745:0:22625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a45b59ca400) 00010000:00010000:2.0:1788746809.670747:0:22625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788746809.670751:0:22625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a4581688800/0xfac36e8915414bc1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.39@tcp remote: 0x4d2179c47f078933 expref: 12 pid: 22625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746809.670761:0:22625:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a4581688800, rc 0) 00000100:00100000:2.0:1788746809.670831:0:22625:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4483c66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7d8327c8-4436-4f17-b07d-03a96e9e6b73+11:18673:x1875636305162240:12345-192.168.204.39@tcp:101:lfs.0 Request processed in 869us (1121us total) trans 12884901894 rc 301/301 00000100:00100000:2.0:1788746809.670839:0:22625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 34 00000100:00100000:3.0:1788746809.672378:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788746809.672476:0:22617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636305162368 00000100:00100000:1.0:1788746809.672485:0:22617:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636305162368 00000100:00100000:1.0:1788746809.672605:0:22617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 165 00000100:00100000:1.0:1788746809.672614:0:22617:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a45af2a6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f755556-f1cd-4e4b-8ec3-48b3fc3a369c+13:18035:x1875636305162368:12345-192.168.204.39@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788746809.672750:0:22617:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a45af2a6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f755556-f1cd-4e4b-8ec3-48b3fc3a369c+13:18035:x1875636305162368:12345-192.168.204.39@tcp:503:ll_cfg_requeue.0 Request processed in 136us (377us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746809.672758:0:22617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 165 00000100:00100000:3.0:1788746809.676503:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788746809.676740:0:22623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636305162496 00000100:00100000:2.0:1788746809.676750:0:22623:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636305162496 00000100:00100000:2.0:1788746809.676836:0:22623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 35 00000100:00100000:2.0:1788746809.676846:0:22623:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a45c0ea6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7d8327c8-4436-4f17-b07d-03a96e9e6b73+11:18673:x1875636305162496:12345-192.168.204.39@tcp:101:lfs.0 00010000:00010000:2.0:1788746809.676868:0:22623:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788746809.676899:0:22623:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a4483ed6600/0xfac36e8915414bdd lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4d2179c47f07893a expref: -99 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746809.676990:0:22623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a4483ed6400/0xfac36e8915414be4 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746809.677111:0:22623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a4483ed6400/0xfac36e8915414be4 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746809.677125:0:22623:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a4483ed6400/0xfac36e8915414be4 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788746809.677154:0:22623:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788746809.677171:0:22623:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788746809.677190:0:22623:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a4483ed6400/0xfac36e8915414be4 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746809.677215:0:22623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a4483ed6600/0xfac36e8915414bdd lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.39@tcp remote: 0x4d2179c47f07893a expref: 13 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746809.677232:0:22623:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a4483ed6400/0xfac36e8915414be4 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.39@tcp remote: 0x4d2179c47f07893a expref: 12 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746809.677240:0:22623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8a4483586100) 00010000:00010000:2.0:1788746809.677243:0:22623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788746809.677246:0:22623:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a4483ed6400, rc 0) 00000100:00100000:2.0:1788746809.677704:0:22623:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a45c0ea6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7d8327c8-4436-4f17-b07d-03a96e9e6b73+12:18673:x1875636305162496:12345-192.168.204.39@tcp:101:lfs.0 Request processed in 856us (1207us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746809.677712:0:22623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 35 00000100:00100000:3.0:1788746809.681752:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788746809.681895:0:22627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636305162624 00000100:00100000:1.0:1788746809.681905:0:22627:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636305162624 00000100:00100000:1.0:1788746809.681966:0:22627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 3 00000100:00100000:1.0:1788746809.681977:0:22627:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a45c0ea5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7d8327c8-4436-4f17-b07d-03a96e9e6b73+12:18673:x1875636305162624:12345-192.168.204.39@tcp:37:lfs.0 00000040:00080000:1.0:1788746809.685511:0:22657:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788746809.687736:0:22627:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a45c0ea5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7d8327c8-4436-4f17-b07d-03a96e9e6b73+12:18673:x1875636305162624:12345-192.168.204.39@tcp:37:lfs.0 Request processed in 5752us (5984us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746809.687761:0:22627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 3 00000100:00100000:3.0:1788746809.692253:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788746809.692387:0:22626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636305162880 00000100:00100000:2.0:1788746809.692397:0:22626:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636305162880 00000100:00100000:2.0:1788746809.692459:0:22626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 4 00000100:00100000:2.0:1788746809.692470:0:22626:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a45a80d3450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7d8327c8-4436-4f17-b07d-03a96e9e6b73+12:18673:x1875636305162880:12345-192.168.204.39@tcp:35:lfs.0 00000100:00100000:2.0:1788746809.692705:0:22626:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a45a80d3450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7d8327c8-4436-4f17-b07d-03a96e9e6b73+13:18673:x1875636305162880:12345-192.168.204.39@tcp:35:lfs.0 Request processed in 237us (462us total) trans 12884901895 rc 0/0 00000100:00100000:2.0:1788746809.692713:0:22626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 4 00000100:00100000:3.0:1788746809.753476:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788746809.753821:0:25672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636305163008 00000100:00100000:1.0:1788746809.753832:0:25672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636305163008 00000100:00100000:1.0:1788746809.753907:0:25672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 36 00000100:00100000:1.0:1788746809.753918:0:25672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a45c0ea5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bbae771a-9fe8-425e-89d3-e0a0b7b26f24+11:18681:x1875636305163008:12345-192.168.204.39@tcp:101:bash.0 00010000:00010000:1.0:1788746809.753939:0:25672:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788746809.753963:0:25672:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a45b7f95600/0xfac36e8915414beb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4d2179c47f078941 expref: -99 pid: 25672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746809.754041:0:25672:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a45b7f95a00/0xfac36e8915414bf2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746809.754055:0:25672:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a45b7f95a00/0xfac36e8915414bf2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746809.754065:0:25672:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a45b7f95a00/0xfac36e8915414bf2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746809.754075:0:25672:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a45b7f94c00/0xfac36e8915414bf9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 25672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746809.754082:0:25672:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a45b7f94c00/0xfac36e8915414bf9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746809.754089:0:25672:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a45b7f94c00/0xfac36e8915414bf9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746809.754179:0:25672:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a45b7f95e00/0xfac36e8915414c00 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746809.754208:0:25672:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a45b7f95e00/0xfac36e8915414c00 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746809.754216:0:25672:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a45b7f95e00/0xfac36e8915414c00 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25672 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788746809.754252:0:25672:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788746809.754258:0:25672:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788746809.754353:0:25672:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a45b7f95e00/0xfac36e8915414c00 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746809.754366:0:25672:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a45b7f95a00/0xfac36e8915414bf2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746809.754372:0:25672:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a45b7f95a00/0xfac36e8915414bf2 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746809.754378:0:25672:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a45b7f95a00/0xfac36e8915414bf2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746809.754384:0:25672:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a45b7f95a00 already unused, calling callback (ffffffffc17914f0) 00010000:00010000:1.0:1788746809.754387:0:25672:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a45b7f95a00/0xfac36e8915414bf2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746809.754393:0:25672:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a45b7f95a00/0xfac36e8915414bf2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746809.754403:0:25672:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a45b59ca400) 00010000:00010000:1.0:1788746809.754406:0:25672:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788746809.754411:0:25672:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a45b7f95a00/0xfac36e8915414bf2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746809.754426:0:25672:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a45b7f95a00/0xfac36e8915414bf2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746809.754441:0:25672:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a45b7f94c00/0xfac36e8915414bf9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746809.754447:0:25672:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a45b7f94c00/0xfac36e8915414bf9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 25672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746809.754452:0:25672:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a45b7f94c00/0xfac36e8915414bf9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746809.754457:0:25672:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a45b7f94c00 already unused, calling callback (ffffffffc17914f0) 00010000:00010000:1.0:1788746809.754460:0:25672:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a45b7f94c00/0xfac36e8915414bf9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746809.754466:0:25672:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a45b7f94c00/0xfac36e8915414bf9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 25672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746809.754473:0:25672:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff8a4483586000) 00010000:00010000:1.0:1788746809.754476:0:25672:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788746809.754478:0:25672:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a45b7f94c00/0xfac36e8915414bf9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746809.754484:0:25672:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a45b7f94c00/0xfac36e8915414bf9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746809.754509:0:25672:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a45b7f95600/0xfac36e8915414beb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.39@tcp remote: 0x4d2179c47f078941 expref: 13 pid: 25672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746809.754779:0:25672:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a45b7f95e00/0xfac36e8915414c00 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.39@tcp remote: 0x4d2179c47f078941 expref: 12 pid: 25672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746809.754786:0:25672:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8a4483586100) 00010000:00010000:1.0:1788746809.754789:0:25672:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1788746809.754791:0:25672:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a45b7f95e00, rc 0) 00000100:00100000:3.0:1788746809.755266:0:25672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a45c0ea5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bbae771a-9fe8-425e-89d3-e0a0b7b26f24+12:18681:x1875636305163008:12345-192.168.204.39@tcp:101:bash.0 Request processed in 1346us (1797us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746809.755275:0:25672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 36 00000100:00100000:3.0:1788746809.759566:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788746809.759796:0:22634:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636305163136 00000100:00100000:2.0:1788746809.759807:0:22634:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636305163136 00000100:00100000:2.0:1788746809.759870:0:22634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 7 00000100:00100000:2.0:1788746809.759893:0:22634:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a448448ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:bbae771a-9fe8-425e-89d3-e0a0b7b26f24+5:18681:x1875636305163136:12345-192.168.204.39@tcp:900:bash.0 00000100:00100000:2.0:1788746809.759979:0:22634:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a448448ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:bbae771a-9fe8-425e-89d3-e0a0b7b26f24+5:18681:x1875636305163136:12345-192.168.204.39@tcp:900:bash.0 Request processed in 100us (422us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746809.760013:0:22634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 7 00000100:00100000:0.0:1788746809.765736:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788746809.765845:0:25514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636305163392 00000100:00100000:2.0:1788746809.765855:0:25514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636305163392 00000100:00100000:2.0:1788746809.765930:0:25514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 37 00000100:00100000:2.0:1788746809.765941:0:25514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4483c67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bbae771a-9fe8-425e-89d3-e0a0b7b26f24+12:18681:x1875636305163392:12345-192.168.204.39@tcp:101:bash.0 00010000:00010000:2.0:1788746809.765961:0:25514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788746809.765979:0:25514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a4483ed6600/0xfac36e8915414c07 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4d2179c47f078948 expref: -99 pid: 25514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746809.766092:0:25514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a4483ed7200/0xfac36e8915414c0e lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 25514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746809.766108:0:25514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a4483ed6400/0xfac36e8915414be4 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.39@tcp remote: 0x4d2179c47f07893a expref: 12 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746809.766116:0:25514:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a4483ed7200/0xfac36e8915414c0e lrc: 4/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 25514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746809.766151:0:25514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a4483ed6400/0xfac36e8915414be4 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.39@tcp remote: 0x4d2179c47f07893a expref: 12 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746809.766166:0:25514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a4483ed6400/0xfac36e8915414be4 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.39@tcp remote: 0x4d2179c47f07893a expref: 12 pid: 22623 timeout: 839 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788746809.766180:0:25514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a4481b64000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:25514:1875636324151552:192.168.204.39@tcp:104: 00000100:00100000:2.0:1788746809.766397:0:25514:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a45a2ab0cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788746809.770539:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788746809.770724:0:25653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636305163520 00000100:00100000:3.0:1788746809.770733:0:25653:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636305163520 00010000:00010000:3.0:1788746809.770774:0:25653:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a4483ed6400/0xfac36e8915414be4 lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.39@tcp remote: 0x4d2179c47f07893a expref: 13 pid: 22623 timeout: 839 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788746809.770815:0:25653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 16 00000100:00100000:3.0:1788746809.770825:0:25653:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4483c65180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7d8327c8-4436-4f17-b07d-03a96e9e6b73+13:2399:x1875636305163520:12345-192.168.204.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788746809.770839:0:25653:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788746809.770845:0:25653:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a4483ed6400/0xfac36e8915414be4 lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.39@tcp remote: 0x4d2179c47f07893a expref: 13 pid: 22623 timeout: 839 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746809.770889:0:25653:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a4483ed6400/0xfac36e8915414be4 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.39@tcp remote: 0x4d2179c47f07893a expref: 13 pid: 22623 timeout: 839 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746809.770916:0:25653:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8a4483586100) 00010000:00010000:3.0:1788746809.770922:0:25653:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8a4483ed7200/0xfac36e8915414c0e lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 25514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746809.770933:0:25653:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a4483ed7200/0xfac36e8915414c0e lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 25514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746809.770940:0:25653:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a4483ed7200/0xfac36e8915414c0e lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 25514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746809.770958:0:25653:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788746809.771127:0:25653:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4483c65180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7d8327c8-4436-4f17-b07d-03a96e9e6b73+13:2399:x1875636305163520:12345-192.168.204.39@tcp:103:ldlm_bl.0 Request processed in 302us (595us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746809.771135:0:25653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 16 00010000:00010000:2.0:1788746809.771608:0:25514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a4483ed6400/0xfac36e8915414be4 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.39@tcp remote: 0x4d2179c47f07893a expref: 12 pid: 22623 timeout: 839 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788746809.771636:0:25514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a4481b64000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:25514:1875636324151552:192.168.204.39@tcp:104: 00010000:00010000:2.0:1788746809.771657:0:25514:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a4483ed7200/0xfac36e8915414c0e lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 25514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746809.771666:0:25514:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a4483ed7200/0xfac36e8915414c0e lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 25514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746809.771672:0:25514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a4483ed7200/0xfac36e8915414c0e lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 25514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746809.771743:0:25514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a4483ed6c00/0xfac36e8915414c15 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746809.771753:0:25514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a4483ed6c00/0xfac36e8915414c15 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746809.771762:0:25514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a4483ed6c00/0xfac36e8915414c15 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746809.772643:0:25514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a4483ed7e00/0xfac36e8915414c1c lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746809.772654:0:25514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a4483ed7e00/0xfac36e8915414c1c lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746809.772662:0:25514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a4483ed7e00/0xfac36e8915414c1c lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788746809.772673:0:25514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788746809.772698:0:25514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a4483ed7200/0xfac36e8915414c0e lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 25514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746809.772714:0:25514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a4483ed7200/0xfac36e8915414c0e lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 25514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746809.772721:0:25514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a4483ed7200/0xfac36e8915414c0e lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 25514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746809.772727:0:25514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a4483ed7200 already unused, calling callback (ffffffffc17914f0) 00010000:00010000:2.0:1788746809.772732:0:25514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a4483ed7200/0xfac36e8915414c0e lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 25514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746809.772740:0:25514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a4483ed7200/0xfac36e8915414c0e lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 25514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746809.772751:0:25514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8a4483586100) 00010000:00010000:2.0:1788746809.772754:0:25514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788746809.772759:0:25514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a4483ed7200/0xfac36e8915414c0e lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 25514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746809.772765:0:25514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a4483ed7200/0xfac36e8915414c0e lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 25514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788746809.772778:0:25514:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 000000001cf0a905 reply state 00000000c71db998 transno 12884901896 ns: mdt-lustre-MDT0000_UUID lock: ffff8a4483ed6c00/0xfac36e8915414c15 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746809.772788:0:25514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a4483ed6c00/0xfac36e8915414c15 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746809.772795:0:25514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff8a4483586400) 00010000:00010000:2.0:1788746809.772796:0:25514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788746809.772800:0:25514:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788746809.772837:0:25514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a4483ed6600/0xfac36e8915414c07 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.39@tcp remote: 0x4d2179c47f078948 expref: 15 pid: 25514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746809.772860:0:25514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a4483ed7e00/0xfac36e8915414c1c lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.39@tcp remote: 0x4d2179c47f078948 expref: 14 pid: 25514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746809.772866:0:25514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8a4483586f00) 00010000:00010000:2.0:1788746809.772868:0:25514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:2.0:1788746809.772870:0:25514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a4483ed7e00, rc 0) 00000100:00100000:2.0:1788746809.772947:0:25514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4483c67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bbae771a-9fe8-425e-89d3-e0a0b7b26f24+15:18681:x1875636305163392:12345-192.168.204.39@tcp:101:bash.0 Request processed in 7008us (7221us total) trans 12884901896 rc 0/0 00000100:00100000:2.0:1788746809.772954:0:25514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 37 00000100:00100000:0.0:1788746809.786648:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788746809.786802:0:22623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636305163648 00000100:00100000:2.0:1788746809.786813:0:22623:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636305163648 00000100:00100000:2.0:1788746809.786895:0:22623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 38 00000100:00100000:2.0:1788746809.786907:0:22623:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4483c65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bbae771a-9fe8-425e-89d3-e0a0b7b26f24+15:18681:x1875636305163648:12345-192.168.204.39@tcp:101:bash.0 00010000:00010000:2.0:1788746809.786932:0:22623:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788746809.786953:0:22623:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a4483ed6600/0xfac36e8915414c2a lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4d2179c47f07894f expref: -99 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746809.787035:0:22623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a4483ed7200/0xfac36e8915414c31 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746809.787050:0:22623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a4483ed7200/0xfac36e8915414c31 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746809.787061:0:22623:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a4483ed7200/0xfac36e8915414c31 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788746809.787110:0:22623:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1788746809.787141:0:22623:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788746809.787164:0:22623:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a4483ed7200/0xfac36e8915414c31 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746809.787177:0:22623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a4483ed7200/0xfac36e8915414c31 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746809.787201:0:22623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a4483ed6600/0xfac36e8915414c2a lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.39@tcp remote: 0x4d2179c47f07894f expref: 17 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746809.787222:0:22623:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a4483ed7200/0xfac36e8915414c31 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.39@tcp remote: 0x4d2179c47f07894f expref: 16 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746809.787230:0:22623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8a4483586f00) 00010000:00010000:2.0:1788746809.787233:0:22623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788746809.787236:0:22623:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a4483ed7200, rc 0) 00000100:00100000:2.0:1788746809.787363:0:22623:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4483c65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bbae771a-9fe8-425e-89d3-e0a0b7b26f24+16:18681:x1875636305163648:12345-192.168.204.39@tcp:101:bash.0 Request processed in 458us (724us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746809.787370:0:22623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 38 00000100:00100000:3.0:1788746809.791283:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788746809.791584:0:22626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636305163904 00000100:00100000:2.0:1788746809.791596:0:22626:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636305163904 00000100:00100000:2.0:1788746809.791654:0:22626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 5 00000100:00100000:2.0:1788746809.791664:0:22626:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4484489180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bbae771a-9fe8-425e-89d3-e0a0b7b26f24+16:18681:x1875636305163904:12345-192.168.204.39@tcp:35:bash.0 00000100:00100000:2.0:1788746809.792033:0:22626:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4484489180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bbae771a-9fe8-425e-89d3-e0a0b7b26f24+17:18681:x1875636305163904:12345-192.168.204.39@tcp:35:bash.0 Request processed in 369us (758us total) trans 12884901897 rc 0/0 00000100:00100000:2.0:1788746809.792042:0:22626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 5 00000100:00100000:0.0:1788746809.924495:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788746809.924602:0:25672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636305164160 00000100:00100000:3.0:1788746809.924613:0:25672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636305164160 00000100:00100000:3.0:1788746809.924674:0:25672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 39 00000100:00100000:3.0:1788746809.924683:0:25672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4483c67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bbae771a-9fe8-425e-89d3-e0a0b7b26f24+17:18691:x1875636305164160:12345-192.168.204.39@tcp:101:lfs.0 00010000:00010000:3.0:1788746809.924708:0:25672:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788746809.924737:0:25672:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a45c216ca00/0xfac36e8915414c38 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4d2179c47f078956 expref: -99 pid: 25672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788746809.924844:0:25672:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1788746809.924971:0:25672:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a45c216ca00/0xfac36e8915414c38 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.39@tcp remote: 0x4d2179c47f078956 expref: 19 pid: 25672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746809.924985:0:25672:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a45b59ca400) 00010000:00010000:3.0:1788746809.924988:0:25672:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788746809.925104:0:25672:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a45c216ca00/0xfac36e8915414c38 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.39@tcp remote: 0x4d2179c47f078956 expref: 19 pid: 25672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746809.925121:0:25672:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a45c216ca00, rc 0) 00000100:00100000:3.0:1788746809.925188:0:25672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4483c67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bbae771a-9fe8-425e-89d3-e0a0b7b26f24+18:18691:x1875636305164160:12345-192.168.204.39@tcp:101:lfs.0 Request processed in 505us (702us total) trans 12884901898 rc 301/301 00000100:00100000:3.0:1788746809.925195:0:25672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 39 00000100:00100000:0.0:1788746809.931658:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788746809.931967:0:22627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636305164416 00000100:00100000:1.0:1788746809.931979:0:22627:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636305164416 00000100:00100000:1.0:1788746809.932055:0:22627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 6 00000100:00100000:1.0:1788746809.932066:0:22627:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4483c66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bbae771a-9fe8-425e-89d3-e0a0b7b26f24+18:18691:x1875636305164416:12345-192.168.204.39@tcp:35:lfs.0 00000100:00100000:1.0:1788746809.932527:0:22627:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4483c66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bbae771a-9fe8-425e-89d3-e0a0b7b26f24+19:18691:x1875636305164416:12345-192.168.204.39@tcp:35:lfs.0 Request processed in 460us (877us total) trans 12884901899 rc 0/0 00000100:00100000:1.0:1788746809.932535:0:22627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 6 00000100:00100000:1.0:1788746809.992262:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788746809.992796:0:25514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636305164672 00000100:00100000:2.0:1788746809.992808:0:25514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636305164672 00000100:00100000:2.0:1788746809.992889:0:25514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 40 00000100:00100000:2.0:1788746809.992913:0:25514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4483dd8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bbae771a-9fe8-425e-89d3-e0a0b7b26f24+19:18694:x1875636305164672:12345-192.168.204.39@tcp:101:lfs.0 00010000:00010000:2.0:1788746809.992939:0:25514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788746809.992961:0:25514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a4483ed6600/0xfac36e8915414c46 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4d2179c47f07895d expref: -99 pid: 25514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746809.993080:0:25514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a4483ed6400/0xfac36e8915414c4d lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 25514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746809.993094:0:25514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a4483ed6400/0xfac36e8915414c4d lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746809.993106:0:25514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a4483ed6400/0xfac36e8915414c4d lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788746809.993117:0:25514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788746809.993223:0:25514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a4483ed6600/0xfac36e8915414c46 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.39@tcp remote: 0x4d2179c47f07895d expref: 22 pid: 25514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746809.993243:0:25514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a4483ed6400/0xfac36e8915414c4d lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.39@tcp remote: 0x4d2179c47f07895d expref: 21 pid: 25514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746809.993251:0:25514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8a4483586f00) 00010000:00010000:2.0:1788746809.993253:0:25514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788746809.993258:0:25514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a4483ed6400, rc 0) 00000100:00100000:2.0:1788746809.993398:0:25514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4483dd8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bbae771a-9fe8-425e-89d3-e0a0b7b26f24+21:18694:x1875636305164672:12345-192.168.204.39@tcp:101:lfs.0 Request processed in 487us (1146us total) trans 12884901900 rc 0/0 00000100:00100000:2.0:1788746809.993406:0:25514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 40 00000100:00100000:0.0:1788746810.005986:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788746810.006045:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788746810.006168:0:22609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636305164928 00000100:00100000:2.0:1788746810.006180:0:22609:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636305164928 00000100:00100000:2.0:1788746810.006320:0:22609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 0 00000100:00100000:2.0:1788746810.006335:0:22609:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4483c65c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bbae771a-9fe8-425e-89d3-e0a0b7b26f24+21:2399:x1875636305164928:12345-192.168.204.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788746810.006357:0:22609:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788746810.006387:0:22609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a4483ed6400/0xfac36e8915414c4d lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.39@tcp remote: 0x4d2179c47f07895d expref: 21 pid: 25514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746810.006407:0:22609:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8a4483586f00) 00010000:00010000:2.0:1788746810.006413:0:22609:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788746810.006477:0:22609:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4483c65c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bbae771a-9fe8-425e-89d3-e0a0b7b26f24+20:2399:x1875636305164928:12345-192.168.204.39@tcp:103:ldlm_bl.0 Request processed in 146us (430us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746810.006484:0:22609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 0 00000100:00100000:1.0:1788746810.008697:0:22625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636305164800 00000100:00100000:1.0:1788746810.008712:0:22625:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636305164800 00000100:00100000:1.0:1788746810.008785:0:22625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 41 00000100:00100000:1.0:1788746810.008796:0:22625:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4483c64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbae771a-9fe8-425e-89d3-e0a0b7b26f24+20:18694:x1875636305164800:12345-192.168.204.39@tcp:54:lfs.0 00010000:00010000:1.0:1788746810.008864:0:22625:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a45b7f95a00/0xfac36e8915414c5b lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746810.008893:0:22625:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a45b7f95a00/0xfac36e8915414c5b lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746810.008904:0:22625:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a45b7f95a00/0xfac36e8915414c5b lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746810.008964:0:22625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a45b7f95a00/0xfac36e8915414c5b lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746810.008970:0:22625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a45b7f95a00/0xfac36e8915414c5b lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746810.008976:0:22625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a45b7f95a00/0xfac36e8915414c5b lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746810.008982:0:22625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a45b7f95a00 already unused, calling callback (ffffffffc17914f0) 00010000:00010000:1.0:1788746810.008986:0:22625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a45b7f95a00/0xfac36e8915414c5b lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746810.009004:0:22625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a45b7f95a00/0xfac36e8915414c5b lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746810.009016:0:22625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8a4483586f00) 00010000:00010000:1.0:1788746810.009019:0:22625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788746810.009024:0:22625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a45b7f95a00/0xfac36e8915414c5b lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746810.009029:0:22625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a45b7f95a00/0xfac36e8915414c5b lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22625 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788746810.009112:0:22625:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4483c64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbae771a-9fe8-425e-89d3-e0a0b7b26f24+20:18694:x1875636305164800:12345-192.168.204.39@tcp:54:lfs.0 Request processed in 318us (3137us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746810.009119:0:22625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 41 00000100:00100000:0.0:1788746810.013989:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788746810.014100:0:22626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636305165184 00000100:00100000:2.0:1788746810.014109:0:22626:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636305165184 00000100:00100000:2.0:1788746810.014172:0:22626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 7 00000100:00100000:2.0:1788746810.014183:0:22626:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4483c66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bbae771a-9fe8-425e-89d3-e0a0b7b26f24+20:18694:x1875636305165184:12345-192.168.204.39@tcp:35:lfs.0 00000100:00100000:2.0:1788746810.014465:0:22626:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4483c66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bbae771a-9fe8-425e-89d3-e0a0b7b26f24+21:18694:x1875636305165184:12345-192.168.204.39@tcp:35:lfs.0 Request processed in 283us (484us total) trans 12884901901 rc 0/0 00000100:00100000:2.0:1788746810.014473:0:22626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 7 00010000:00010000:0.0:1788746810.258632:0:25654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788746810.581972:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788746810.582069:0:25672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636305165440 00000100:00100000:3.0:1788746810.582080:0:25672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636305165440 00000100:00100000:3.0:1788746810.582150:0:25672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 42 00000100:00100000:3.0:1788746810.582161:0:25672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4481b64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bbae771a-9fe8-425e-89d3-e0a0b7b26f24+21:18725:x1875636305165440:12345-192.168.204.39@tcp:101:cat.0 00010000:00010000:3.0:1788746810.582187:0:25672:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788746810.582209:0:25672:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a45c216ca00/0xfac36e8915414c62 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4d2179c47f078964 expref: -99 pid: 25672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746810.582368:0:25672:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a45c216c000/0xfac36e8915414c69 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 25672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746810.582384:0:25672:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a45c216c000/0xfac36e8915414c69 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746810.582398:0:25672:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a45c216c000/0xfac36e8915414c69 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25672 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788746810.582433:0:25672:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1788746810.582579:0:25672:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a45c216ca00/0xfac36e8915414c62 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.39@tcp remote: 0x4d2179c47f078964 expref: 24 pid: 25672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746810.582600:0:25672:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a45c216c000/0xfac36e8915414c69 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.39@tcp remote: 0x4d2179c47f078964 expref: 23 pid: 25672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746810.582609:0:25672:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8a4483586f00) 00010000:00010000:3.0:1788746810.582612:0:25672:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788746810.582615:0:25672:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a45c216c000, rc 0) 00000100:00100000:3.0:1788746810.582681:0:25672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4481b64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bbae771a-9fe8-425e-89d3-e0a0b7b26f24+23:18725:x1875636305165440:12345-192.168.204.39@tcp:101:cat.0 Request processed in 521us (717us total) trans 12884901902 rc 0/0 00000100:00100000:3.0:1788746810.582687:0:25672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 42 00000100:00100000:0.0:1788746810.588231:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788746810.588389:0:22610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636305165568 00000100:00100000:3.0:1788746810.588399:0:22610:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636305165568 00000100:00100000:3.0:1788746810.588476:0:22610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1 00000100:00100000:3.0:1788746810.588491:0:22610:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4483c65f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bbae771a-9fe8-425e-89d3-e0a0b7b26f24+23:2399:x1875636305165568:12345-192.168.204.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788746810.588517:0:22610:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788746810.588554:0:22610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a45c216c000/0xfac36e8915414c69 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.39@tcp remote: 0x4d2179c47f078964 expref: 23 pid: 25672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746810.588572:0:22610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8a4483586f00) 00010000:00010000:3.0:1788746810.588577:0:22610:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788746810.588639:0:22610:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4483c65f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bbae771a-9fe8-425e-89d3-e0a0b7b26f24+22:2399:x1875636305165568:12345-192.168.204.39@tcp:103:ldlm_bl.0 Request processed in 151us (418us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746810.588647:0:22610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1 00000100:00100000:0.0:1788746810.591713:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788746810.591842:0:22626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636305165824 00000100:00100000:2.0:1788746810.591851:0:22626:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636305165824 00000100:00100000:2.0:1788746810.591916:0:22626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 8 00000100:00100000:2.0:1788746810.591926:0:22626:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a45bfe9ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bbae771a-9fe8-425e-89d3-e0a0b7b26f24+22:18725:x1875636305165824:12345-192.168.204.39@tcp:35:cat.0 00000100:00100000:2.0:1788746810.592207:0:22626:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a45bfe9ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bbae771a-9fe8-425e-89d3-e0a0b7b26f24+23:18725:x1875636305165824:12345-192.168.204.39@tcp:35:cat.0 Request processed in 281us (502us total) trans 12884901903 rc 0/0 00000100:00100000:2.0:1788746810.592215:0:22626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 8 00000100:00100000:2.0:1788746810.689408:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788746810.689557:0:22623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636305166080 00000100:00100000:0.0:1788746810.689568:0:22623:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636305166080 00000100:00100000:0.0:1788746810.689639:0:22623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 43 00000100:00100000:0.0:1788746810.689649:0:22623:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4481b66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bbae771a-9fe8-425e-89d3-e0a0b7b26f24+23:18731:x1875636305166080:12345-192.168.204.39@tcp:101:dd.0 00010000:00010000:0.0:1788746810.689675:0:22623:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788746810.689699:0:22623:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a4580031600/0xfac36e8915414c77 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4d2179c47f07896b expref: -99 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746810.689818:0:22623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a4580030e00/0xfac36e8915414c7e lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746810.689834:0:22623:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a4483ed7e00/0xfac36e8915414c1c lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.39@tcp remote: 0x4d2179c47f078948 expref: 24 pid: 25514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746810.689842:0:22623:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a4483ed7200/0xfac36e8915414c31 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.39@tcp remote: 0x4d2179c47f07894f expref: 24 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746810.689850:0:22623:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a4580030e00/0xfac36e8915414c7e lrc: 5/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746810.690046:0:22623:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a4483ed7200/0xfac36e8915414c31 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.39@tcp remote: 0x4d2179c47f07894f expref: 24 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746810.690061:0:22623:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a4483ed7200/0xfac36e8915414c31 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.39@tcp remote: 0x4d2179c47f07894f expref: 24 pid: 22623 timeout: 840 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788746810.690074:0:22623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a45bfe9b480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22623:1875636324151680:192.168.204.39@tcp:104: 00010000:00010000:0.0:1788746810.690219:0:22623:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a4483ed7e00/0xfac36e8915414c1c lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.39@tcp remote: 0x4d2179c47f078948 expref: 24 pid: 25514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746810.690229:0:22623:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a4483ed7e00/0xfac36e8915414c1c lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.39@tcp remote: 0x4d2179c47f078948 expref: 24 pid: 25514 timeout: 840 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788746810.690238:0:22623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a45bfe99f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22623:1875636324151808:192.168.204.39@tcp:104: 00000100:00100000:0.0:1788746810.690261:0:22623:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a45875f46c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788746810.700913:0:22623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a45bfe9b480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22623:1875636324151680:192.168.204.39@tcp:104: 00000100:00100000:0.0:1788746810.703337:0:22623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a45bfe99f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22623:1875636324151808:192.168.204.39@tcp:104: 00010000:00010000:0.0:1788746810.703374:0:22623:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a4580030e00/0xfac36e8915414c7e lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788746810.711783:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788746810.711839:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788746810.712023:0:22608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636305166336 00000100:00100000:3.0:1788746810.712033:0:22608:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636305166336 00010000:00010000:3.0:1788746810.712077:0:22608:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a4483ed7e00/0xfac36e8915414c1c lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.39@tcp remote: 0x4d2179c47f078948 expref: 25 pid: 25514 timeout: 840 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788746810.712107:0:22608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636305166208 00000100:00100000:3.0:1788746810.712110:0:22608:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636305166208 00010000:00010000:3.0:1788746810.712124:0:22608:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a4483ed7200/0xfac36e8915414c31 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.39@tcp remote: 0x4d2179c47f07894f expref: 26 pid: 22623 timeout: 840 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788746810.712161:0:22608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 17 00000100:00100000:3.0:1788746810.712171:0:22608:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4483ddbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bbae771a-9fe8-425e-89d3-e0a0b7b26f24+26:2399:x1875636305166336:12345-192.168.204.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788746810.712188:0:22608:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788746810.712206:0:22608:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a4483ed7e00/0xfac36e8915414c1c lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.39@tcp remote: 0x4d2179c47f078948 expref: 26 pid: 25514 timeout: 840 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746810.712217:0:22608:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a4483ed7e00/0xfac36e8915414c1c lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.39@tcp remote: 0x4d2179c47f078948 expref: 26 pid: 25514 timeout: 840 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746810.712240:0:22608:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a4483ed7e00/0xfac36e8915414c1c lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.39@tcp remote: 0x4d2179c47f078948 expref: 26 pid: 25514 timeout: 840 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746810.712255:0:22608:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8a4483586f00) 00010000:00010000:3.0:1788746810.712261:0:22608:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8a4580030e00/0xfac36e8915414c7e lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746810.712270:0:22608:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8a4580030e00/0xfac36e8915414c7e lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746810.712347:0:22608:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788746810.712401:0:22608:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4483ddbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bbae771a-9fe8-425e-89d3-e0a0b7b26f24+25:2399:x1875636305166336:12345-192.168.204.39@tcp:103:ldlm_bl.0 Request processed in 231us (628us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746810.712409:0:22608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 17 00000100:00100000:3.0:1788746810.712428:0:22608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 18 00000100:00100000:3.0:1788746810.712434:0:22608:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4584203c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bbae771a-9fe8-425e-89d3-e0a0b7b26f24+24:2399:x1875636305166208:12345-192.168.204.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788746810.712442:0:22608:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788746810.712448:0:22608:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a4483ed7200/0xfac36e8915414c31 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.39@tcp remote: 0x4d2179c47f07894f expref: 24 pid: 22623 timeout: 840 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746810.712458:0:22608:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a4483ed7200/0xfac36e8915414c31 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.39@tcp remote: 0x4d2179c47f07894f expref: 24 pid: 22623 timeout: 840 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746810.712470:0:22608:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a4483ed7200/0xfac36e8915414c31 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.39@tcp remote: 0x4d2179c47f07894f expref: 24 pid: 22623 timeout: 840 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746810.712479:0:22608:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8a4483586f00) 00010000:00010000:3.0:1788746810.712483:0:22608:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8a4580030e00/0xfac36e8915414c7e lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746810.712489:0:22608:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a4580030e00/0xfac36e8915414c7e lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746810.712496:0:22608:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a4580030e00/0xfac36e8915414c7e lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746810.712529:0:22608:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788746810.712568:0:22608:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4584203c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bbae771a-9fe8-425e-89d3-e0a0b7b26f24+23:2399:x1875636305166208:12345-192.168.204.39@tcp:103:ldlm_bl.0 Request processed in 122us (716us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746810.712576:0:22608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 18 00010000:00010000:0.0:1788746810.713504:0:22623:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a4580030e00/0xfac36e8915414c7e lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746810.713517:0:22623:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a4580030e00/0xfac36e8915414c7e lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788746810.713540:0:22623:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1788746810.713698:0:22623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a4580031600/0xfac36e8915414c77 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.39@tcp remote: 0x4d2179c47f07896b expref: 24 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746810.713717:0:22623:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a4580030e00/0xfac36e8915414c7e lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.39@tcp remote: 0x4d2179c47f07896b expref: 23 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746810.713725:0:22623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8a4483586f00) 00010000:00010000:0.0:1788746810.713728:0:22623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788746810.713731:0:22623:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a4580030e00, rc 0) 00000100:00100000:0.0:1788746810.713795:0:22623:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4481b66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bbae771a-9fe8-425e-89d3-e0a0b7b26f24+23:18731:x1875636305166080:12345-192.168.204.39@tcp:101:dd.0 Request processed in 24148us (24399us total) trans 12884901904 rc 0/0 00000100:00100000:0.0:1788746810.713804:0:22623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 43 00000100:00100000:1.0:1788746810.718680:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788746810.718830:0:22624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636305166464 00000100:00100000:0.0:1788746810.718841:0:22624:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636305166464 00000100:00100000:0.0:1788746810.718923:0:22624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 44 00000100:00100000:0.0:1788746810.718934:0:22624:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4483ddbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bbae771a-9fe8-425e-89d3-e0a0b7b26f24+23:18731:x1875636305166464:12345-192.168.204.39@tcp:101:dd.0 00010000:00010000:0.0:1788746810.718958:0:22624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788746810.718980:0:22624:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a4581527c00/0xfac36e8915414c8c lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4d2179c47f078972 expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746810.719656:0:22624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a4581526800/0xfac36e8915414c93 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746810.719676:0:22624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a4581526800/0xfac36e8915414c93 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746810.719690:0:22624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a4581526800/0xfac36e8915414c93 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746810.719826:0:22624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a4581527c00/0xfac36e8915414c8c lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.39@tcp remote: 0x4d2179c47f078972 expref: 25 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746810.719848:0:22624:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a4581526800/0xfac36e8915414c93 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.39@tcp remote: 0x4d2179c47f078972 expref: 24 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746810.719875:0:22624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8a4483586f00) 00010000:00010000:0.0:1788746810.720688:0:22624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788746810.720693:0:22624:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a4581526800, rc 0) 00000100:00100000:0.0:1788746810.720788:0:22624:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4483ddbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bbae771a-9fe8-425e-89d3-e0a0b7b26f24+24:18731:x1875636305166464:12345-192.168.204.39@tcp:101:dd.0 Request processed in 1853us (2117us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746810.720796:0:22624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 44 00000100:00100000:1.0:1788746810.724721:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788746810.725323:0:25514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636305166720 00000100:00100000:2.0:1788746810.725335:0:25514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636305166720 00000100:00100000:2.0:1788746810.725414:0:25514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 45 00000100:00100000:2.0:1788746810.725425:0:25514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4483590000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bbae771a-9fe8-425e-89d3-e0a0b7b26f24+24:18731:x1875636305166720:12345-192.168.204.39@tcp:36:dd.0 00010000:00010000:2.0:1788746810.726058:0:25514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a4483ed6200/0xfac36e8915414c9a lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 25514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746810.726078:0:25514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a4483ed6200/0xfac36e8915414c9a lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746810.726090:0:25514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a4483ed6200/0xfac36e8915414c9a lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25514 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788746810.726133:0:25514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901905 00000004:00010000:2.0:1788746810.726158:0:25514:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 00000000d9ba0578 reply state 000000000aa6dcf2 transno 12884901906 ns: mdt-lustre-MDT0000_UUID lock: ffff8a4483ed6200/0xfac36e8915414c9a lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746810.726172:0:25514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a4483ed6200/0xfac36e8915414c9a lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746810.726179:0:25514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8a4483586f00) 00010000:00010000:2.0:1788746810.726183:0:25514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788746810.726187:0:25514:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788746810.726468:0:25514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4483590000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bbae771a-9fe8-425e-89d3-e0a0b7b26f24+27:18731:x1875636305166720:12345-192.168.204.39@tcp:36:dd.0 Request processed in 1043us (1753us total) trans 12884901906 rc 0/0 00000100:00100000:2.0:1788746810.726476:0:25514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 45 00000020:00080000:2.0:1788746810.726482:0:25514:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1788746810.727116:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788746810.727155:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788746810.727201:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788746810.727231:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788746810.727256:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788746810.727282:0:22615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636305166848 00000100:00100000:1.0:1788746810.727320:0:22615:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636305166848 00000100:00100000:1.0:1788746810.727365:0:22615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 166 00000100:00100000:0.0:1788746810.727368:0:24665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636305167232 00000100:00100000:0.0:1788746810.727375:0:24665:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636305167232 00000100:00100000:1.0:1788746810.727377:0:22615:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a45af2a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f755556-f1cd-4e4b-8ec3-48b3fc3a369c+13:2402:x1875636305166848:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:0.0:1788746810.727416:0:24665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636305167744 00000100:00100000:0.0:1788746810.727420:0:24665:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636305167744 00000100:00100000:1.0:1788746810.727433:0:22615:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a45af2a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f755556-f1cd-4e4b-8ec3-48b3fc3a369c+13:2402:x1875636305166848:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 57us (173us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746810.727442:0:22615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 166 00000100:00100000:0.0:1788746810.727446:0:24665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 16 00000100:00100000:0.0:1788746810.727456:0:24665:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4484468700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bbae771a-9fe8-425e-89d3-e0a0b7b26f24+5:2402:x1875636305167232:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:0.0:1788746810.727490:0:24665:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4484468700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bbae771a-9fe8-425e-89d3-e0a0b7b26f24+5:2402:x1875636305167232:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 36us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746810.727503:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788746810.727510:0:24665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 16 00000100:00100000:0.0:1788746810.727579:0:24665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636305167104 00000100:00100000:0.0:1788746810.727583:0:24665:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636305167104 00000100:00100000:0.0:1788746810.727604:0:24665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 17 00000100:00100000:0.0:1788746810.727610:0:24665:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a45b7ef0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7d8327c8-4436-4f17-b07d-03a96e9e6b73+5:2402:x1875636305167744:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:3.0:1788746810.728045:0:25016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 18 00000100:00100000:3.0:1788746810.728056:0:25016:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a45b7ef0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bbae771a-9fe8-425e-89d3-e0a0b7b26f24+5:2402:x1875636305167104:12345-192.168.204.39@tcp:400:kworker.0 00000100:00080000:2.0:1788746810.728100:0:22619:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788746810.728120:0:22619:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788746810.728132:0:25672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636305166976 00000100:00100000:2.0:1788746810.728137:0:25672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636305166976 00000100:00100000:2.0:1788746810.728170:0:22624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636305167488 00000100:00100000:2.0:1788746810.728173:0:22624:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636305167488 00000100:00100000:2.0:1788746810.728210:0:22624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 61 00000100:00100000:2.0:1788746810.728218:0:22624:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a448446b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bbae771a-9fe8-425e-89d3-e0a0b7b26f24+5:2402:x1875636305166976:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:0.0:1788746810.732358:0:24665:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a45b7ef0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7d8327c8-4436-4f17-b07d-03a96e9e6b73+5:2402:x1875636305167744:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 4734us (5112us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746810.732374:0:24665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 17 00000100:00100000:1.0:1788746810.732385:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788746810.732433:0:22623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636305167360 00000100:00100000:0.0:1788746810.732443:0:22623:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636305167360 00000100:00100000:1.0:1788746810.732454:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788746810.732479:0:22623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 62 00000100:00100000:0.0:1788746810.732488:0:22623:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4483cbd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7d8327c8-4436-4f17-b07d-03a96e9e6b73+5:2402:x1875636305167488:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:1.0:1788746810.732795:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788746810.732819:0:24129:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636305167616 00000100:00100000:1.0:1788746810.732823:0:24129:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636305167616 00000100:00100000:1.0:1788746810.732893:0:24129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 19 00000100:00100000:1.0:1788746810.732901:0:24129:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a448379c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7d8327c8-4436-4f17-b07d-03a96e9e6b73+5:2402:x1875636305167616:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:1.0:1788746810.732959:0:24129:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a448379c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7d8327c8-4436-4f17-b07d-03a96e9e6b73+5:2402:x1875636305167616:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 58us (505us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746810.732966:0:24129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 19 00000100:00100000:3.0:1788746810.733242:0:25016:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a45b7ef0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bbae771a-9fe8-425e-89d3-e0a0b7b26f24+5:2402:x1875636305167104:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 5186us (5737us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746810.733250:0:25016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 18 00000100:00100000:0.0:1788746810.733637:0:22623:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4483cbd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7d8327c8-4436-4f17-b07d-03a96e9e6b73+5:2402:x1875636305167488:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 1148us (6444us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746810.733646:0:22623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 62 00000100:00100000:0.0:1788746810.733678:0:22623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636305167872 00000100:00100000:0.0:1788746810.733683:0:22623:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636305167872 00000100:00100000:0.0:1788746810.733711:0:22623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 63 00000100:00100000:0.0:1788746810.733719:0:22623:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a448379ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7d8327c8-4436-4f17-b07d-03a96e9e6b73+12:2402:x1875636305167360:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:0.0:1788746810.733769:0:22623:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a448379ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7d8327c8-4436-4f17-b07d-03a96e9e6b73+12:2402:x1875636305167360:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 51us (1386us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746810.733776:0:22623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 63 00000100:00100000:0.0:1788746810.733792:0:22623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 46 00000100:00100000:0.0:1788746810.733800:0:22623:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a448379c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bbae771a-9fe8-425e-89d3-e0a0b7b26f24+27:18731:x1875636305167872:12345-192.168.204.39@tcp:101:dd.0 00010000:00010000:0.0:1788746810.733815:0:22623:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788746810.733836:0:22623:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a4581527c00/0xfac36e8915414ca1 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4d2179c47f078979 expref: -99 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746810.733912:0:22623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a4581527c00/0xfac36e8915414ca1 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.39@tcp remote: 0x4d2179c47f078979 expref: 28 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746810.733928:0:22623:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a4581527c00/0xfac36e8915414ca1 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.39@tcp remote: 0x4d2179c47f078979 expref: 28 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746810.733948:0:22623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8a4483586f00) 00000100:00080000:2.0:1788746810.733950:0:22619:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788746810.733953:0:22623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788746810.733958:0:22623:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a4581527c00, rc 0) 00000100:00100000:2.0:1788746810.734028:0:22624:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a448446b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bbae771a-9fe8-425e-89d3-e0a0b7b26f24+5:2402:x1875636305166976:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 5809us (6913us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746810.734037:0:22624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 61 00000100:00100000:0.0:1788746810.734387:0:22623:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a448379c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bbae771a-9fe8-425e-89d3-e0a0b7b26f24+28:18731:x1875636305167872:12345-192.168.204.39@tcp:101:dd.0 Request processed in 586us (1591us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746810.734396:0:22623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 46 00000100:00100000:3.0:1788746810.771461:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788746810.771686:0:22608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636305168128 00000100:00100000:2.0:1788746810.771699:0:22608:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636305168128 00000100:00100000:2.0:1788746810.771832:0:22608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 2 00000100:00100000:2.0:1788746810.771845:0:22608:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a448448a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bbae771a-9fe8-425e-89d3-e0a0b7b26f24+28:18731:x1875636305168128:12345-192.168.204.39@tcp:103:dd.0 00010000:00010000:2.0:1788746810.771874:0:22608:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788746810.771900:0:22608:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a4581527c00/0xfac36e8915414ca1 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.39@tcp remote: 0x4d2179c47f078979 expref: 28 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746810.771920:0:22608:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8a4483586f00) 00010000:00010000:2.0:1788746810.771925:0:22608:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788746810.771979:0:22608:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a448448a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bbae771a-9fe8-425e-89d3-e0a0b7b26f24+27:18731:x1875636305168128:12345-192.168.204.39@tcp:103:dd.0 Request processed in 137us (698us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746810.771994:0:22608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 2 00000100:00100000:0.0:1788746810.774243:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788746810.774701:0:22625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636305168256 00000100:00100000:3.0:1788746810.774711:0:22625:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636305168256 00000100:00100000:3.0:1788746810.774777:0:22625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 47 00000100:00100000:3.0:1788746810.774788:0:22625:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a45bfe99f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbae771a-9fe8-425e-89d3-e0a0b7b26f24+27:18731:x1875636305168256:12345-192.168.204.39@tcp:58:dd.0 00010000:00010000:3.0:1788746810.774913:0:22625:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a45c216c000/0xfac36e8915414ca8 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746810.774935:0:22625:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a45c216c000/0xfac36e8915414ca8 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746810.774947:0:22625:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a45c216c000/0xfac36e8915414ca8 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22625 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788746810.776269:0:22625:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788746810.776343:0:22625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 64 off8384 00000040:00080000:3.0:1788746810.776486:0:22625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x14:0x0].1, 136 off8328 00000100:00100000:3.0:1788746810.776592:0:22625:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a45bfe99f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbae771a-9fe8-425e-89d3-e0a0b7b26f24+27:18731:x1875636305168256:12345-192.168.204.39@tcp:58:dd.0 Request processed in 1800us (2352us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746810.776602:0:22625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 47 00000100:00100000:3.0:1788746810.783020:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788746810.785991:0:22624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636305168384 00000100:00100000:2.0:1788746810.786010:0:22624:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636305168384 00000100:00100000:2.0:1788746810.786098:0:22624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 48 00000100:00100000:2.0:1788746810.786110:0:22624:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a448448b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bbae771a-9fe8-425e-89d3-e0a0b7b26f24+27:18731:x1875636305168384:12345-192.168.204.39@tcp:101:dd.0 00010000:00010000:2.0:1788746810.786147:0:22624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788746810.786169:0:22624:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a4483ed6000/0xfac36e8915414caf lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4d2179c47f078980 expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746810.786986:0:22624:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a45c216c000/0xfac36e8915414ca8 lrc: 2/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746810.787003:0:22624:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a4483ed6000/0xfac36e8915414caf lrc: 4/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.39@tcp remote: 0x4d2179c47f078980 expref: 28 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746810.787024:0:22624:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8a45c216c000/0xfac36e8915414ca8 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 22625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746810.787041:0:22624:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a4483ed6000/0xfac36e8915414caf lrc: 3/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.39@tcp remote: 0x4d2179c47f078980 expref: 28 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746810.787057:0:22624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8a4483586f00) 00010000:00010000:2.0:1788746810.787060:0:22624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788746810.787065:0:22624:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8a4483ed6000/0xfac36e8915414caf lrc: 3/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.39@tcp remote: 0x4d2179c47f078980 expref: 28 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746810.787072:0:22624:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a4483ed6000, rc 0) 00000100:00100000:2.0:1788746810.789574:0:22624:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a448448b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bbae771a-9fe8-425e-89d3-e0a0b7b26f24+28:18731:x1875636305168384:12345-192.168.204.39@tcp:101:dd.0 Request processed in 3453us (6551us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746810.789588:0:22624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 48 00010000:00010000:3.0:1788746811.282816:0:22611:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788746811.730713:0:22657:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:3.0:1788746811.730723:0:22657:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788746811.730768:0:22657:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:3.0:1788746811.730778:0:22657:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:3.0:1788746811.730937:0:22657:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a448448bb80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:22657:1875636324151936:192.168.204.39@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788746811.731206:0:22657:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a458736e0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788746811.741788:0:22657:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a448448bb80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:22657:1875636324151936:192.168.204.39@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788746811.745550:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788746811.745824:0:22623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636305168512 00000100:00100000:2.0:1788746811.745835:0:22623:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636305168512 00000100:00100000:2.0:1788746811.745929:0:22623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 49 00000100:00100000:2.0:1788746811.745948:0:22623:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a45bfe9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bbae771a-9fe8-425e-89d3-e0a0b7b26f24+28:18732:x1875636305168512:12345-192.168.204.39@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788746811.745981:0:22623:0:(mdt_handler.c:8170:mdt_fid2path()) path get [0x2000013a1:0x2:0x0] from 18446744073709551615 #0 00000100:00080000:0.0:1788746811.746102:0:22619:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788746811.746103:0:22623:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a45bfe9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bbae771a-9fe8-425e-89d3-e0a0b7b26f24+28:18732:x1875636305168512:12345-192.168.204.39@tcp:53:lhsmtool_posix.0 Request processed in 158us (560us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746811.746113:0:22623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 49 00000100:00100000:3.0:1788746811.756377:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788746811.758465:0:22625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636305168640 00000100:00100000:2.0:1788746811.758497:0:22625:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636305168640 00000100:00100000:2.0:1788746811.758591:0:22625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 50 00000100:00100000:2.0:1788746811.758603:0:22625:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a448448b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbae771a-9fe8-425e-89d3-e0a0b7b26f24+28:18732:x1875636305168640:12345-192.168.204.39@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1788746811.758684:0:22625:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a4483ed7c00/0xfac36e8915414cb6 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746811.758703:0:22625:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a4483ed7c00/0xfac36e8915414cb6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746811.758717:0:22625:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a4483ed7c00/0xfac36e8915414cb6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746811.758788:0:22625:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a4483ed6a00/0xfac36e8915414cbd lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746811.758808:0:22625:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a4483ed6a00/0xfac36e8915414cbd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746811.758816:0:22625:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a4483ed6a00/0xfac36e8915414cbd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746811.758849:0:22625:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a4483ed6800/0xfac36e8915414cc4 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 22625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746811.758880:0:22625:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a4483ed6800/0xfac36e8915414cc4 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746811.758887:0:22625:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a4483ed6800/0xfac36e8915414cc4 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22625 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788746811.758940:0:22625:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1788746811.758944:0:22625:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788746811.758955:0:22625:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a4483ed6800/0xfac36e8915414cc4 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746811.758980:0:22625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a4483ed7c00/0xfac36e8915414cb6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746811.758988:0:22625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a4483ed7c00/0xfac36e8915414cb6 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746811.758995:0:22625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a4483ed7c00/0xfac36e8915414cb6 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746811.759002:0:22625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a4483ed7c00 already unused, calling callback (ffffffffc17914f0) 00010000:00010000:2.0:1788746811.759006:0:22625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a4483ed7c00/0xfac36e8915414cb6 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746811.759014:0:22625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a4483ed7c00/0xfac36e8915414cb6 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746811.759025:0:22625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8a4483586a00) 00010000:00010000:2.0:1788746811.759029:0:22625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788746811.759033:0:22625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a4483ed7c00/0xfac36e8915414cb6 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746811.759052:0:22625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a4483ed7c00/0xfac36e8915414cb6 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746811.759068:0:22625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a4483ed6a00/0xfac36e8915414cbd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746811.759074:0:22625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a4483ed6a00/0xfac36e8915414cbd lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746811.759079:0:22625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a4483ed6a00/0xfac36e8915414cbd lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746811.759083:0:22625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a4483ed6a00 already unused, calling callback (ffffffffc17914f0) 00010000:00010000:2.0:1788746811.759086:0:22625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a4483ed6a00/0xfac36e8915414cbd lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746811.759092:0:22625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a4483ed6a00/0xfac36e8915414cbd lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746811.759100:0:22625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x925dcd63 (ffff8a4483586d00) 00010000:00010000:2.0:1788746811.759102:0:22625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788746811.759105:0:22625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a4483ed6a00/0xfac36e8915414cbd lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746811.759111:0:22625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a4483ed6a00/0xfac36e8915414cbd lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746811.759125:0:22625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a4483ed6800/0xfac36e8915414cc4 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746811.759130:0:22625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a4483ed6800/0xfac36e8915414cc4 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 22625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746811.759143:0:22625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a4483ed6800/0xfac36e8915414cc4 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 22625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746811.759148:0:22625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a4483ed6800 already unused, calling callback (ffffffffc17914f0) 00010000:00010000:2.0:1788746811.759151:0:22625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a4483ed6800/0xfac36e8915414cc4 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 22625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746811.759157:0:22625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a4483ed6800/0xfac36e8915414cc4 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 22625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746811.759164:0:22625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8a4483586f00) 00010000:00010000:2.0:1788746811.759167:0:22625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788746811.759169:0:22625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a4483ed6800/0xfac36e8915414cc4 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 22625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746811.759174:0:22625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a4483ed6800/0xfac36e8915414cc4 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 22625 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788746811.759266:0:22625:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a448448b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbae771a-9fe8-425e-89d3-e0a0b7b26f24+28:18732:x1875636305168640:12345-192.168.204.39@tcp:34:lhsmtool_posix.0 Request processed in 664us (2898us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746811.759275:0:22625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 50 00000100:00100000:1.0:1788746811.768490:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788746811.768637:0:22624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636305168896 00000100:00100000:2.0:1788746811.768647:0:22624:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636305168896 00000100:00100000:2.0:1788746811.768723:0:22624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 51 00000100:00100000:2.0:1788746811.768734:0:22624:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a448379f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bbae771a-9fe8-425e-89d3-e0a0b7b26f24+28:18732:x1875636305168896:12345-192.168.204.39@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788746811.768754:0:22624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788746811.768774:0:22624:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a4483ed6800/0xfac36e8915414ccb lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4d2179c47f078987 expref: -99 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746811.768906:0:22624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a4483ed6a00/0xfac36e8915414cd2 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 22624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746811.768921:0:22624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a4483ed6a00/0xfac36e8915414cd2 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746811.768933:0:22624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a4483ed6a00/0xfac36e8915414cd2 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22624 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788746811.768945:0:22624:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788746811.769026:0:22624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a4483ed6a00/0xfac36e8915414cd2 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746811.769034:0:22624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a4483ed6a00/0xfac36e8915414cd2 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 22624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746811.769042:0:22624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a4483ed6a00/0xfac36e8915414cd2 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 22624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746811.769047:0:22624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a4483ed6a00 already unused, calling callback (ffffffffc17914f0) 00010000:00010000:2.0:1788746811.769051:0:22624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a4483ed6a00/0xfac36e8915414cd2 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 22624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746811.769059:0:22624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a4483ed6a00/0xfac36e8915414cd2 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 22624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746811.769070:0:22624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8a4483586f00) 00010000:00010000:2.0:1788746811.769073:0:22624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788746811.769078:0:22624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a4483ed6a00/0xfac36e8915414cd2 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 22624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746811.769095:0:22624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a4483ed6a00/0xfac36e8915414cd2 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 22624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746811.769138:0:22624:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a4483ed6800/0xfac36e8915414ccb lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.39@tcp remote: 0x4d2179c47f078987 expref: 30 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746811.769160:0:22624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8a4483586a00) 00010000:00010000:2.0:1788746811.769163:0:22624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788746811.769167:0:22624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a4483ed6800/0xfac36e8915414ccb lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.39@tcp remote: 0x4d2179c47f078987 expref: 30 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746811.769177:0:22624:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a4483ed6800, rc 0) 00000100:00100000:2.0:1788746811.769239:0:22624:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a448379f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bbae771a-9fe8-425e-89d3-e0a0b7b26f24+29:18732:x1875636305168896:12345-192.168.204.39@tcp:101:lhsmtool_posix.0 Request processed in 507us (768us total) trans 12884901907 rc 301/301 00000100:00100000:2.0:1788746811.769247:0:22624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 51 00000100:00100000:0.0:1788746811.783253:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788746811.785565:0:22623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636305169024 00000100:00100000:2.0:1788746811.785581:0:22623:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636305169024 00000100:00100000:2.0:1788746811.785669:0:22623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 52 00000100:00100000:2.0:1788746811.785682:0:22623:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a45bfe99880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bbae771a-9fe8-425e-89d3-e0a0b7b26f24+29:18732:x1875636305169024:12345-192.168.204.39@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788746811.785720:0:22623:0:(mdt_handler.c:8170:mdt_fid2path()) path get [0x2000013a1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788746811.785860:0:22623:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a45bfe99880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bbae771a-9fe8-425e-89d3-e0a0b7b26f24+29:18732:x1875636305169024:12345-192.168.204.39@tcp:53:lhsmtool_posix.0 Request processed in 181us (2616us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746811.785868:0:22623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 52 00000100:00100000:3.0:1788746811.798009:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788746811.798154:0:25672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636305169280 00000100:00100000:1.0:1788746811.798165:0:25672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636305169280 00000100:00100000:1.0:1788746811.798227:0:25672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 53 00000100:00100000:1.0:1788746811.798238:0:25672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4484488700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bbae771a-9fe8-425e-89d3-e0a0b7b26f24+29:18732:x1875636305169280:12345-192.168.204.39@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788746811.798258:0:25672:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788746811.798281:0:25672:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a45b7f95a00/0xfac36e8915414ce0 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4d2179c47f07898e expref: -99 pid: 25672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788746811.798720:0:25672:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x280000401:0x6:0x0], count =60 00000004:00080000:1.0:1788746811.798727:0:25672:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000401:0x6:0x0]+60 in llog 00000004:00080000:1.0:1788746811.798748:0:25672:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x42:0x0], index 0: 0 00010000:00010000:1.0:1788746811.798911:0:25672:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a45b7f95000/0xfac36e8915414ce7 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746811.798927:0:25672:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a45b7f95000/0xfac36e8915414ce7 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746811.798939:0:25672:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a45b7f95000/0xfac36e8915414ce7 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746811.799010:0:25672:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a45b7f95a00/0xfac36e8915414ce0 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.39@tcp remote: 0x4d2179c47f07898e expref: 32 pid: 25672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746811.799029:0:25672:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a45b7f95000/0xfac36e8915414ce7 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.39@tcp remote: 0x4d2179c47f07898e expref: 31 pid: 25672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746811.799037:0:25672:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8a45b59ca600) 00010000:00010000:1.0:1788746811.799040:0:25672:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788746811.799043:0:25672:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a45b7f95000, rc 0) 00000100:00100000:1.0:1788746811.799130:0:25672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4484488700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bbae771a-9fe8-425e-89d3-e0a0b7b26f24+31:18732:x1875636305169280:12345-192.168.204.39@tcp:101:lhsmtool_posix.0 Request processed in 893us (1130us total) trans 12884901908 rc 0/0 00000100:00100000:1.0:1788746811.799138:0:25672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 53 00000100:00100000:1.0:1788746811.823233:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788746811.823413:0:25514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636305169536 00000100:00100000:2.0:1788746811.823423:0:25514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636305169536 00000100:00100000:2.0:1788746811.823491:0:25514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 54 00000100:00100000:2.0:1788746811.823515:0:25514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a448379df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bbae771a-9fe8-425e-89d3-e0a0b7b26f24+31:18732:x1875636305169536:12345-192.168.204.39@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788746811.823572:0:25514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788746811.823600:0:25514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a45b7f95000/0xfac36e8915414ce7 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.39@tcp remote: 0x4d2179c47f07898e expref: 31 pid: 25672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746811.823621:0:25514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8a45b59ca600) 00010000:00010000:2.0:1788746811.823633:0:25514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788746811.823656:0:25514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a4483ed6800/0xfac36e8915414cf5 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746811.823671:0:25514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a4483ed6800/0xfac36e8915414cf5 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746811.823681:0:25514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a4483ed6800/0xfac36e8915414cf5 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746811.823694:0:25514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a4483ed6a00/0xfac36e8915414cfc lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0xa1dfd167 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746811.823701:0:25514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a4483ed6a00/0xfac36e8915414cfc lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xa1dfd167 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746811.823708:0:25514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a4483ed6a00/0xfac36e8915414cfc lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xa1dfd167 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746811.823752:0:25514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a4483ed6800/0xfac36e8915414cf5 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746811.823759:0:25514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a4483ed6800/0xfac36e8915414cf5 lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746811.823775:0:25514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a4483ed6800/0xfac36e8915414cf5 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746811.823782:0:25514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a4483ed6800 already unused, calling callback (ffffffffc17914f0) 00010000:00010000:2.0:1788746811.823786:0:25514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a4483ed6800/0xfac36e8915414cf5 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746811.823799:0:25514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a4483ed6800/0xfac36e8915414cf5 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746811.823808:0:25514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8a4483586100) 00010000:00010000:2.0:1788746811.823811:0:25514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788746811.823814:0:25514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a4483ed6800/0xfac36e8915414cf5 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746811.823821:0:25514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a4483ed6800/0xfac36e8915414cf5 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746811.823831:0:25514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a4483ed6a00/0xfac36e8915414cfc lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xa1dfd167 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746811.823847:0:25514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a4483ed6a00/0xfac36e8915414cfc lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xa1dfd167 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746811.823853:0:25514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a4483ed6a00/0xfac36e8915414cfc lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xa1dfd167 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746811.823859:0:25514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a4483ed6a00 already unused, calling callback (ffffffffc17914f0) 00010000:00010000:2.0:1788746811.823862:0:25514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a4483ed6a00/0xfac36e8915414cfc lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xa1dfd167 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746811.823877:0:25514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a4483ed6a00/0xfac36e8915414cfc lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xa1dfd167 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746811.823884:0:25514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xa1dfd167 (ffff8a4483586d00) 00010000:00010000:2.0:1788746811.823887:0:25514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788746811.823890:0:25514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a4483ed6a00/0xfac36e8915414cfc lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0xa1dfd167 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746811.823896:0:25514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a4483ed6a00/0xfac36e8915414cfc lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0xa1dfd167 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788746811.823987:0:25514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a448379df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bbae771a-9fe8-425e-89d3-e0a0b7b26f24+30:18732:x1875636305169536:12345-192.168.204.39@tcp:36:lhsmtool_posix.0 Request processed in 473us (765us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788746811.823995:0:25514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 54 00000100:00100000:0.0:1788746811.839358:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788746811.839597:0:22625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636305169664 00000100:00100000:3.0:1788746811.839607:0:22625:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636305169664 00000100:00100000:3.0:1788746811.839661:0:22625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 55 00000100:00100000:3.0:1788746811.839673:0:22625:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a45bfe99500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbae771a-9fe8-425e-89d3-e0a0b7b26f24+30:18732:x1875636305169664:12345-192.168.204.39@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788746811.839695:0:22625:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788746811.839784:0:22625:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a45c216ca00/0xfac36e8915414d03 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4d2179c47f078995 expref: -99 pid: 22625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746811.839864:0:22625:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a4587527200/0xfac36e8915414d0a lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746811.839878:0:22625:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a4587527200/0xfac36e8915414d0a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746811.839890:0:22625:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a4587527200/0xfac36e8915414d0a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746811.840895:0:22625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a45c216ca00/0xfac36e8915414d03 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.39@tcp remote: 0x4d2179c47f078995 expref: 32 pid: 22625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746811.840934:0:22625:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a4587527200/0xfac36e8915414d0a lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.39@tcp remote: 0x4d2179c47f078995 expref: 31 pid: 22625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746811.840942:0:22625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8a45833f9600) 00010000:00010000:3.0:1788746811.840945:0:22625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788746811.840949:0:22625:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a4587527200, rc 0) 00000100:00100000:3.0:1788746811.841384:0:22625:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a45bfe99500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbae771a-9fe8-425e-89d3-e0a0b7b26f24+31:18732:x1875636305169664:12345-192.168.204.39@tcp:101:lhsmtool_posix.0 Request processed in 1711us (2034us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746811.841393:0:22625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 55 00000100:00100000:3.0:1788746811.848461:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788746811.850462:0:22624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636305169920 00000100:00100000:2.0:1788746811.850476:0:22624:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636305169920 00000100:00100000:2.0:1788746811.850551:0:22624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 56 00000100:00100000:2.0:1788746811.850562:0:22624:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4484488e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bbae771a-9fe8-425e-89d3-e0a0b7b26f24+31:18732:x1875636305169920:12345-192.168.204.39@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788746811.850647:0:22624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a4483ed6a00/0xfac36e8915414d11 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746811.850666:0:22624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a4483ed6a00/0xfac36e8915414d11 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746811.850679:0:22624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a4483ed6a00/0xfac36e8915414d11 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22624 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788746811.850865:0:22624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].2, 88 off8344 00000004:00080000:2.0:1788746811.850877:0:22624:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 741591590293ns, next at 742591585721ns, rc = 0 00000004:00010000:2.0:1788746811.850944:0:22624:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 0000000050378dda reply state 00000000577c2ed9 transno 12884901909 ns: mdt-lustre-MDT0000_UUID lock: ffff8a4483ed6a00/0xfac36e8915414d11 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746811.850957:0:22624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a4483ed6a00/0xfac36e8915414d11 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746811.850965:0:22624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8a45833f9600) 00010000:00010000:2.0:1788746811.850968:0:22624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1788746811.850972:0:22624:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788746811.851078:0:22624:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4484488e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bbae771a-9fe8-425e-89d3-e0a0b7b26f24+33:18732:x1875636305169920:12345-192.168.204.39@tcp:36:lhsmtool_posix.0 Request processed in 517us (2626us total) trans 12884901909 rc 0/0 00000100:00100000:2.0:1788746811.851086:0:22624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 56 00000100:00100000:1.0:1788746811.859790:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788746811.860316:0:22623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636305170048 00000100:00100000:0.0:1788746811.860327:0:22623:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636305170048 00000100:00100000:0.0:1788746811.860380:0:22623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 57 00000100:00100000:0.0:1788746811.860391:0:22623:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a448379f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bbae771a-9fe8-425e-89d3-e0a0b7b26f24+33:18732:x1875636305170048:12345-192.168.204.39@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788746811.860415:0:22623:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788746811.860436:0:22623:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a4581527200/0xfac36e8915414d18 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4d2179c47f07899c expref: -99 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746811.860513:0:22623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a4581527200/0xfac36e8915414d18 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.39@tcp remote: 0x4d2179c47f07899c expref: 34 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746811.860529:0:22623:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a4581527200/0xfac36e8915414d18 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.39@tcp remote: 0x4d2179c47f07899c expref: 34 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746811.860546:0:22623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8a45833f9600) 00010000:00010000:0.0:1788746811.860550:0:22623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788746811.860554:0:22623:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a4581527200, rc 0) 00000100:00100000:0.0:1788746811.860618:0:22623:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a448379f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bbae771a-9fe8-425e-89d3-e0a0b7b26f24+34:18732:x1875636305170048:12345-192.168.204.39@tcp:101:lhsmtool_posix.0 Request processed in 228us (837us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746811.860625:0:22623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 57 00000100:00100000:0.0:1788746811.873567:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788746811.873730:0:24129:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636305170176 00000100:00100000:1.0:1788746811.873741:0:24129:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636305170176 00000100:00100000:1.0:1788746811.873808:0:24129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 21 00000100:00100000:1.0:1788746811.873818:0:24129:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a45bfe99180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bbae771a-9fe8-425e-89d3-e0a0b7b26f24+5:2399:x1875636305170176:12345-192.168.204.39@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1788746811.874079:0:24129:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a45bfe99180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bbae771a-9fe8-425e-89d3-e0a0b7b26f24+6:2399:x1875636305170176:12345-192.168.204.39@tcp:2:lhsmtool_posix.0 Request processed in 261us (521us total) trans 12884901891 rc 0/0 00000100:00100000:1.0:1788746811.874087:0:24129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 21 00000100:00100000:3.0:1788746811.878468:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788746811.879001:0:22626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636305170432 00000100:00100000:2.0:1788746811.879011:0:22626:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636305170432 00000100:00100000:2.0:1788746811.879074:0:22626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 9 00000100:00100000:2.0:1788746811.879085:0:22626:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a448448bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bbae771a-9fe8-425e-89d3-e0a0b7b26f24+34:18732:x1875636305170432:12345-192.168.204.39@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788746811.879974:0:22626:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a448448bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bbae771a-9fe8-425e-89d3-e0a0b7b26f24+35:18732:x1875636305170432:12345-192.168.204.39@tcp:35:lhsmtool_posix.0 Request processed in 885us (1512us total) trans 12884901910 rc 0/0 00000100:00100000:2.0:1788746811.879984:0:22626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 9 00000100:00100000:3.0:1788746811.916120:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788746811.916231:0:22625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636305170688 00000100:00100000:2.0:1788746811.916241:0:22625:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636305170688 00000100:00100000:2.0:1788746811.916334:0:22625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 58 00000100:00100000:2.0:1788746811.916344:0:22625:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4483dff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbae771a-9fe8-425e-89d3-e0a0b7b26f24+35:18732:x1875636305170688:12345-192.168.204.39@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788746811.916454:0:22625:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4483dff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbae771a-9fe8-425e-89d3-e0a0b7b26f24+35:18732:x1875636305170688:12345-192.168.204.39@tcp:57:lhsmtool_posix.0 Request processed in 111us (345us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746811.916463:0:22625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 58 00000100:00100000:1.0:1788746811.925934:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788746811.926041:0:25514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636305170816 00000100:00100000:2.0:1788746811.926066:0:25514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636305170816 00000100:00100000:2.0:1788746811.926133:0:25514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 59 00000100:00100000:2.0:1788746811.926146:0:25514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a448379d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bbae771a-9fe8-425e-89d3-e0a0b7b26f24+35:18732:x1875636305170816:12345-192.168.204.39@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788746811.926167:0:25514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788746811.926188:0:25514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a4483ed6800/0xfac36e8915414d1f lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4d2179c47f0789a3 expref: -99 pid: 25514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746811.926617:0:25514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a4483ed7c00/0xfac36e8915414d26 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 25514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746811.926633:0:25514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a4483ed7c00/0xfac36e8915414d26 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 25514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746811.926644:0:25514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a4483ed7c00/0xfac36e8915414d26 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 25514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788746811.926693:0:25514:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788746811.926714:0:25514:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a4483ed7c00/0xfac36e8915414d26 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 25514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746811.926741:0:25514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a4483ed6800/0xfac36e8915414d1f lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.39@tcp remote: 0x4d2179c47f0789a3 expref: 37 pid: 25514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746811.926760:0:25514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a4483ed7c00/0xfac36e8915414d26 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.39@tcp remote: 0x4d2179c47f0789a3 expref: 36 pid: 25514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746811.926768:0:25514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8a45833f9600) 00010000:00010000:2.0:1788746811.926771:0:25514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788746811.926774:0:25514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a4483ed7c00, rc 0) 00000100:00100000:2.0:1788746811.926900:0:25514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a448379d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bbae771a-9fe8-425e-89d3-e0a0b7b26f24+36:18732:x1875636305170816:12345-192.168.204.39@tcp:101:lhsmtool_posix.0 Request processed in 756us (973us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746811.926917:0:25514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 59 00000100:00100000:3.0:1788746811.941373:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788746811.941774:0:25016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636305170944 00000100:00100000:0.0:1788746811.941784:0:25016:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636305170944 00000100:00100000:0.0:1788746811.941859:0:25016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 22 00000100:00100000:0.0:1788746811.941870:0:25016:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4483c65180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bbae771a-9fe8-425e-89d3-e0a0b7b26f24+6:2400:x1875636305170944:12345-192.168.204.39@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788746811.941903:0:25016:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788746811.941925:0:25016:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004fad7ea7/0xfac36e8915414d2d lrc: 2/0,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4d2179c47f0789aa expref: -99 pid: 25016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788746811.941952:0:25016:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x42:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9e1c3b, blocks: 0x0 00010000:00010000:0.0:1788746811.941974:0:25016:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=741s v=(0 0) 00010000:00010000:0.0:1788746811.941979:0:25016:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788746811.941988:0:25016:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004fad7ea7/0xfac36e8915414d2d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.39@tcp remote: 0x4d2179c47f0789aa expref: 7 pid: 25016 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746811.942007:0:25016:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004fad7ea7/0xfac36e8915414d2d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.39@tcp remote: 0x4d2179c47f0789aa expref: 7 pid: 25016 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746811.942020:0:25016:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a4581526400, rc 0) 00000100:00100000:0.0:1788746811.942087:0:25016:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4483c65180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bbae771a-9fe8-425e-89d3-e0a0b7b26f24+7:2400:x1875636305170944:12345-192.168.204.39@tcp:101:lhsmtool_posix.0 Request processed in 218us (724us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746811.942094:0:25016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 22 00000100:00100000:3.0:1788746811.947875:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788746811.947977:0:25672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636305171200 00000100:00100000:1.0:1788746811.947987:0:25672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636305171200 00000100:00100000:1.0:1788746811.948052:0:25672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 60 00000100:00100000:1.0:1788746811.948064:0:25672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4483c65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bbae771a-9fe8-425e-89d3-e0a0b7b26f24+36:18732:x1875636305171200:12345-192.168.204.39@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788746811.948179:0:25672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4483c65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bbae771a-9fe8-425e-89d3-e0a0b7b26f24+36:18732:x1875636305171200:12345-192.168.204.39@tcp:57:lhsmtool_posix.0 Request processed in 118us (314us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746811.948187:0:25672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 60 00000100:00100000:1.0:1788746811.955998:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788746811.956130:0:22625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636305171328 00000100:00100000:2.0:1788746811.956140:0:22625:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636305171328 00000100:00100000:2.0:1788746811.956395:0:22625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 61 00000100:00100000:2.0:1788746811.956408:0:22625:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a448379dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbae771a-9fe8-425e-89d3-e0a0b7b26f24+36:18732:x1875636305171328:12345-192.168.204.39@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1788746811.958133:0:22603:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901910 is committed 00000004:00080000:3.0:1788746811.958149:0:22603:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000001:00080000:3.0:1788746811.958218:0:22603:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901895 is committed 00010000:00010000:1.0:1788746811.958359:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a4580031000/0xfac36e8915414bb3 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746811.958372:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a4580031000/0xfac36e8915414bb3 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746811.958394:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a4580031000/0xfac36e8915414bb3 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746811.958401:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a4580031000 already unused, calling callback (ffffffffc17914f0) 00010000:00010000:1.0:1788746811.958406:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a4580031000/0xfac36e8915414bb3 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746811.958415:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a4580031000/0xfac36e8915414bb3 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746811.958433:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8a4483586100) 00010000:00010000:1.0:1788746811.958437:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:1.0:1788746811.958443:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a4580031000/0xfac36e8915414bb3 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746811.958449:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a4580031000/0xfac36e8915414bb3 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22624 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788746811.958629:0:22625:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a448379dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbae771a-9fe8-425e-89d3-e0a0b7b26f24+19:18732:x1875636305171328:12345-192.168.204.39@tcp:44:lhsmtool_posix.0 Request processed in 2220us (2636us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746811.958640:0:22625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 61 00000100:00100000:1.0:1788746811.958954:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:2.0:1788746811.959619:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a4581689600/0xfac36e8915414b2e lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746811.959631:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a4581689600/0xfac36e8915414b2e lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746811.959637:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a4581689600/0xfac36e8915414b2e lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746811.959643:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a4581689600 already unused, calling callback (ffffffffc17914f0) 00010000:00010000:2.0:1788746811.959646:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a4581689600/0xfac36e8915414b2e lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746811.959653:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a4581689600/0xfac36e8915414b2e lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746811.959666:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff8a4483586000) 00010000:00010000:2.0:1788746811.959669:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788746811.959673:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a4581689600/0xfac36e8915414b2e lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746811.959679:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a4581689600/0xfac36e8915414b2e lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746811.959701:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a4581688c00/0xfac36e8915414b35 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746811.959721:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a4581688c00/0xfac36e8915414b35 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746811.959726:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a4581688c00/0xfac36e8915414b35 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746811.959731:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a4581688c00 already unused, calling callback (ffffffffc17914f0) 00010000:00010000:2.0:1788746811.959734:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a4581688c00/0xfac36e8915414b35 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746811.959740:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a4581688c00/0xfac36e8915414b35 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746811.959748:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8a4483586100) 00010000:00010000:2.0:1788746811.959750:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788746811.959753:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a4581688c00/0xfac36e8915414b35 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746811.959759:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a4581688c00/0xfac36e8915414b35 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746811.959774:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a4483ed6c00/0xfac36e8915414c15 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746811.959779:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a4483ed6c00/0xfac36e8915414c15 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746811.959785:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a4483ed6c00/0xfac36e8915414c15 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746811.959790:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a4483ed6c00 already unused, calling callback (ffffffffc17914f0) 00010000:00010000:2.0:1788746811.959799:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a4483ed6c00/0xfac36e8915414c15 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746811.959805:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a4483ed6c00/0xfac36e8915414c15 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746811.959813:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff8a4483586400) 00010000:00010000:2.0:1788746811.959816:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788746811.959819:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a4483ed6c00/0xfac36e8915414c15 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746811.959824:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a4483ed6c00/0xfac36e8915414c15 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746811.959850:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a4483ed6200/0xfac36e8915414c9a lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 25514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746811.959856:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a4483ed6200/0xfac36e8915414c9a lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 25514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746811.959862:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a4483ed6200/0xfac36e8915414c9a lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 25514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746811.959867:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a4483ed6200 already unused, calling callback (ffffffffc17914f0) 00010000:00010000:2.0:1788746811.959869:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a4483ed6200/0xfac36e8915414c9a lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 25514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746811.959875:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a4483ed6200/0xfac36e8915414c9a lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 25514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746811.959884:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8a4483586f00) 00010000:00010000:2.0:1788746811.959886:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788746811.959899:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a4483ed6200/0xfac36e8915414c9a lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 25514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746811.959904:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a4483ed6200/0xfac36e8915414c9a lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 25514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746811.959916:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a4483ed6a00/0xfac36e8915414d11 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746811.959922:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a4483ed6a00/0xfac36e8915414d11 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746811.959929:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a4483ed6a00/0xfac36e8915414d11 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746811.959934:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a4483ed6a00 already unused, calling callback (ffffffffc17914f0) 00010000:00010000:2.0:1788746811.959937:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a4483ed6a00/0xfac36e8915414d11 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746811.959943:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a4483ed6a00/0xfac36e8915414d11 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746811.959950:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8a45833f9600) 00010000:00010000:2.0:1788746811.959952:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788746811.959955:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a4483ed6a00/0xfac36e8915414d11 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746811.960023:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a4483ed6a00/0xfac36e8915414d11 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22624 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788746811.960169:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a45bfe98e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875636324152064:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1788746811.960526:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746811.960785:0:24130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324152064 00000100:00100000:3.0:1788746811.960793:0:24130:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324152064 00000100:00100000:3.0:1788746811.960901:0:24130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788746811.960912:0:24130:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a45b6534450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875636324152064:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1788746811.961048:0:24130:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1788746811.961052:0:24130:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1788746811.961054:0:24130:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1788746811.961056:0:24130:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb ctime from disk: 1788746811 -> 1788746811 00002000:00010000:3.0:1788746811.961059:0:24130:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1788746811.961120:0:24130:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a45b6534450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3644:x1875636324152064:12345-0@lo:2:osp-syn-0-0.0 Request processed in 211us (594us total) trans 12884901892 rc 0/0 00000100:00100000:3.0:1788746811.961128:0:24130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000004:00080000:2.0:1788746811.961859:0:3644:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a45bfe98e00/2, rc 0, transno 12884901892 00000100:00100000:2.0:1788746811.961869:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a45bfe98e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875636324152064:0@lo:2:osp-syn-0-0.0 00000100:00080000:0.0:1788746811.965150:0:22619:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788746811.965423:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788746811.965591:0:24665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636305171456 00000100:00100000:0.0:1788746811.965600:0:24665:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636305171456 00000100:00100000:0.0:1788746811.965659:0:24665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 24 00000100:00100000:0.0:1788746811.965669:0:24665:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4481b64380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bbae771a-9fe8-425e-89d3-e0a0b7b26f24+7:2399:x1875636305171456:12345-192.168.204.39@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1788746811.965775:0:24665:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4481b64380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bbae771a-9fe8-425e-89d3-e0a0b7b26f24+7:2399:x1875636305171456:12345-192.168.204.39@tcp:16:lhsmtool_posix.0 Request processed in 107us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746811.965782:0:24665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 24 00000100:00100000:3.0:1788746811.969570:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788746811.971726:0:25514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636305171712 00000100:00100000:2.0:1788746811.971743:0:25514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636305171712 00000100:00100000:2.0:1788746811.971889:0:25514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 62 00000100:00100000:2.0:1788746811.971900:0:25514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4483c65180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bbae771a-9fe8-425e-89d3-e0a0b7b26f24+15:18732:x1875636305171712:12345-192.168.204.39@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788746811.971964:0:25514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788746811.972009:0:25514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a4483ed7c00/0xfac36e8915414d26 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.39@tcp remote: 0x4d2179c47f0789a3 expref: 15 pid: 25514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746811.972031:0:25514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8a45833f9600) 00010000:00010000:2.0:1788746811.972036:0:25514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788746811.972066:0:25514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a4483ed6a00/0xfac36e8915414d34 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 25514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746811.972079:0:25514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a4483ed6a00/0xfac36e8915414d34 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746811.972089:0:25514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a4483ed6a00/0xfac36e8915414d34 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788746811.972230:0:25514:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 0000000066b663cf reply state 00000000281ddc1a transno 12884901911 ns: mdt-lustre-MDT0000_UUID lock: ffff8a4483ed6a00/0xfac36e8915414d34 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746811.972242:0:25514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a4483ed6a00/0xfac36e8915414d34 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746811.972247:0:25514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8a45833f9600) 00010000:00010000:2.0:1788746811.972250:0:25514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788746811.972252:0:25514:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788746811.972399:0:25514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4483c65180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bbae771a-9fe8-425e-89d3-e0a0b7b26f24+16:18732:x1875636305171712:12345-192.168.204.39@tcp:36:lhsmtool_posix.0 Request processed in 500us (2837us total) trans 12884901911 rc 0/0 00000100:00100000:2.0:1788746811.972433:0:25514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 62 00000100:00100000:2.0:1788746811.975405:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788746811.976316:0:24131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636305171840 00000100:00100000:3.0:1788746811.976328:0:24131:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636305171840 00000100:00100000:3.0:1788746811.976399:0:24131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 25 00000100:00100000:3.0:1788746811.976409:0:24131:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4481b67480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bbae771a-9fe8-425e-89d3-e0a0b7b26f24+7:18732:x1875636305171840:12345-192.168.204.39@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788746811.976496:0:24131:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788746811.976515:0:24131:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000785dbb72/0xfac36e8915414d3b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4d2179c47f0789b1 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746811.976547:0:24131:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004fad7ea7/0xfac36e8915414d2d lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.39@tcp remote: 0x4d2179c47f0789aa expref: 8 pid: 25016 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746811.976556:0:24131:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788746811.976560:0:24131:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788746811.976565:0:24131:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000785dbb72/0xfac36e8915414d3b lrc: 4/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.39@tcp remote: 0x4d2179c47f0789b1 expref: 8 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746811.976597:0:24131:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000004fad7ea7/0xfac36e8915414d2d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.39@tcp remote: 0x4d2179c47f0789aa expref: 8 pid: 25016 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746811.976611:0:24131:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000004fad7ea7/0xfac36e8915414d2d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.39@tcp remote: 0x4d2179c47f0789aa expref: 8 pid: 25016 timeout: 841 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788746811.976625:0:24131:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a4483c65f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:24131:1875636324152192:192.168.204.39@tcp:104: 00000100:00100000:3.0:1788746811.976790:0:24131:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a458736e0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788746811.980973:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788746811.981202:0:22610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636305171968 00000100:00100000:1.0:1788746811.981211:0:22610:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636305171968 00010000:00010000:1.0:1788746811.981252:0:22610:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000004fad7ea7/0xfac36e8915414d2d lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.39@tcp remote: 0x4d2179c47f0789aa expref: 9 pid: 25016 timeout: 841 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788746811.981359:0:22610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 19 00000100:00100000:1.0:1788746811.981370:0:22610:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a45bfe9b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bbae771a-9fe8-425e-89d3-e0a0b7b26f24+9:2399:x1875636305171968:12345-192.168.204.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788746811.981386:0:22610:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788746811.981410:0:22610:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000004fad7ea7/0xfac36e8915414d2d lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.39@tcp remote: 0x4d2179c47f0789aa expref: 9 pid: 25016 timeout: 841 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788746811.981500:0:24131:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a4483c65f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:24131:1875636324152192:192.168.204.39@tcp:104: 00010000:00010000:3.0:1788746811.981530:0:24131:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000785dbb72/0xfac36e8915414d3b lrc: 3/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.39@tcp remote: 0x4d2179c47f0789b1 expref: 9 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746811.981545:0:24131:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a4587526e00, rc 0) 00000100:00100000:3.0:1788746811.981596:0:24131:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4481b67480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bbae771a-9fe8-425e-89d3-e0a0b7b26f24+9:18732:x1875636305171840:12345-192.168.204.39@tcp:101:lhsmtool_posix.0 Request processed in 5188us (6200us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746811.981604:0:24131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 25 00010000:00010000:1.0:1788746811.982083:0:22610:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000004fad7ea7/0xfac36e8915414d2d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.39@tcp remote: 0x4d2179c47f0789aa expref: 8 pid: 25016 timeout: 841 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746811.982105:0:22610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004fad7ea7/0xfac36e8915414d2d lrc: 0/0,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.39@tcp remote: 0x4d2179c47f0789aa expref: 8 pid: 25016 timeout: 841 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746811.982120:0:22610:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788746811.982125:0:22610:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788746811.982131:0:22610:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000785dbb72/0xfac36e8915414d3b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.39@tcp remote: 0x4d2179c47f0789b1 expref: 7 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746811.982142:0:22610:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000785dbb72/0xfac36e8915414d3b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.39@tcp remote: 0x4d2179c47f0789b1 expref: 7 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746811.982177:0:22610:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000785dbb72/0xfac36e8915414d3b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.39@tcp remote: 0x4d2179c47f0789b1 expref: 7 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788746811.982207:0:22610:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a448379d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:22610:1875636324152320:192.168.204.39@tcp:105: 00000100:00100000:1.0:1788746811.982277:0:22610:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a45b4c0bb40 going to sleep for 11 seconds 00000100:00100000:1.0:1788746811.985537:0:22610:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a448379d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:22610:1875636324152320:192.168.204.39@tcp:105: 00010000:00010000:1.0:1788746811.985563:0:22610:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788746811.985627:0:22610:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a45bfe9b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bbae771a-9fe8-425e-89d3-e0a0b7b26f24+7:2399:x1875636305171968:12345-192.168.204.39@tcp:103:ldlm_bl.0 Request processed in 4258us (4670us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746811.985639:0:22610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 19 00000100:00100000:3.0:1788746811.988319:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788746811.988439:0:24129:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636305172096 00000100:00100000:0.0:1788746811.988450:0:24129:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636305172096 00000100:00100000:0.0:1788746811.988842:0:24665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 26 00000100:00100000:0.0:1788746811.988856:0:24665:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4483c65f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bbae771a-9fe8-425e-89d3-e0a0b7b26f24+7:2399:x1875636305172096:12345-192.168.204.39@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1788746811.989276:0:24665:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1788746811.989280:0:24665:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb mtime from disk: 0 -> 1788746810 00002000:00010000:1.0:1788746811.989282:0:24665:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb atime from disk: 0 -> 1788746809 00002000:00010000:1.0:1788746811.989350:0:24665:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb ctime from disk: 1788746811 -> 1788746810 00002000:00010000:1.0:1788746811.989353:0:24665:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1788746811.989454:0:24665:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4483c65f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bbae771a-9fe8-425e-89d3-e0a0b7b26f24+8:2399:x1875636305172096:12345-192.168.204.39@tcp:2:lhsmtool_posix.0 Request processed in 600us (1165us total) trans 12884901893 rc 0/0 00000100:00100000:1.0:1788746811.989464:0:24665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 26 00000100:00100000:0.0:1788746811.993439:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788746811.993623:0:25016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636305172224 00000100:00100000:1.0:1788746811.993643:0:25016:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636305172224 00000100:00100000:1.0:1788746811.993694:0:25016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 27 00000100:00100000:1.0:1788746811.993703:0:25016:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a45bfe9a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bbae771a-9fe8-425e-89d3-e0a0b7b26f24+8:2401:x1875636305172224:12345-192.168.204.39@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1788746811.993874:0:25016:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000dac8e4a9/0xfac36e8915414d42 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746811.993894:0:25016:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000785dbb72/0xfac36e8915414d3b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.39@tcp remote: 0x4d2179c47f0789b1 expref: 8 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746811.993934:0:25016:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788746811.993939:0:25016:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788746811.993943:0:25016:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dac8e4a9/0xfac36e8915414d42 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746811.993989:0:25016:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000785dbb72/0xfac36e8915414d3b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.204.39@tcp remote: 0x4d2179c47f0789b1 expref: 8 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746811.994005:0:25016:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000785dbb72/0xfac36e8915414d3b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.204.39@tcp remote: 0x4d2179c47f0789b1 expref: 8 pid: 24131 timeout: 841 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788746811.994022:0:25016:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a448379d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:25016:1875636324152448:192.168.204.39@tcp:104: 00000100:00100000:1.0:1788746811.994262:0:25016:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a45b4c0bb40 going to sleep for 11 seconds 00000100:00100000:1.0:1788746811.999621:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788746811.999853:0:25653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636305172352 00000100:00100000:2.0:1788746811.999862:0:25653:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636305172352 00010000:00010000:2.0:1788746811.999905:0:25653:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000785dbb72/0xfac36e8915414d3b lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.39@tcp remote: 0x4d2179c47f0789b1 expref: 9 pid: 24131 timeout: 841 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788746811.999950:0:25653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 20 00000100:00100000:2.0:1788746811.999970:0:25653:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a448379c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bbae771a-9fe8-425e-89d3-e0a0b7b26f24+9:2400:x1875636305172352:12345-192.168.204.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788746811.999986:0:25653:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788746812.000012:0:25653:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000785dbb72/0xfac36e8915414d3b lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.39@tcp remote: 0x4d2179c47f0789b1 expref: 9 pid: 24131 timeout: 841 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746812.000028:0:25653:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000785dbb72/0xfac36e8915414d3b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.204.39@tcp remote: 0x4d2179c47f0789b1 expref: 9 pid: 24131 timeout: 841 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746812.000056:0:25653:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788746812.000060:0:25653:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788746812.000066:0:25653:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000dac8e4a9/0xfac36e8915414d42 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 25016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746812.000076:0:25653:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dac8e4a9/0xfac36e8915414d42 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 25016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746812.000097:0:25653:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788746812.000186:0:25653:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a448379c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bbae771a-9fe8-425e-89d3-e0a0b7b26f24+9:2400:x1875636305172352:12345-192.168.204.39@tcp:103:ldlm_bl.0 Request processed in 218us (575us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746812.000193:0:25653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 20 00010000:00010000:0.0:1788746812.002245:0:25016:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000785dbb72/0xfac36e8915414d3b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.204.39@tcp remote: 0x4d2179c47f0789b1 expref: 8 pid: 24131 timeout: 841 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788746812.002271:0:25016:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a448379d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:25016:1875636324152448:192.168.204.39@tcp:104: 00010000:00010000:0.0:1788746812.002421:0:25016:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000dac8e4a9/0xfac36e8915414d42 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746812.002830:0:25016:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000dac8e4a9/0xfac36e8915414d42 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746812.002852:0:25016:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dac8e4a9/0xfac36e8915414d42 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746812.002882:0:25016:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000dac8e4a9/0xfac36e8915414d42 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746812.002891:0:25016:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dac8e4a9/0xfac36e8915414d42 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 25016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746812.002918:0:25016:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dac8e4a9/0xfac36e8915414d42 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746812.002925:0:25016:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a45b7f95a00 already unused, calling callback (ffffffffc0b5a8d0) 00010000:00010000:1.0:1788746812.002929:0:25016:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dac8e4a9/0xfac36e8915414d42 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746812.002938:0:25016:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dac8e4a9/0xfac36e8915414d42 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 25016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746812.003046:0:25016:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dac8e4a9/0xfac36e8915414d42 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746812.003055:0:25016:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dac8e4a9/0xfac36e8915414d42 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788746812.003188:0:25016:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a45bfe9a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bbae771a-9fe8-425e-89d3-e0a0b7b26f24+7:2401:x1875636305172224:12345-192.168.204.39@tcp:1:lhsmtool_posix.0 Request processed in 9482us (9756us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746812.003198:0:25016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 27 00000100:00100000:1.0:1788746812.006606:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788746812.006847:0:22624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636305172608 00000100:00100000:0.0:1788746812.006857:0:22624:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636305172608 00000100:00100000:0.0:1788746812.006973:0:22624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 63 00000100:00100000:0.0:1788746812.006984:0:22624:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a448379ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bbae771a-9fe8-425e-89d3-e0a0b7b26f24+16:18732:x1875636305172608:12345-192.168.204.39@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1788746812.007068:0:22624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a4581526200/0xfac36e8915414d49 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746812.007086:0:22624:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a4581526800/0xfac36e8915414c93 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.39@tcp remote: 0x4d2179c47f078972 expref: 16 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746812.007094:0:22624:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a4581526200/0xfac36e8915414d49 lrc: 4/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746812.007129:0:22624:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a4581526800/0xfac36e8915414c93 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.39@tcp remote: 0x4d2179c47f078972 expref: 16 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746812.007160:0:22624:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a4581526800/0xfac36e8915414c93 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.39@tcp remote: 0x4d2179c47f078972 expref: 16 pid: 22624 timeout: 841 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788746812.007174:0:22624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a45bfe98700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22624:1875636324152576:192.168.204.39@tcp:104: 00000100:00100000:0.0:1788746812.007321:0:22624:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a45875f46c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788746812.013013:0:22624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a45bfe98700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22624:1875636324152576:192.168.204.39@tcp:104: 00010000:00010000:0.0:1788746812.013070:0:22624:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a4581526200/0xfac36e8915414d49 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22624 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788746812.014536:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788746812.014629:0:22609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636305172736 00000100:00100000:2.0:1788746812.014639:0:22609:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636305172736 00010000:00010000:2.0:1788746812.014677:0:22609:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a4581526800/0xfac36e8915414c93 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.39@tcp remote: 0x4d2179c47f078972 expref: 17 pid: 22624 timeout: 841 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788746812.014726:0:22609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 21 00000100:00100000:2.0:1788746812.014735:0:22609:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a448379e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bbae771a-9fe8-425e-89d3-e0a0b7b26f24+17:2399:x1875636305172736:12345-192.168.204.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788746812.014749:0:22609:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788746812.014766:0:22609:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a4581526800/0xfac36e8915414c93 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.39@tcp remote: 0x4d2179c47f078972 expref: 17 pid: 22624 timeout: 841 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746812.014779:0:22609:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a4581526800/0xfac36e8915414c93 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.39@tcp remote: 0x4d2179c47f078972 expref: 17 pid: 22624 timeout: 841 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746812.014803:0:22609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a4581526800/0xfac36e8915414c93 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.39@tcp remote: 0x4d2179c47f078972 expref: 17 pid: 22624 timeout: 841 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746812.014820:0:22609:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8a4483586f00) 00010000:00010000:2.0:1788746812.014826:0:22609:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8a4483ed6000/0xfac36e8915414caf lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.39@tcp remote: 0x4d2179c47f078980 expref: 16 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746812.014847:0:22609:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8a4581526200/0xfac36e8915414d49 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746812.014855:0:22609:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a4581526200/0xfac36e8915414d49 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 22624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746812.014876:0:22609:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a4581526200/0xfac36e8915414d49 lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 22624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746812.014897:0:22609:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788746812.014959:0:22609:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a448379e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bbae771a-9fe8-425e-89d3-e0a0b7b26f24+16:2399:x1875636305172736:12345-192.168.204.39@tcp:103:ldlm_bl.0 Request processed in 224us (430us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746812.014967:0:22609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 21 00010000:00010000:0.0:1788746812.015269:0:22624:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a4581526200/0xfac36e8915414d49 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746812.015277:0:22624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a4581526200/0xfac36e8915414d49 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746812.015516:0:22624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a4581526400/0xfac36e8915414d50 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746812.015529:0:22624:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a4581527200/0xfac36e8915414d18 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.39@tcp remote: 0x4d2179c47f07899c expref: 16 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746812.015537:0:22624:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a4581526400/0xfac36e8915414d50 lrc: 4/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746812.015566:0:22624:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a4581527200/0xfac36e8915414d18 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.39@tcp remote: 0x4d2179c47f07899c expref: 16 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746812.015579:0:22624:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a4581527200/0xfac36e8915414d18 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.39@tcp remote: 0x4d2179c47f07899c expref: 16 pid: 22623 timeout: 841 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788746812.015599:0:22624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a45bfe98700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22624:1875636324152704:192.168.204.39@tcp:104: 00000100:00100000:0.0:1788746812.015663:0:22624:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a45875f4c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788746812.021279:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788746812.021397:0:25653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636305172864 00000100:00100000:2.0:1788746812.021405:0:25653:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636305172864 00010000:00010000:2.0:1788746812.021448:0:25653:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a4581527200/0xfac36e8915414d18 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.39@tcp remote: 0x4d2179c47f07899c expref: 17 pid: 22623 timeout: 841 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788746812.021491:0:22624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a45bfe98700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22624:1875636324152704:192.168.204.39@tcp:104: 00010000:00010000:0.0:1788746812.021516:0:22624:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a4581526400/0xfac36e8915414d50 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22624 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788746812.021582:0:25653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 22 00000100:00100000:2.0:1788746812.021594:0:25653:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4482713480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bbae771a-9fe8-425e-89d3-e0a0b7b26f24+17:2400:x1875636305172864:12345-192.168.204.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788746812.021610:0:25653:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788746812.021616:0:25653:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a4581527200/0xfac36e8915414d18 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.39@tcp remote: 0x4d2179c47f07899c expref: 17 pid: 22623 timeout: 841 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746812.021628:0:25653:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a4581527200/0xfac36e8915414d18 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.39@tcp remote: 0x4d2179c47f07899c expref: 17 pid: 22623 timeout: 841 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746812.021650:0:25653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a4581527200/0xfac36e8915414d18 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.39@tcp remote: 0x4d2179c47f07899c expref: 17 pid: 22623 timeout: 841 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746812.021666:0:25653:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8a45833f9600) 00010000:00010000:2.0:1788746812.021671:0:25653:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8a4581526400/0xfac36e8915414d50 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746812.021704:0:25653:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a4581526400/0xfac36e8915414d50 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 22624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746812.021712:0:25653:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a4581526400/0xfac36e8915414d50 lrc: 4/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 22624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746812.021754:0:25653:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788746812.021816:0:25653:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4482713480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bbae771a-9fe8-425e-89d3-e0a0b7b26f24+16:2400:x1875636305172864:12345-192.168.204.39@tcp:103:ldlm_bl.0 Request processed in 224us (547us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746812.021824:0:25653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 22 00010000:00010000:0.0:1788746812.023272:0:22624:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a4581526400/0xfac36e8915414d50 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746812.023419:0:22624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a4581526400/0xfac36e8915414d50 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22624 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788746812.023595:0:22624:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901912 00000001:00080000:0.0:1788746812.023708:0:22624:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901913 00000001:00080000:0.0:1788746812.023743:0:22624:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901914 00000100:00100000:0.0:1788746812.023872:0:22624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a45bfe98700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:22624:1875636324152832:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1788746812.023931:0:22624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746812.024055:0:23652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324152832 00000100:00100000:1.0:1788746812.024063:0:23652:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324152832 00000100:00100000:1.0:1788746812.024157:0:23652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788746812.024165:0:23652:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a45bfe98380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:22624:x1875636324152832:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1788746812.024249:0:23652:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a45bfe98380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:22624:x1875636324152832:12345-0@lo:1000:mdt00_001.0 Request processed in 85us (318us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746812.024256:0:23652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788746812.024330:0:22624:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a45a91e0540 going to sleep for 11 seconds 00000100:00100000:0.0:1788746812.024354:0:22624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a45bfe98700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:22624:1875636324152832:0@lo:1000:mdt00_001.0 00000001:00080000:0.0:1788746812.024523:0:22624:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901915 00000100:00100000:0.0:1788746812.024565:0:22624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a45bfe98700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:22624:1875636324152960:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1788746812.024593:0:22624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746812.025024:0:22624:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a45873d39c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788746812.025151:0:22629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324152960 00000100:00100000:2.0:1788746812.025158:0:22629:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324152960 00000100:00100000:2.0:1788746812.025189:0:22629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788746812.025196:0:22629:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a45bfe99180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22624:x1875636324152960:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1788746812.025354:0:22629:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a45bfe99180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:22624:x1875636324152960:12345-0@lo:1000:mdt00_001.0 Request processed in 158us (760us total) trans 12884901894 rc 0/0 00000100:00100000:2.0:1788746812.025361:0:22629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788746812.025527:0:22624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a45bfe98700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:22624:1875636324152960:0@lo:1000:mdt00_001.0 00010000:00010000:0.0:1788746812.025564:0:22624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a4581526400/0xfac36e8915414d50 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746812.025583:0:22624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a4581526400/0xfac36e8915414d50 lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746812.025590:0:22624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a4581526400/0xfac36e8915414d50 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746812.025596:0:22624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a4581526400 already unused, calling callback (ffffffffc17914f0) 00010000:00010000:0.0:1788746812.025600:0:22624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a4581526400/0xfac36e8915414d50 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746812.025607:0:22624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a4581526400/0xfac36e8915414d50 lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746812.025622:0:22624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8a45833f9600) 00010000:00010000:0.0:1788746812.025625:0:22624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788746812.025630:0:22624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a4581526400/0xfac36e8915414d50 lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746812.025636:0:22624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a4581526400/0xfac36e8915414d50 lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746812.025667:0:22624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a45c216c000/0xfac36e8915414ca8 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 22625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746812.025674:0:22624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a45c216c000/0xfac36e8915414ca8 lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 22625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746812.025681:0:22624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a45c216c000/0xfac36e8915414ca8 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 22625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746812.025685:0:22624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a45c216c000 already unused, calling callback (ffffffffc17914f0) 00010000:00010000:0.0:1788746812.025695:0:22624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a45c216c000/0xfac36e8915414ca8 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 22625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746812.025701:0:22624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a45c216c000/0xfac36e8915414ca8 lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 22625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746812.025710:0:22624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8a4483586f00) 00010000:00010000:0.0:1788746812.025712:0:22624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788746812.025719:0:22624:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8a4483ed6000/0xfac36e8915414caf lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.39@tcp remote: 0x4d2179c47f078980 expref: 19 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746812.025730:0:22624:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a4483ed6000/0xfac36e8915414caf lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.39@tcp remote: 0x4d2179c47f078980 expref: 19 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746812.025739:0:22624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a4483ed6000/0xfac36e8915414caf lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.39@tcp remote: 0x4d2179c47f078980 expref: 19 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746812.025796:0:22624:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a4483ed6000/0xfac36e8915414caf lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.39@tcp remote: 0x4d2179c47f078980 expref: 19 pid: 22624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788746812.025809:0:22624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a4590cb8000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22624:1875636324153088:192.168.204.39@tcp:105: 00000100:00100000:0.0:1788746812.025886:0:22624:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a45873d39c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788746812.030520:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788746812.030645:0:22627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636305172992 00000100:00100000:1.0:1788746812.030654:0:22627:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636305172992 00000100:00100000:1.0:1788746812.030708:0:22627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 10 00000100:00100000:1.0:1788746812.030719:0:22627:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a45a80d1c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bbae771a-9fe8-425e-89d3-e0a0b7b26f24+20:18731:x1875636305172992:12345-192.168.204.39@tcp:49:dd.0 00000100:00100000:1.0:1788746812.030868:0:22627:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a45a80d1c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bbae771a-9fe8-425e-89d3-e0a0b7b26f24+20:18731:x1875636305172992:12345-192.168.204.39@tcp:49:dd.0 Request processed in 150us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746812.030876:0:22627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 10 00000100:00100000:0.0:1788746812.032779:0:22624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a4590cb8000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22624:1875636324153088:192.168.204.39@tcp:105: 00010000:00010000:0.0:1788746812.032810:0:22624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a45c216c000/0xfac36e8915414ca8 lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 22625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746812.032821:0:22624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a45c216c000/0xfac36e8915414ca8 lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 22625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746812.032992:0:22624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a45b7f95600/0xfac36e8915414d57 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746812.033007:0:22624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a45b7f95600/0xfac36e8915414d57 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746812.033019:0:22624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a45b7f95600/0xfac36e8915414d57 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746812.033030:0:22624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a45b7f95600/0xfac36e8915414d57 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746812.033037:0:22624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a45b7f95600/0xfac36e8915414d57 lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746812.033050:0:22624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a45b7f95600/0xfac36e8915414d57 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746812.033056:0:22624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a45b7f95600 already unused, calling callback (ffffffffc17914f0) 00010000:00010000:1.0:1788746812.033060:0:22624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a45b7f95600/0xfac36e8915414d57 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746812.033073:0:22624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a45b7f95600/0xfac36e8915414d57 lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746812.033084:0:22624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8a4483586f00) 00010000:00010000:1.0:1788746812.033087:0:22624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788746812.033794:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00010000:00010000:1.0:1788746812.033875:0:22624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a45b7f95600/0xfac36e8915414d57 lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746812.033882:0:22624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a45b7f95600/0xfac36e8915414d57 lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746812.033896:0:22624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a4581526200/0xfac36e8915414d49 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746812.033902:0:22624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a4581526200/0xfac36e8915414d49 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746812.033907:0:22624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a4581526200/0xfac36e8915414d49 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746812.033911:0:22624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a4581526200 already unused, calling callback (ffffffffc17914f0) 00010000:00010000:1.0:1788746812.033914:0:22624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a4581526200/0xfac36e8915414d49 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746812.033920:0:22624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a4581526200/0xfac36e8915414d49 lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746812.033928:0:22624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8a4483586f00) 00010000:00010000:1.0:1788746812.033930:0:22624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788746812.033933:0:22624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a4581526200/0xfac36e8915414d49 lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746812.033951:0:22624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a4581526200/0xfac36e8915414d49 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22624 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788746812.034120:0:22624:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a448379ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bbae771a-9fe8-425e-89d3-e0a0b7b26f24+19:18732:x1875636305172608:12345-192.168.204.39@tcp:57:lhsmtool_posix.0 Request processed in 27136us (27522us total) trans 12884901916 rc 0/0 00000100:00100000:1.0:1788746812.034129:0:22624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 63 00000020:00080000:1.0:1788746812.034135:0:22624:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1788746812.034536:0:22657:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:0.0:1788746812.034540:0:22657:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788746812.034556:0:22657:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:0.0:1788746812.034562:0:22657:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:1.0:1788746812.034777:0:22624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636305173120 00000100:00100000:1.0:1788746812.034785:0:22624:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636305173120 00000100:00100000:3.0:1788746812.035258:0:22625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 64 00000100:00100000:3.0:1788746812.035272:0:22625:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4481b66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbae771a-9fe8-425e-89d3-e0a0b7b26f24+19:18731:x1875636305173120:12345-192.168.204.39@tcp:101:dd.0 00010000:00010000:3.0:1788746812.035308:0:22625:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788746812.035328:0:22625:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a4587526a00/0xfac36e8915414d5e lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4d2179c47f0789b8 expref: -99 pid: 22625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746812.035359:0:22625:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a4587527600/0xfac36e8915414d65 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746812.035371:0:22625:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a4587527600/0xfac36e8915414d65 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746812.035382:0:22625:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a4587527600/0xfac36e8915414d65 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746812.035582:0:22625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a4587526a00/0xfac36e8915414d5e lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.39@tcp remote: 0x4d2179c47f0789b8 expref: 21 pid: 22625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746812.035599:0:22625:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a4587527600/0xfac36e8915414d65 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.39@tcp remote: 0x4d2179c47f0789b8 expref: 20 pid: 22625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746812.035606:0:22625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8a4483586f00) 00010000:00010000:3.0:1788746812.035610:0:22625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788746812.035613:0:22625:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a4587527600, rc 0) 00000100:00100000:3.0:1788746812.035668:0:22625:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4481b66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbae771a-9fe8-425e-89d3-e0a0b7b26f24+20:18731:x1875636305173120:12345-192.168.204.39@tcp:101:dd.0 Request processed in 400us (1876us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746812.035675:0:22625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 64 00000100:00100000:0.0:1788746812.039765:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788746812.039849:0:22626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636305173376 00000100:00100000:2.0:1788746812.039859:0:22626:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636305173376 00000100:00100000:2.0:1788746812.039912:0:22626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 11 00000100:00100000:2.0:1788746812.039922:0:22626:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4590cb8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bbae771a-9fe8-425e-89d3-e0a0b7b26f24+20:18732:x1875636305173376:12345-192.168.204.39@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1788746812.040205:0:22626:0:(mdd_object.c:4014:mdd_close()) Object [0x2000013a1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1788746812.040235:0:22626:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901917 00010000:00010000:2.0:1788746812.040265:0:22626:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a4483ed7a00/0xfac36e8915414d6c lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746812.041108:0:22626:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a4483ed7a00/0xfac36e8915414d6c lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 22626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746812.041122:0:22626:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a4483ed7a00/0xfac36e8915414d6c lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 22626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746812.041131:0:22626:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a4483ed7a00/0xfac36e8915414d6c lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 22626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746812.041138:0:22626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a4483ed7a00/0xfac36e8915414d6c lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 22626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746812.041144:0:22626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a4483ed7a00/0xfac36e8915414d6c lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 22626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788746812.041223:0:22626:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788746812.041261:0:22612:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788746812.041269:0:22612:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a4483ed7a00/0xfac36e8915414d6c lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 22626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746812.041277:0:22612:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a4483ed7a00 already unused, calling callback (ffffffffc0b5a8d0) 00010000:00010000:0.0:1788746812.041282:0:22612:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a4483ed7a00/0xfac36e8915414d6c lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 22626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746812.041323:0:22612:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a4483ed7a00/0xfac36e8915414d6c lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 22626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746812.041336:0:22612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8a45833f9600) 00010000:00010000:0.0:1788746812.041339:0:22612:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788746812.041344:0:22612:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a4483ed7a00/0xfac36e8915414d6c lrc: 1/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 22626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746812.041349:0:22612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a4483ed7a00/0xfac36e8915414d6c lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 22626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746812.041361:0:22612:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788746812.041362:0:22612:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788746812.041364:0:22612:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788746812.041737:0:22626:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4590cb8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bbae771a-9fe8-425e-89d3-e0a0b7b26f24+22:18732:x1875636305173376:12345-192.168.204.39@tcp:35:lhsmtool_posix.0 Request processed in 1812us (1983us total) trans 12884901918 rc 0/0 00000100:00100000:2.0:1788746812.041747:0:22626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 11 00000020:00080000:2.0:1788746812.041753:0:22626:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1788746812.090495:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788746812.090557:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788746812.090748:0:24135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636305173632 00000100:00100000:1.0:1788746812.090761:0:24135:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636305173632 00000100:00100000:1.0:1788746812.090872:0:24135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636305173504 00000100:00100000:1.0:1788746812.090876:0:24135:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636305173504 00000100:00100000:1.0:1788746812.090902:0:24135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 0 00000100:00100000:1.0:1788746812.090915:0:24135:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4481b65180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bbae771a-9fe8-425e-89d3-e0a0b7b26f24+8:2399:x1875636305173632:12345-192.168.204.39@tcp:4:dd.0 00002000:00010000:1.0:1788746812.090981:0:24135:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x42:0x0] initial LVB size: 0, mtime: 0x6a9e1c3a, atime: 0x6a9e1c39, ctime: 0x6a9e1c3a, blocks: 0x0 00010000:00010000:1.0:1788746812.090994:0:24135:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e55e37de/0xfac36e8915414d73 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746812.091015:0:24135:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=741s v=(0 0) 00010000:00010000:1.0:1788746812.091020:0:24135:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788746812.091029:0:24135:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e55e37de/0xfac36e8915414d73 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746812.091057:0:24135:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e55e37de/0xfac36e8915414d73 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788746812.092065:0:22619:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:2.0:1788746812.175776:0:24125:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901895 is committed 00000001:00080000:2.0:1788746812.175796:0:24125:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901894 is committed 00002000:00010000:0.0:1788746812.176660:0:24135:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb size from disk: 0 -> 7654321 00002000:00010000:0.0:1788746812.176668:0:24135:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb mtime from disk: 1788746810 -> 1788746812 00002000:00010000:0.0:1788746812.176670:0:24135:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb ctime from disk: 1788746810 -> 1788746812 00002000:00010000:0.0:1788746812.176688:0:24135:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb blocks from disk: 0 -> 6760 00010000:00010000:0.0:1788746812.176709:0:24135:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e55e37de/0xfac36e8915414d73 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746812.176722:0:24135:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e55e37de/0xfac36e8915414d73 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 24135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746812.176732:0:24135:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e55e37de/0xfac36e8915414d73 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746812.176739:0:24135:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a45b7f95600 already unused, calling callback (ffffffffc0b5a8d0) 00010000:00010000:0.0:1788746812.176744:0:24135:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e55e37de/0xfac36e8915414d73 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746812.176753:0:24135:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e55e37de/0xfac36e8915414d73 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 24135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746812.176772:0:24135:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e55e37de/0xfac36e8915414d73 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788746812.176781:0:24135:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e55e37de/0xfac36e8915414d73 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788746812.178353:0:24135:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4481b65180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bbae771a-9fe8-425e-89d3-e0a0b7b26f24+6:2399:x1875636305173632:12345-192.168.204.39@tcp:4:dd.0 Request processed in 87430us (87864us total) trans 12884901895 rc 0/0 00000100:00100000:1.0:1788746812.178367:0:24135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 0 00000100:00100000:1.0:1788746812.178406:0:24135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1 00000100:00100000:1.0:1788746812.178418:0:24135:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a45b7ef4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bbae771a-9fe8-425e-89d3-e0a0b7b26f24+5:2399:x1875636305173504:12345-192.168.204.39@tcp:4:dd.0 00002000:00010000:1.0:1788746812.178492:0:24135:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x42:0x0] initial LVB size: 7654321, mtime: 0x6a9e1c3c, atime: 0x6a9e1c39, ctime: 0x6a9e1c3c, blocks: 0x1a68 00010000:00010000:1.0:1788746812.178501:0:24135:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dac8e4a9/0xfac36e8915414d7a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746812.178516:0:24135:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=741s v=(0 0) 00010000:00010000:1.0:1788746812.178521:0:24135:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788746812.178527:0:24135:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dac8e4a9/0xfac36e8915414d7a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788746812.178540:0:24135:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dac8e4a9/0xfac36e8915414d7a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788746812.262874:0:24125:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901896 is committed 00002000:00010000:3.0:1788746812.263238:0:24135:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb blocks from disk: 6760 -> 14952 00010000:00010000:3.0:1788746812.263259:0:24135:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dac8e4a9/0xfac36e8915414d7a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746812.263272:0:24135:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dac8e4a9/0xfac36e8915414d7a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 24135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746812.263281:0:24135:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dac8e4a9/0xfac36e8915414d7a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746812.263331:0:24135:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a45b7f95a00 already unused, calling callback (ffffffffc0b5a8d0) 00010000:00010000:3.0:1788746812.263336:0:24135:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dac8e4a9/0xfac36e8915414d7a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746812.263361:0:24135:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dac8e4a9/0xfac36e8915414d7a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 24135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746812.263384:0:24135:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dac8e4a9/0xfac36e8915414d7a lrc: 2/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788746812.263392:0:24135:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dac8e4a9/0xfac36e8915414d7a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788746812.263692:0:24135:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a45b7ef4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bbae771a-9fe8-425e-89d3-e0a0b7b26f24+5:2399:x1875636305173504:12345-192.168.204.39@tcp:4:dd.0 Request processed in 85272us (173129us total) trans 12884901896 rc 0/0 00000100:00100000:3.0:1788746812.263709:0:24135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1 00010000:00010000:2.0:1788746812.306608:0:25655:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788746812.626505:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a45b7ef6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875636324153216:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788746812.626574:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788746812.626583:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746812.626591:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a448379ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875636324153344:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788746812.626645:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788746812.626665:0:22629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324153216 00000100:00100000:2.0:1788746812.626673:0:22629:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324153216 00000100:00100000:1.0:1788746812.626687:0:25416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324153344 00000100:00100000:1.0:1788746812.626693:0:25416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324153344 00000100:00100000:2.0:1788746812.626736:0:22629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788746812.626756:0:25416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788746812.626766:0:22629:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4482710700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875636324153216:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788746812.626770:0:25416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a448379f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875636324153344:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788746812.626801:0:25416:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3485696 granted 26324672 pending 0 free 3923513344 avail 3684286464 00000004:00000024:2.0:1788746812.626804:0:22629:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788746812.626965:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a448379ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875636324153344:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788746812.627011:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788746812.627019:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a4590cb9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875636324153472:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788746812.627233:0:25416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a448379f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875636324153344:12345-0@lo:13:osp-pre-0-1.0 Request processed in 467us (586us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746812.627241:0:25416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:1.0:1788746812.627307:0:22619:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788746812.627414:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746812.627910:0:22628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324153472 00000100:00100000:1.0:1788746812.627918:0:22628:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324153472 00000100:00100000:1.0:1788746812.627955:0:22628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788746812.627963:0:22628:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4590cbad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875636324153472:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788746812.627987:0:22628:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446289408 avail 1300049920 00000100:00100000:1.0:1788746812.628032:0:22628:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4590cbad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875636324153472:12345-0@lo:41:osp-pre-0-1.0 Request processed in 69us (618us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746812.628051:0:22628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788746812.628209:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a4590cb9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875636324153472:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788746812.631187:0:22629:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4482710700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875636324153216:12345-0@lo:41:osp-pre-1-0.0 Request processed in 4414us (4593us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746812.631204:0:22629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788746812.635439:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a45b7ef6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875636324153216:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788746813.330910:0:25654:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788746814.102814:0:22657:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:1.0:1788746814.102824:0:22657:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788746814.102842:0:22657:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:1.0:1788746814.102849:0:22657:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000001:02000400:0.0:1788746814.144182:0:25709:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1d: @@@@@@ FAIL: expected /mnt/pcc.d1d.sanity-pcc/d1d.sanity-pcc/13a3/0x2000013a1:0x2:0x0 size: 7654321 got: 0 00010000:00010000:0.0:1788746814.356437:0:22611:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788746814.675087:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a4482711f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875636324153728:0@lo:400:kworker.0 00000100:00100000:3.0:1788746814.675169:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746814.675205:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a4484489180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875636324154240:0@lo:400:kworker.0 00000100:00100000:3.0:1788746814.675226:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746814.675238:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a4483cbe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3644:1875636324154752:0@lo:400:kworker.0 00000100:00100000:3.0:1788746814.675276:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746814.675320:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:3.0:1788746814.675327:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a4482712d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:41310026-2b0a-472c-80e6-fbabf81d5070:3644:1875636324153600:0@lo:400:kworker.0 00000100:00100000:3.0:1788746814.675377:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746814.675402:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a4483590e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875636324154112:0@lo:400:kworker.0 00000100:00100000:3.0:1788746814.675741:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746814.675760:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a45c0ea5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875636324154624:0@lo:400:kworker.0 00000100:00100000:3.0:1788746814.675794:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746814.675814:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a45b0c53800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3644:1875636324155136:0@lo:400:kworker.0 00000100:00100000:3.0:1788746814.675833:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746814.675868:0:22625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324154752 00000100:00100000:3.0:1788746814.675876:0:22625:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324154752 00000100:00100000:3.0:1788746814.675928:0:22625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324154112 00000100:00100000:3.0:1788746814.675931:0:22625:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324154112 00000100:00100000:3.0:1788746814.675944:0:22625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324154624 00000100:00100000:3.0:1788746814.675946:0:22625:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324154624 00000100:00100000:3.0:1788746814.675955:0:22625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324155136 00000100:00100000:3.0:1788746814.675958:0:22625:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324155136 00000100:00100000:3.0:1788746814.675973:0:22625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788746814.675982:0:22625:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4483ddaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875636324154752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788746814.676207:0:25514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788746814.676217:0:25514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4483ddb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875636324154112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788746814.676273:0:25514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4483ddb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875636324154112:12345-0@lo:400:kworker.0 Request processed in 58us (531us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746814.676280:0:25514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788746814.676322:0:25514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788746814.676330:0:25514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4483dd9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875636324154624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788746814.676359:0:25514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4483dd9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875636324154624:12345-0@lo:400:kworker.0 Request processed in 31us (565us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746814.676364:0:25514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788746814.676375:0:25514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788746814.676381:0:25514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4483dd8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875636324155136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788746814.676403:0:25514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4483dd8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875636324155136:12345-0@lo:400:kworker.0 Request processed in 23us (569us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746814.676409:0:25514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788746814.676445:0:22618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324153600 00000100:00100000:2.0:1788746814.676449:0:22618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324153600 00000100:00100000:2.0:1788746814.676478:0:22618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1788746814.676485:0:22618:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a45af2a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41310026-2b0a-472c-80e6-fbabf81d5070+24:3644:x1875636324153600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788746814.676515:0:22618:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a45af2a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41310026-2b0a-472c-80e6-fbabf81d5070+24:3644:x1875636324153600:12345-0@lo:400:kworker.0 Request processed in 31us (1137us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746814.676822:0:22618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1788746814.676894:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a45b7ef6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875636324155264:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788746814.676926:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788746814.676961:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a4482712d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:41310026-2b0a-472c-80e6-fbabf81d5070:3644:1875636324153600:0@lo:400:kworker.0 00000100:00100000:2.0:1788746814.676975:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a4483590e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875636324154112:0@lo:400:kworker.0 00000100:00100000:2.0:1788746814.676984:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a45c0ea5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875636324154624:0@lo:400:kworker.0 00010000:00080000:2.0:1788746814.676996:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a45b0c53800 x1875636324155136/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788746830 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788746814.677331:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a4482711c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875636324153984:0@lo:400:kworker.0 00000100:00100000:1.0:1788746814.677361:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746814.677381:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a4484489c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875636324154496:0@lo:400:kworker.0 00000100:00100000:1.0:1788746814.677395:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746814.677407:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a45b0c53480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3646:1875636324155008:0@lo:400:kworker.0 00000100:00100000:2.0:1788746814.677654:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a45b0c53800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3644:1875636324155136:0@lo:400:kworker.0 00000100:00100000:2.0:1788746814.677704:0:24131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324153984 00000100:00100000:2.0:1788746814.677708:0:24131:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324153984 00000100:00100000:2.0:1788746814.677736:0:24131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324154496 00000100:00100000:2.0:1788746814.677738:0:24131:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324154496 00000100:00100000:2.0:1788746814.677754:0:24131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788746814.677760:0:24131:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a448379e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1875636324153984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788746814.677812:0:24131:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a448379e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1875636324153984:12345-0@lo:400:kworker.0 Request processed in 51us (449us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746814.677817:0:24131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788746814.677828:0:24131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788746814.677833:0:24131:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a448379d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1875636324154496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788746814.677854:0:24131:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a448379d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1875636324154496:12345-0@lo:400:kworker.0 Request processed in 21us (458us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746814.677859:0:24131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:2.0:1788746814.677897:0:22619:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788746814.677901:0:22619:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788746814.677904:0:22619:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788746814.677913:0:22628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324153728 00000100:00100000:2.0:1788746814.677916:0:22628:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324153728 00000100:00100000:2.0:1788746814.677933:0:22628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324154240 00000100:00100000:2.0:1788746814.677935:0:22628:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324154240 00000100:00100000:2.0:1788746814.677945:0:22628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788746814.677951:0:22628:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a45b0c50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875636324153728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788746814.677982:0:22628:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a45b0c50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875636324153728:12345-0@lo:400:kworker.0 Request processed in 31us (2813us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746814.677987:0:22628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788746814.677997:0:22628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788746814.678207:0:22625:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4483ddaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875636324154752:12345-0@lo:400:kworker.0 Request processed in 2226us (2929us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746814.678215:0:22625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788746814.678314:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746814.678349:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a4482711c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875636324153984:0@lo:400:kworker.0 00000100:00100000:1.0:1788746814.678357:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a4484489c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875636324154496:0@lo:400:kworker.0 00000100:00100000:1.0:1788746814.678377:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:1.0:1788746814.678385:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a4482713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875636324153856:0@lo:400:kworker.0 00000100:00100000:1.0:1788746814.678408:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788746814.678628:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a4482711f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875636324153728:0@lo:400:kworker.0 00000100:00100000:3.0:1788746814.678639:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a4483cbe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3644:1875636324154752:0@lo:400:kworker.0 00000100:00100000:3.0:1788746814.678668:0:24129:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324153856 00000100:00100000:3.0:1788746814.678671:0:24129:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324153856 00000100:00100000:3.0:1788746814.678701:0:24129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788746814.678706:0:24129:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a448379ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875636324153856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788746814.678745:0:24129:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a448379ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875636324153856:12345-0@lo:400:kworker.0 Request processed in 39us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746814.678751:0:24129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788746814.678767:0:24133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324155264 00000100:00100000:3.0:1788746814.678770:0:24133:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324155264 00000100:00100000:3.0:1788746814.678802:0:24133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788746814.678808:0:24133:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a45b7ef7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875636324155264:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788746814.678827:0:24133:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915849728 avail 3684327424 00000100:00100000:3.0:1788746814.678857:0:24133:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a45b7ef7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875636324155264:12345-0@lo:13:osp-pre-1-1.0 Request processed in 50us (1931us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746814.678863:0:24133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:3.0:1788746814.678877:0:22619:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788746814.678899:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a45b7ef6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875636324155264:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788746814.678927:0:25514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324155008 00000100:00100000:3.0:1788746814.678930:0:25514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324155008 00000100:00100000:3.0:1788746814.678953:0:25514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788746814.678958:0:25514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a448379fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875636324155008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788746814.678984:0:25514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a448379fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875636324155008:12345-0@lo:400:kworker.0 Request processed in 26us (671us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746814.678990:0:25514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788746814.679160:0:3646:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 12884901894 gen 2 00000004:00080000:1.0:1788746814.679165:0:3646:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a45bfe98e00, transno 12884901892 00000004:00080000:1.0:1788746814.679174:0:3646:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 12884901894 committed transno 12884901894 00000100:00100000:1.0:1788746814.679188:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a4482713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875636324153856:0@lo:400:kworker.0 00000100:00100000:1.0:1788746814.679195:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a448448bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875636324154368:0@lo:400:kworker.0 00000100:00100000:1.0:1788746814.679218:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746814.679319:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a45b0c53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3646:1875636324154880:0@lo:400:kworker.0 00000100:00100000:1.0:1788746814.679341:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746814.679355:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a448379ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875636324155392:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788746814.679372:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788746814.679390:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a45b0c53480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3646:1875636324155008:0@lo:400:kworker.0 00000100:00100000:1.0:1788746814.679414:0:25016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324154368 00000100:00100000:1.0:1788746814.679417:0:25016:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324154368 00000100:00100000:0.0:1788746814.679570:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788746814.679579:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a4590cb9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875636324155520:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788746814.679603:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788746814.679719:0:24133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324155392 00000100:00100000:0.0:1788746814.679723:0:24133:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324155392 00000100:00100000:1.0:1788746814.679841:0:25016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788746814.679887:0:22628:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a45b0c50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875636324154240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788746814.679929:0:22628:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a45b0c50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875636324154240:12345-0@lo:400:kworker.0 Request processed in 1926us (4702us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746814.679936:0:22628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788746814.679953:0:22623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324154880 00000100:00100000:2.0:1788746814.679956:0:22623:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324154880 00000100:00100000:2.0:1788746814.679975:0:22623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788746814.679980:0:22623:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a448379c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875636324154880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788746814.680019:0:22623:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a448379c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875636324154880:12345-0@lo:400:kworker.0 Request processed in 38us (677us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746814.680025:0:22623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788746814.680064:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a4484489180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875636324154240:0@lo:400:kworker.0 00000100:00100000:2.0:1788746814.680098:0:25416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636324155520 00000100:00100000:2.0:1788746814.680101:0:25416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636324155520 00000100:00100000:2.0:1788746814.680118:0:25416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788746814.680139:0:25416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4590cb8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875636324155520:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788746814.680152:0:25416:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915849728 avail 3684327424 00000100:00100000:2.0:1788746814.680185:0:25416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4590cb8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875636324155520:12345-0@lo:13:osp-pre-1-0.0 Request processed in 48us (581us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746814.680191:0:25416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788746814.680248:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a4590cb9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875636324155520:0@lo:13:osp-pre-1-0.0 00010000:00080000:2.0:1788746814.680274:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a45b0c53b80 x1875636324154880/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788746830 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788746814.680284:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a45b0c53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3646:1875636324154880:0@lo:400:kworker.0 00000100:00080000:3.0:1788746814.680398:0:22619:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788746814.680403:0:22619:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788746814.680893:0:24133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788746814.680901:0:24133:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4484489c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875636324155392:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788746814.680918:0:24133:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3485696 granted 26324672 pending 0 free 3915857920 avail 3684335616 00000100:00100000:0.0:1788746814.680959:0:24133:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4484489c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875636324155392:12345-0@lo:13:osp-pre-0-0.0 Request processed in 59us (1584us total) trans 0 rc 0/0 00000100:00100000:0.0:1788746814.680965:0:24133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788746814.680998:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a448379ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875636324155392:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788746814.681139:0:25016:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a448379d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3646:x1875636324154368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788746814.681185:0:25016:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a448379d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3646:x1875636324154368:12345-0@lo:400:kworker.0 Request processed in 1338us (1965us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746814.681191:0:25016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788746814.681267:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a448448bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875636324154368:0@lo:400:kworker.0 00000100:00080000:3.0:1788746814.681381:0:22619:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788746815.383325:0:22612:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788746815.850365:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788746815.850469:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788746815.850505:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788746815.850530:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788746815.850561:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788746815.850580:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788746815.850599:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788746815.850617:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788746815.850641:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788746815.850673:0:24665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636305174272 00000100:00100000:1.0:1788746815.850683:0:24665:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636305174272 00000100:00100000:1.0:1788746815.850736:0:24665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636305174784 00000100:00100000:1.0:1788746815.850752:0:24665:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636305174784 00000100:00100000:3.0:1788746815.852075:0:22625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636305174016 00000100:00100000:3.0:1788746815.852085:0:22625:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636305174016 00000100:00100000:3.0:1788746815.852126:0:22625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636305174528 00000100:00100000:3.0:1788746815.852128:0:22625:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636305174528 00000100:00100000:3.0:1788746815.852152:0:22625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636305173888 00000100:00100000:3.0:1788746815.852165:0:22625:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636305173888 00000100:00100000:3.0:1788746815.852180:0:22625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636305174400 00000100:00100000:3.0:1788746815.852183:0:22625:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636305174400 00000100:00100000:3.0:1788746815.852202:0:22625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 70 00000100:00100000:3.0:1788746815.852212:0:22625:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a448448bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbae771a-9fe8-425e-89d3-e0a0b7b26f24+5:2400:x1875636305174016:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:3.0:1788746815.852305:0:22625:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a448448bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbae771a-9fe8-425e-89d3-e0a0b7b26f24+5:2400:x1875636305174016:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 94us (1836us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746815.852312:0:22625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 70 00000100:00100000:3.0:1788746815.852331:0:22625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 71 00000100:00100000:3.0:1788746815.852336:0:22625:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4483c66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7d8327c8-4436-4f17-b07d-03a96e9e6b73+5:2400:x1875636305174528:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:3.0:1788746815.852360:0:22625:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4483c66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7d8327c8-4436-4f17-b07d-03a96e9e6b73+5:2400:x1875636305174528:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 24us (1830us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746815.852366:0:22625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 71 00000100:00100000:3.0:1788746815.852380:0:22625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 72 00000100:00100000:3.0:1788746815.852385:0:22625:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a45bfe98e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbae771a-9fe8-425e-89d3-e0a0b7b26f24+22:2400:x1875636305173888:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:3.0:1788746815.852409:0:22625:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a45bfe98e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbae771a-9fe8-425e-89d3-e0a0b7b26f24+22:2400:x1875636305173888:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 24us (1829us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746815.852415:0:22625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 72 00000100:00100000:3.0:1788746815.852425:0:22625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 73 00000100:00100000:3.0:1788746815.852431:0:22625:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a45bfe9ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7d8327c8-4436-4f17-b07d-03a96e9e6b73+6:2400:x1875636305174400:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:3.0:1788746815.852454:0:22625:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a45bfe9ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7d8327c8-4436-4f17-b07d-03a96e9e6b73+6:2400:x1875636305174400:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 24us (1836us total) trans 0 rc 0/0 00000100:00100000:3.0:1788746815.852459:0:22625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 73 00000100:00100000:1.0:1788746815.853326:0:24665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636305174144 00000100:00100000:1.0:1788746815.853335:0:24665:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636305174144 00000100:00100000:1.0:1788746815.853351:0:24665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636305174656 00000100:00100000:1.0:1788746815.853354:0:24665:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636305174656 00000100:00100000:1.0:1788746815.853371:0:24665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 24 00000100:00100000:1.0:1788746815.853379:0:24665:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4484489180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bbae771a-9fe8-425e-89d3-e0a0b7b26f24+5:2400:x1875636305174272:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:1.0:1788746815.853422:0:24665:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4484489180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bbae771a-9fe8-425e-89d3-e0a0b7b26f24+5:2400:x1875636305174272:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 44us (2916us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746815.853428:0:24665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 24 00000100:00100000:1.0:1788746815.853441:0:24665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 25 00000100:00100000:1.0:1788746815.853448:0:24665:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a4483c66680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7d8327c8-4436-4f17-b07d-03a96e9e6b73+5:2400:x1875636305174784:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:1.0:1788746815.853472:0:24665:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a4483c66680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7d8327c8-4436-4f17-b07d-03a96e9e6b73+5:2400:x1875636305174784:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 25us (2910us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746815.853477:0:24665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 25 00000100:00100000:1.0:1788746815.853489:0:24665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 26 00000100:00100000:1.0:1788746815.853494:0:24665:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a45bfe98700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bbae771a-9fe8-425e-89d3-e0a0b7b26f24+5:2400:x1875636305174144:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:1.0:1788746815.853515:0:24665:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a45bfe98700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bbae771a-9fe8-425e-89d3-e0a0b7b26f24+5:2400:x1875636305174144:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 20us (2915us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746815.853528:0:24665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 26 00000100:00100000:1.0:1788746815.853539:0:24665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 27 00000100:00100000:1.0:1788746815.853544:0:24665:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a45bcb69f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7d8327c8-4436-4f17-b07d-03a96e9e6b73+5:2400:x1875636305174656:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:1.0:1788746815.853566:0:24665:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a45bcb69f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7d8327c8-4436-4f17-b07d-03a96e9e6b73+5:2400:x1875636305174656:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 22us (2925us total) trans 0 rc 0/0 00000100:00100000:1.0:1788746815.853571:0:24665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 27 00000100:00080000:1.0:1788746815.853617:0:22619:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788746815.853622:0:22619:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788746815.853624:0:22619:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788746815.853626:0:22619:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788746815.858318:0:22617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875636305173760 00000100:00100000:2.0:1788746815.858330:0:22617:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875636305173760 00000100:00100000:2.0:1788746815.858397:0:22617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 168 00000100:00100000:2.0:1788746815.858408:0:22617:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a45af2a5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f755556-f1cd-4e4b-8ec3-48b3fc3a369c+13:2400:x1875636305173760:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:2.0:1788746815.858465:0:22617:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a45af2a5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f755556-f1cd-4e4b-8ec3-48b3fc3a369c+13:2400:x1875636305173760:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 60us (8112us total) trans 0 rc 0/0 00000100:00100000:2.0:1788746815.858472:0:22617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 168 Debug log: 14288 lines, 14288 kept, 0 dropped, 0 bad.