00010000:00010000:1.0F:1788843781.467269:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0F:1788843782.491244:0:19636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0F:1788843783.072748:0:17130:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934622 is committed 00000020:00080000:2.0:1788843783.072788:0:17130:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9bd110dec0c0 refcount 2 committed 0 result 0 batchid 4294967529 00000020:00080000:2.0:1788843783.072794:0:17130:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9bd13e8de100 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9bd110dec840 00000020:00080000:2.0:1788843783.072797:0:17130:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9bd13e8de300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9bd1330fba00 00000020:00080000:0.0F:1788843783.072885:0:17188:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4294967529 committed batchid 8 00000020:00080000:0.0:1788843783.072986:0:17188:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:1.0:1788843783.073170:0:3617:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947c00/0xa762dfcbd58d2934 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19944 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843783.073185:0:3617:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947c00/0xa762dfcbd58d2934 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 19944 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843783.073194:0:3617:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947c00/0xa762dfcbd58d2934 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19944 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843783.073201:0:3617:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd007947c00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1788843783.073206:0:3617:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947c00/0xa762dfcbd58d2934 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19944 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843783.073216:0:3617:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947c00/0xa762dfcbd58d2934 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 19944 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843783.073393:0:3617:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9bd105fa2000) 00010000:00010000:1.0:1788843783.073447:0:3617:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788843783.073454:0:3617:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947c00/0xa762dfcbd58d2934 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19944 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843783.073460:0:3617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947c00/0xa762dfcbd58d2934 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19944 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843783.095830:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843783.095924:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116632448 00000100:00100000:3.0:1788843783.095935:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116632448 00000100:00100000:3.0:1788843783.096024:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 65 00000100:00100000:3.0:1788843783.096036:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f8d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6921b2ba-4cb8-4cf7-a5c0-1c37d97b5fd0+13:15582:x1875738116632448:12345-192.168.203.33@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1788843783.096201:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f8d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6921b2ba-4cb8-4cf7-a5c0-1c37d97b5fd0+13:15582:x1875738116632448:12345-192.168.203.33@tcp:60:lhsmtool_posix.0 Request processed in 167us (380us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843783.096209:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 65 00000100:00080000:0.0:1788843783.096689:0:17146:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788843783.100826:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1788843783.100910:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116632576 00000100:00100000:1.0:1788843783.100923:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116632576 00000100:00080000:0.0:1788843783.101078:0:17146:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788843783.101173:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 66 00000100:00100000:1.0:1788843783.101189:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141b6b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6921b2ba-4cb8-4cf7-a5c0-1c37d97b5fd0+5:15582:x1875738116632576:12345-192.168.203.33@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1788843783.101303:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141b6b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6921b2ba-4cb8-4cf7-a5c0-1c37d97b5fd0+5:15582:x1875738116632576:12345-192.168.203.33@tcp:60:lhsmtool_posix.0 Request processed in 118us (487us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843783.101311:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 66 00000100:00100000:1.0:1788843783.114266:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843783.114712:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116632832 00000100:00100000:2.0:1788843783.114724:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116632832 00000100:00100000:2.0:1788843783.114793:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 12 00000100:00100000:2.0:1788843783.114805:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141b9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6921b2ba-4cb8-4cf7-a5c0-1c37d97b5fd0+13:15582:x1875738116632832:12345-192.168.203.33@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788843783.115044:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141b9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6921b2ba-4cb8-4cf7-a5c0-1c37d97b5fd0+14:15582:x1875738116632832:12345-192.168.203.33@tcp:35:lhsmtool_posix.0 Request processed in 241us (788us total) trans 8589934623 rc 0/0 00000100:00100000:2.0:1788843783.115052:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 12 00010000:00010000:2.0:1788843783.523374:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788843783.578347:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788843783.578372:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd141b9e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1875738134539264:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788843783.578393:0:3632:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788843783.578406:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd141b6a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1875738134539392:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788843783.578450:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843783.578456:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843783.578510:0:18659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134539264 00000100:00100000:0.0:1788843783.578519:0:18659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134539264 00000100:00080000:1.0:1788843783.578561:0:17146:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788843783.578579:0:18659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788843783.578589:0:18659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141b9c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1875738134539264:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788843783.578618:0:18659:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 26324672 pending 0 free 3915857920 avail 3684335616 00000100:00100000:3.0:1788843783.578640:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134539392 00000100:00100000:3.0:1788843783.578643:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134539392 00000100:00100000:0.0:1788843783.578678:0:18659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141b9c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1875738134539264:12345-0@lo:13:osp-pre-0-1.0 Request processed in 91us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843783.578684:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788843783.578686:0:18659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788843783.578690:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd12036aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3632:x1875738134539392:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788843783.578711:0:17155:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:3.0:1788843783.578753:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd12036aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3632:x1875738134539392:12345-0@lo:41:osp-pre-0-1.0 Request processed in 63us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843783.578759:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788843783.578888:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd141b6a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1875738134539392:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788843783.579040:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd141b9e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1875738134539264:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788843784.090725:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd12036b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1875738134539520:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788843784.090813:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843784.090958:0:17890:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134539520 00000100:00100000:2.0:1788843784.090967:0:17890:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134539520 00000100:00100000:2.0:1788843784.091020:0:17890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788843784.091030:0:17890:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141b9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3630:x1875738134539520:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788843784.091064:0:17890:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788843784.091120:0:17890:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141b9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3630:x1875738134539520:12345-0@lo:41:osp-pre-1-0.0 Request processed in 90us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843784.091127:0:17890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788843784.091297:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd12036b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1875738134539520:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788843784.538301:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788843784.795086:0:17908:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788843785.114578:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788843785.114605:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd141b9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1875738134539648:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788843785.114680:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843785.115264:0:18657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134539648 00000100:00100000:0.0:1788843785.115274:0:18657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134539648 00000100:00100000:0.0:1788843785.115347:0:18657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788843785.115359:0:18657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141b9c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3630:x1875738134539648:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788843785.115392:0:18657:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1788843785.115458:0:18657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141b9c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3630:x1875738134539648:12345-0@lo:13:osp-pre-1-1.0 Request processed in 102us (778us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843785.115465:0:18657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788843785.117019:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f8d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1875738134539776:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788843785.117097:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843785.117314:0:3632:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788843785.117324:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f8d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1875738134539904:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788843785.117368:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843785.118420:0:18659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134539776 00000100:00100000:0.0:1788843785.118432:0:18659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134539776 00000100:00100000:0.0:1788843785.118476:0:18659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134539904 00000100:00100000:0.0:1788843785.118479:0:18659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134539904 00000100:00100000:0.0:1788843785.118497:0:18659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788843785.118508:0:18659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f8d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3632:x1875738134539776:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788843785.118531:0:18659:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1788843785.118613:0:18659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f8d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3632:x1875738134539776:12345-0@lo:13:osp-pre-1-0.0 Request processed in 107us (1516us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843785.118619:0:18659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788843785.118637:0:18659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788843785.118644:0:18659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f8d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3632:x1875738134539904:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788843785.118661:0:18659:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 26324672 pending 0 free 3915857920 avail 3684335616 00000100:00100000:0.0:1788843785.118687:0:18659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f8d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3632:x1875738134539904:12345-0@lo:13:osp-pre-0-0.0 Request processed in 45us (1319us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843785.118692:0:18659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788843785.118919:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd141b6a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1875738134540160:0@lo:400:kworker.0 00000100:00100000:0.0:1788843785.118972:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843785.119007:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd008624700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3631:1875738134540672:0@lo:400:kworker.0 00000100:00100000:0.0:1788843785.119033:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843785.119051:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd141ae8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3631:1875738134541184:0@lo:400:kworker.0 00000100:00100000:0.0:1788843785.119071:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843785.119089:0:3631:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1788843785.119094:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd00723dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:20b96c6c-8494-483a-b913-89dfc06b1440:3631:1875738134540032:0@lo:400:kworker.0 00000100:00100000:0.0:1788843785.119120:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843785.119181:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd008624e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1875738134540544:0@lo:400:kworker.0 00000100:00100000:0.0:1788843785.119206:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843785.119223:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd141ae8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3631:1875738134541056:0@lo:400:kworker.0 00000100:00100000:0.0:1788843785.119244:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843785.119269:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134540160 00000100:00100000:0.0:1788843785.119274:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134540160 00000100:00100000:0.0:1788843785.119318:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788843785.119326:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141ae9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3631:x1875738134540160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788843785.119372:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141ae9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3631:x1875738134540160:12345-0@lo:400:kworker.0 Request processed in 48us (400us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843785.119379:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788843785.119419:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd141b6a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1875738134540160:0@lo:400:kworker.0 00000100:00080000:1.0:1788843785.119815:0:17146:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788843785.119820:0:17146:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788843785.119859:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd008625180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1875738134540416:0@lo:400:kworker.0 00000100:00100000:1.0:1788843785.119892:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843785.119909:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd008627480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3633:1875738134540928:0@lo:400:kworker.0 00000100:00100000:1.0:1788843785.119942:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843785.119962:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1788843785.119967:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd008625500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3633:1875738134540288:0@lo:400:kworker.0 00000100:00100000:1.0:1788843785.119988:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843785.119998:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd008626d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3633:1875738134540800:0@lo:400:kworker.0 00000100:00100000:1.0:1788843785.120017:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843785.120038:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134540672 00000100:00100000:1.0:1788843785.120043:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134540672 00000100:00100000:1.0:1788843785.120074:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134541184 00000100:00100000:1.0:1788843785.120077:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134541184 00000100:00100000:1.0:1788843785.120097:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134541056 00000100:00100000:1.0:1788843785.120100:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134541056 00000100:00100000:1.0:1788843785.120111:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134540928 00000100:00100000:1.0:1788843785.120114:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134540928 00000100:00100000:1.0:1788843785.120127:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134540288 00000100:00100000:1.0:1788843785.120130:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134540288 00000100:00100000:1.0:1788843785.120173:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134540800 00000100:00100000:1.0:1788843785.120177:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134540800 00000100:00100000:1.0:1788843785.120191:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788843785.120197:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0084e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3631:x1875738134540672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843785.120236:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0084e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3631:x1875738134540672:12345-0@lo:400:kworker.0 Request processed in 39us (1202us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843785.120242:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788843785.120256:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788843785.120262:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0084e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3631:x1875738134541184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843785.120288:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0084e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3631:x1875738134541184:12345-0@lo:400:kworker.0 Request processed in 27us (1216us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843785.120293:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788843785.120317:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788843785.120324:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd13e878a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3631:x1875738134541056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843785.120350:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd13e878a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3631:x1875738134541056:12345-0@lo:400:kworker.0 Request processed in 27us (1105us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843785.120355:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788843785.120367:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788843785.120373:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141b9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3633:x1875738134540928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843785.120403:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141b9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3633:x1875738134540928:12345-0@lo:400:kworker.0 Request processed in 31us (461us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843785.120608:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788843785.120623:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788843785.120629:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141b9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3633:x1875738134540288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843785.120661:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141b9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3633:x1875738134540288:12345-0@lo:400:kworker.0 Request processed in 33us (672us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843785.120667:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788843785.120679:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788843785.120685:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141b9df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3633:x1875738134540800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843785.121483:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141b9df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3633:x1875738134540800:12345-0@lo:400:kworker.0 Request processed in 724us (1390us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843785.121494:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00080000:1.0:1788843785.121523:0:17146:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788843785.121526:0:17146:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788843785.121563:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd141ae8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3631:1875738134541056:0@lo:400:kworker.0 00000100:00100000:1.0:1788843785.121578:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd008624700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3631:1875738134540672:0@lo:400:kworker.0 00010000:00080000:1.0:1788843785.121593:0:3631:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd141ae8a80 x1875738134541184/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843801 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788843785.121605:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd141ae8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3631:1875738134541184:0@lo:400:kworker.0 00000100:00100000:1.0:1788843785.121643:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd008625500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3633:1875738134540288:0@lo:400:kworker.0 00000100:00100000:1.0:1788843785.121655:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd008626d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3633:1875738134540800:0@lo:400:kworker.0 00010000:00080000:1.0:1788843785.121666:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd008627480 x1875738134540928/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843801 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788843785.121675:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd008627480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3633:1875738134540928:0@lo:400:kworker.0 00000100:00100000:3.0:1788843785.122180:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134540032 00000100:00100000:3.0:1788843785.122188:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134540032 00000100:00100000:3.0:1788843785.122238:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1788843785.122247:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0059e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20b96c6c-8494-483a-b913-89dfc06b1440+24:3631:x1875738134540032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788843785.122344:0:18654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134540544 00000100:00100000:0.0:1788843785.122350:0:18654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134540544 00000100:00100000:0.0:1788843785.122394:0:18654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788843785.122402:0:18654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0084e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3631:x1875738134540544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843785.122489:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd141b9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1875738134539648:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1788843785.122511:0:17146:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788843785.122543:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134540416 00000100:00100000:1.0:1788843785.122547:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134540416 00000100:00100000:1.0:1788843785.122576:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788843785.122582:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141b9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3633:x1875738134540416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788843785.125407:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0059e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20b96c6c-8494-483a-b913-89dfc06b1440+24:3631:x1875738134540032:12345-0@lo:400:kworker.0 Request processed in 3150us (6274us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843785.125579:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1788843785.125673:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd00723dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:20b96c6c-8494-483a-b913-89dfc06b1440:3631:1875738134540032:0@lo:400:kworker.0 00000100:00100000:0.0:1788843785.131660:0:18654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0084e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3631:x1875738134540544:12345-0@lo:400:kworker.0 Request processed in 9247us (12440us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843785.131676:0:18654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788843785.131864:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd008624e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1875738134540544:0@lo:400:kworker.0 00000100:00100000:1.0:1788843785.132101:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141b9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3633:x1875738134540416:12345-0@lo:400:kworker.0 Request processed in 9517us (12205us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843785.132111:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788843785.132395:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f8d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1875738134539904:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788843785.132523:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f8d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1875738134539776:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788843785.132791:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd008625180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1875738134540416:0@lo:400:kworker.0 00000100:00100000:1.0:1788843785.137934:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1788843785.137978:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1788843785.138010:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1788843785.138042:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1788843785.138109:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116632960 00000100:00100000:0.0:1788843785.138122:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116632960 00000100:00100000:0.0:1788843785.138246:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 172 00000100:00100000:0.0:1788843785.138258:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0059e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f839db8-0699-423e-a998-0395c59fee9e+13:2387:x1875738116632960:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:0.0:1788843785.138347:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0059e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f839db8-0699-423e-a998-0395c59fee9e+13:2387:x1875738116632960:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 91us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843785.138355:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 172 00000100:00100000:0.0:1788843785.138390:0:19632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116633344 00000100:00100000:0.0:1788843785.138394:0:19632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116633344 00000100:00100000:0.0:1788843785.138431:0:19632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 28 00000100:00100000:0.0:1788843785.138438:0:19632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141b9f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6921b2ba-4cb8-4cf7-a5c0-1c37d97b5fd0+5:2387:x1875738116633344:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:0.0:1788843785.138465:0:19632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141b9f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6921b2ba-4cb8-4cf7-a5c0-1c37d97b5fd0+5:2387:x1875738116633344:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 28us (422us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843785.138492:0:19632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 28 00000100:00100000:3.0:1788843785.138616:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116633216 00000100:00100000:3.0:1788843785.138621:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116633216 00000100:00100000:3.0:1788843785.138663:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116633088 00000100:00100000:3.0:1788843785.138667:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116633088 00000100:00100000:3.0:1788843785.138688:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 83 00000100:00100000:3.0:1788843785.138696:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141b9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6921b2ba-4cb8-4cf7-a5c0-1c37d97b5fd0+5:2387:x1875738116633216:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:3.0:1788843785.138723:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141b9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6921b2ba-4cb8-4cf7-a5c0-1c37d97b5fd0+5:2387:x1875738116633216:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 30us (746us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843785.138729:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 83 00000100:00100000:3.0:1788843785.138741:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 84 00000100:00100000:3.0:1788843785.138747:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141b9d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6921b2ba-4cb8-4cf7-a5c0-1c37d97b5fd0+14:2387:x1875738116633088:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:3.0:1788843785.138779:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141b9d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6921b2ba-4cb8-4cf7-a5c0-1c37d97b5fd0+14:2387:x1875738116633088:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 32us (768us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843785.138785:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 84 00000100:00080000:1.0:1788843785.139818:0:17146:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788843785.139825:0:17146:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788843785.139828:0:17146:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788843785.151759:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1788843785.151803:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1788843785.151835:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1788843785.151868:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1788843785.151897:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1788843785.151937:0:18655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116633472 00000100:00100000:1.0:1788843785.151947:0:18655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116633472 00000100:00100000:1.0:1788843785.152006:0:18655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116633856 00000100:00100000:1.0:1788843785.152009:0:18655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116633856 00000100:00100000:1.0:1788843785.152027:0:18655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116633984 00000100:00100000:1.0:1788843785.152030:0:18655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116633984 00000100:00100000:1.0:1788843785.152045:0:18655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 27 00000100:00100000:1.0:1788843785.152055:0:18655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141b9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6921b2ba-4cb8-4cf7-a5c0-1c37d97b5fd0+5:2386:x1875738116633472:12345-192.168.203.33@tcp:9:kworker.0 00000020:00000080:1.0:1788843785.152103:0:18655:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa762dfcbd58d266a 00000100:00080000:1.0:1788843785.152120:0:18655:0:(import.c:65:import_set_state_nolock()) ffff9bd1074cf000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788843785.152214:0:18655:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:1.0:1788843785.152452:0:18655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141b9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6921b2ba-4cb8-4cf7-a5c0-1c37d97b5fd0+2:2386:x1875738116633472:12345-192.168.203.33@tcp:9:kworker.0 Request processed in 397us (700us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843785.152461:0:18655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 27 00000100:00100000:1.0:1788843785.152477:0:18655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 28 00000100:00100000:1.0:1788843785.152484:0:18655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141b9f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cd5af0cf-62ad-40c0-947c-f942bbf55123+5:2386:x1875738116633856:12345-192.168.203.33@tcp:9:kworker.0 00000020:00000080:1.0:1788843785.152498:0:18655:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa762dfcbd58d26a2 00000100:00080000:1.0:1788843785.152505:0:18655:0:(import.c:65:import_set_state_nolock()) ffff9bd12e2b3800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788843785.152527:0:18655:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934600 00000100:00100000:1.0:1788843785.152599:0:18655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141b9f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cd5af0cf-62ad-40c0-947c-f942bbf55123+2:2386:x1875738116633856:12345-192.168.203.33@tcp:9:kworker.0 Request processed in 115us (730us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843785.152605:0:18655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 28 00000100:00100000:1.0:1788843785.152617:0:18655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 29 00000100:00100000:1.0:1788843785.152624:0:18655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141b9ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cd5af0cf-62ad-40c0-947c-f942bbf55123+5:2386:x1875738116633984:12345-192.168.203.33@tcp:9:kworker.0 00000020:00000080:1.0:1788843785.152636:0:18655:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa762dfcbd58d26a9 00000100:00080000:1.0:1788843785.152640:0:18655:0:(import.c:65:import_set_state_nolock()) ffff9bd127b8e800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788843785.152661:0:18655:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:1.0:1788843785.152704:0:18655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141b9ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cd5af0cf-62ad-40c0-947c-f942bbf55123+2:2386:x1875738116633984:12345-192.168.203.33@tcp:9:kworker.0 Request processed in 81us (807us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843785.152711:0:18655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 29 00010000:00010000:1.0:1788843785.152732:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788843785.152740:0:17146:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788843785.152744:0:17146:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1788843785.153069:0:19636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788843785.153083:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116633600 00000100:00100000:3.0:1788843785.153089:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116633600 00000100:00100000:3.0:1788843785.153163:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116633728 00000100:00100000:3.0:1788843785.153167:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116633728 00000100:00100000:3.0:1788843785.153189:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 85 00000100:00100000:3.0:1788843785.153196:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141b9d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd5af0cf-62ad-40c0-947c-f942bbf55123+6:2387:x1875738116633600:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:3.0:1788843785.153230:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141b9d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd5af0cf-62ad-40c0-947c-f942bbf55123+6:2387:x1875738116633600:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 35us (1427us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843785.153237:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 85 00000100:00100000:3.0:1788843785.153259:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 86 00000100:00100000:3.0:1788843785.153265:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141b9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd5af0cf-62ad-40c0-947c-f942bbf55123+5:2388:x1875738116633728:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:3.0:1788843785.153287:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141b9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd5af0cf-62ad-40c0-947c-f942bbf55123+5:2388:x1875738116633728:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 23us (1452us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843785.153292:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 86 00010000:00010000:2.0:1788843785.153578:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788843785.153670:0:17146:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788843785.153680:0:17146:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788843785.564208:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788843786.586650:0:19636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788843787.619254:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788843787.980066:0:20527:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1d: Test Project ID with remote access ========================================================== 01:03:05 (1788843785) 00010000:00010000:3.0:1788843788.634940:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788843788.699816:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788843788.699845:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd120369f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1875738134541312:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788843788.699939:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843788.700013:0:17890:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134541312 00000100:00100000:3.0:1788843788.700021:0:17890:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134541312 00000100:00100000:3.0:1788843788.700072:0:17890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788843788.700083:0:17890:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd120369c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3633:x1875738134541312:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788843788.700127:0:17890:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:3.0:1788843788.700194:0:17890:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd120369c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3633:x1875738134541312:12345-0@lo:41:osp-pre-0-1.0 Request processed in 113us (254us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843788.700202:0:17890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788843788.700512:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd120369f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1875738134541312:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788843788.701576:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd13e878700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1875738134541440:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788843788.701639:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843788.704529:0:18659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134541440 00000100:00100000:0.0:1788843788.704548:0:18659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134541440 00000100:00100000:0.0:1788843788.704638:0:18659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788843788.704650:0:18659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd120369f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1875738134541440:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788843788.704690:0:18659:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 17886912 pending 0 free 3915857920 avail 3684335616 00000100:00100000:0.0:1788843788.704784:0:18659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd120369f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1875738134541440:12345-0@lo:13:osp-pre-0-1.0 Request processed in 136us (3143us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843788.704792:0:18659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788843788.704853:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd13e878700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1875738134541440:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1788843788.705051:0:17146:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:1.0:1788843788.716368:0:17130:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934623 is committed 00000020:00080000:1.0:1788843788.716389:0:17130:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4294967529 batchid updated 00000020:00080000:1.0:1788843788.716421:0:17188:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967529 00000020:00080000:1.0:1788843788.716433:0:17188:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967529 00000100:00100000:3.0:1788843789.212786:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd12036b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1875738134541568:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788843789.212884:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843789.212990:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134541568 00000100:00100000:3.0:1788843789.212997:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134541568 00000100:00100000:3.0:1788843789.213069:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788843789.213079:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd00723dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3630:x1875738134541568:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788843789.213122:0:17155:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788843789.213205:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd00723dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3630:x1875738134541568:12345-0@lo:41:osp-pre-1-0.0 Request processed in 126us (320us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843789.213212:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788843789.213532:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd12036b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1875738134541568:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1788843789.661517:0:19636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788843790.235585:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd127be2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1875738134542080:0@lo:400:kworker.0 00000100:00100000:0.0:1788843790.235791:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843790.235866:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd141ae1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1875738134542592:0@lo:400:kworker.0 00000100:00100000:0.0:1788843790.235888:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843790.235923:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd1074ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3630:1875738134543104:0@lo:400:kworker.0 00000100:00100000:0.0:1788843790.235946:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843790.236101:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:0.0:1788843790.236108:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd008625180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1875738134541696:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788843790.236135:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843790.236390:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd127be1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1875738134542208:0@lo:400:kworker.0 00000100:00100000:0.0:1788843790.236539:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843790.236735:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd141ae1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1875738134542720:0@lo:400:kworker.0 00000100:00100000:0.0:1788843790.236758:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843790.236773:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd1074fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3630:1875738134543232:0@lo:400:kworker.0 00000100:00100000:0.0:1788843790.236808:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843790.236846:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd127be1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1875738134541952:0@lo:400:kworker.0 00000100:00100000:0.0:1788843790.236883:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843790.236931:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007998e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1875738134542464:0@lo:400:kworker.0 00000100:00100000:3.0:1788843790.237077:0:18655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134542080 00000100:00100000:3.0:1788843790.237086:0:18655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134542080 00000100:00100000:3.0:1788843790.237166:0:18655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134542592 00000100:00100000:3.0:1788843790.237286:0:18655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134542592 00000100:00100000:3.0:1788843790.237371:0:18655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134542208 00000100:00100000:3.0:1788843790.237375:0:18655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134542208 00000100:00100000:3.0:1788843790.237389:0:18655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134542720 00000100:00100000:3.0:1788843790.237391:0:18655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134542720 00000100:00100000:3.0:1788843790.237407:0:18655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788843790.237482:0:18655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd13e878700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3630:x1875738134542080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788843790.237548:0:18655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd13e878700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3630:x1875738134542080:12345-0@lo:400:kworker.0 Request processed in 70us (1757us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843790.237555:0:18655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788843790.238270:0:18655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788843790.238282:0:18655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd13e87b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3630:x1875738134542592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788843790.239239:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843790.239557:0:18655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd13e87b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3630:x1875738134542592:12345-0@lo:400:kworker.0 Request processed in 1274us (3663us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843790.239569:0:18655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788843790.239599:0:18655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788843790.239609:0:18655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd13e87aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3630:x1875738134542208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788843790.239719:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd141ae0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3633:1875738134542976:0@lo:400:kworker.0 00000100:00100000:0.0:1788843790.239770:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843790.239803:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:0.0:1788843790.239811:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd12036b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:20b96c6c-8494-483a-b913-89dfc06b1440:3633:1875738134541824:0@lo:400:kworker.0 00000100:00100000:1.0:1788843790.239838:0:18656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788843790.239841:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843790.239851:0:18656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd13e87ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3630:x1875738134542720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788843790.239871:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd127be3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3633:1875738134542336:0@lo:400:kworker.0 00000100:00100000:1.0:1788843790.239906:0:18656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd13e87ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3630:x1875738134542720:12345-0@lo:400:kworker.0 Request processed in 59us (3145us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843790.239907:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843790.239911:0:18656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788843790.239922:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd141ae0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3633:1875738134542848:0@lo:400:kworker.0 00000100:00100000:0.0:1788843790.239943:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843790.239953:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd1074fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3633:1875738134543360:0@lo:400:kworker.0 00000100:00100000:1.0:1788843790.239972:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134541952 00000100:00100000:0.0:1788843790.239972:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843790.239980:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134541952 00000100:00100000:0.0:1788843790.239997:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134542464 00000100:00100000:0.0:1788843790.240000:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134542464 00000100:00100000:1.0:1788843790.240021:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788843790.240118:0:19944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134543104 00000100:00100000:2.0:1788843790.240122:0:19944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134543104 00000100:00100000:2.0:1788843790.240170:0:19944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134543232 00000100:00100000:2.0:1788843790.240173:0:19944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134543232 00000100:00100000:2.0:1788843790.240188:0:19944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134542976 00000100:00100000:2.0:1788843790.240190:0:19944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134542976 00000100:00100000:2.0:1788843790.240216:0:19944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134542336 00000100:00100000:2.0:1788843790.240219:0:19944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134542336 00000100:00100000:2.0:1788843790.240230:0:19944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134542848 00000100:00100000:2.0:1788843790.240233:0:19944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134542848 00000100:00100000:2.0:1788843790.240243:0:19944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134543360 00000100:00100000:2.0:1788843790.240245:0:19944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134543360 00000100:00100000:2.0:1788843790.240259:0:19944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1788843790.240266:0:18655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd13e87aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3630:x1875738134542208:12345-0@lo:400:kworker.0 Request processed in 661us (3728us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843790.240266:0:19944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd13e87a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3630:x1875738134543104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788843790.240273:0:18655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:3.0:1788843790.240294:0:17146:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788843790.240298:0:17146:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788843790.240301:0:17146:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788843790.240303:0:17146:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788843790.240306:0:19944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd13e87a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3630:x1875738134543104:12345-0@lo:400:kworker.0 Request processed in 41us (4359us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843790.240312:0:19944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788843790.240325:0:19944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788843790.240331:0:19944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141b6a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3630:x1875738134543232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788843790.240359:0:19944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141b6a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3630:x1875738134543232:12345-0@lo:400:kworker.0 Request processed in 29us (3549us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843790.240377:0:19944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788843790.240390:0:19944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788843790.240396:0:19944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f960e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3633:x1875738134542976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788843790.240429:0:19944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f960e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3633:x1875738134542976:12345-0@lo:400:kworker.0 Request processed in 34us (659us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843790.240435:0:19944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788843790.240447:0:19944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1788843790.240453:0:19944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f961500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3633:x1875738134542336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788843790.240479:0:19944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f961500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3633:x1875738134542336:12345-0@lo:400:kworker.0 Request processed in 27us (571us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843790.240484:0:19944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1788843790.240495:0:19944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1788843790.240501:0:19944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f961f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3633:x1875738134542848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788843790.240527:0:19944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f961f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3633:x1875738134542848:12345-0@lo:400:kworker.0 Request processed in 26us (583us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843790.240532:0:19944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1788843790.240542:0:19944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788843790.240549:0:19944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f960a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3633:x1875738134543360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788843790.240574:0:19944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f960a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3633:x1875738134543360:12345-0@lo:400:kworker.0 Request processed in 27us (602us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843790.240579:0:19944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788843790.240667:0:3631:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788843790.240676:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f8d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1875738134543616:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788843790.240707:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843790.240748:0:18659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134541696 00000100:00100000:2.0:1788843790.240754:0:18659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134541696 00000100:00100000:2.0:1788843790.240780:0:18659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134543616 00000100:00100000:2.0:1788843790.240783:0:18659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134543616 00000100:00100000:2.0:1788843790.240796:0:18659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788843790.240799:0:3632:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788843790.240802:0:18659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd13e879880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3630:x1875738134541696:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788843790.240808:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f8d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1875738134543488:0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788843790.240825:0:18659:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1788843790.240838:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843790.240858:0:18659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd13e879880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3630:x1875738134541696:12345-0@lo:13:osp-pre-1-1.0 Request processed in 57us (4722us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843790.240865:0:18659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788843790.240875:0:18659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134543488 00000100:00100000:2.0:1788843790.240879:0:18659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134543488 00000100:00100000:0.0:1788843790.241091:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788843790.241103:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f962a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3633:x1875738134542464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788843790.241162:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f962a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3633:x1875738134542464:12345-0@lo:400:kworker.0 Request processed in 62us (4207us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843790.241178:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788843790.241206:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134541824 00000100:00100000:0.0:1788843790.241210:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134541824 00000100:00100000:0.0:1788843790.241246:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1788843790.241252:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0059e3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20b96c6c-8494-483a-b913-89dfc06b1440+24:3633:x1875738134541824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788843790.241285:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0059e3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20b96c6c-8494-483a-b913-89dfc06b1440+24:3633:x1875738134541824:12345-0@lo:400:kworker.0 Request processed in 33us (1442us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843790.241291:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1788843790.241367:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd008625180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1875738134541696:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788843790.241380:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd127be1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1875738134542208:0@lo:400:kworker.0 00000100:00100000:0.0:1788843790.241390:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd141ae1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1875738134542720:0@lo:400:kworker.0 00000100:00100000:0.0:1788843790.241402:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd1074fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3630:1875738134543232:0@lo:400:kworker.0 00000100:00100000:0.0:1788843790.241423:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd127be2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1875738134542080:0@lo:400:kworker.0 00000100:00100000:0.0:1788843790.241437:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd141ae1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1875738134542592:0@lo:400:kworker.0 00010000:00080000:0.0:1788843790.241451:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd1074ff100 x1875738134543104/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843806 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788843790.241463:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd1074ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3630:1875738134543104:0@lo:400:kworker.0 00000100:00100000:0.0:1788843790.241511:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd12036b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:20b96c6c-8494-483a-b913-89dfc06b1440:3633:1875738134541824:0@lo:400:kworker.0 00000100:00100000:0.0:1788843790.241522:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd127be3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3633:1875738134542336:0@lo:400:kworker.0 00000100:00100000:0.0:1788843790.241532:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd141ae0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3633:1875738134542848:0@lo:400:kworker.0 00010000:00080000:0.0:1788843790.241543:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd1074fd180 x1875738134543360/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843806 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788843790.241552:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd1074fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3633:1875738134543360:0@lo:400:kworker.0 00000100:00100000:1.0:1788843790.241603:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f961180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3633:x1875738134541952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843790.241648:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f961180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3633:x1875738134541952:12345-0@lo:400:kworker.0 Request processed in 1620us (4763us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843790.241654:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788843790.241687:0:19943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788843790.241697:0:19943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f8d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3631:x1875738134543616:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788843790.241716:0:19943:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 17886912 pending 0 free 3915857920 avail 3684335616 00000100:00100000:1.0:1788843790.241754:0:19943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f8d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3631:x1875738134543616:12345-0@lo:13:osp-pre-0-0.0 Request processed in 59us (1046us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843790.241761:0:19943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788843790.241775:0:19943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788843790.241780:0:19943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1074fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3632:x1875738134543488:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788843790.241791:0:19943:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788843790.241834:0:19943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1074fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3632:x1875738134543488:12345-0@lo:13:osp-pre-1-0.0 Request processed in 54us (995us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843790.241840:0:19943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788843790.241881:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f8d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1875738134543488:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788843790.241954:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f8d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1875738134543616:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788843790.242219:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd127be1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1875738134541952:0@lo:400:kworker.0 00000100:00100000:0.0:1788843790.242231:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007998e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1875738134542464:0@lo:400:kworker.0 00000100:00100000:0.0:1788843790.242243:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd141ae0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3633:1875738134542976:0@lo:400:kworker.0 00000100:00100000:1.0:1788843790.253557:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1788843790.253614:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1788843790.253644:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1788843790.253673:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1788843790.253698:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1788843790.253724:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1788843790.253755:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116634368 00000100:00100000:1.0:1788843790.253767:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116634368 00000100:00100000:1.0:1788843790.253831:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116634624 00000100:00100000:1.0:1788843790.253835:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116634624 00000100:00100000:1.0:1788843790.253858:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116634240 00000100:00100000:1.0:1788843790.253861:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116634240 00000100:00100000:1.0:1788843790.253901:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116634752 00000100:00100000:1.0:1788843790.253906:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116634752 00000100:00100000:0.0:1788843790.253906:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116634112 00000100:00100000:0.0:1788843790.253923:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116634112 00000100:00100000:1.0:1788843790.253933:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 93 00000100:00100000:1.0:1788843790.253950:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd008624e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6921b2ba-4cb8-4cf7-a5c0-1c37d97b5fd0+5:2389:x1875738116634368:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:0.0:1788843790.254002:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 174 00000100:00100000:0.0:1788843790.254016:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0059e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f839db8-0699-423e-a998-0395c59fee9e+13:2389:x1875738116634112:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:1.0:1788843790.254042:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd008624e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6921b2ba-4cb8-4cf7-a5c0-1c37d97b5fd0+5:2389:x1875738116634368:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 96us (434us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843790.254052:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 93 00000100:00100000:1.0:1788843790.254077:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 94 00000100:00100000:1.0:1788843790.254088:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd008627480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd5af0cf-62ad-40c0-947c-f942bbf55123+6:2389:x1875738116634624:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:0.0:1788843790.254095:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0059e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f839db8-0699-423e-a998-0395c59fee9e+13:2389:x1875738116634112:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 79us (544us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843790.254107:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 174 00000100:00100000:1.0:1788843790.254188:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd008627480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd5af0cf-62ad-40c0-947c-f942bbf55123+6:2389:x1875738116634624:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 102us (542us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843790.254212:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 94 00000100:00100000:1.0:1788843790.254229:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 95 00000100:00100000:1.0:1788843790.254235:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd008626d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6921b2ba-4cb8-4cf7-a5c0-1c37d97b5fd0+13:2389:x1875738116634240:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:1.0:1788843790.254264:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd008626d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6921b2ba-4cb8-4cf7-a5c0-1c37d97b5fd0+13:2389:x1875738116634240:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 29us (589us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843790.254270:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 95 00000100:00100000:1.0:1788843790.254281:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 96 00000100:00100000:1.0:1788843790.254288:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd008624700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd5af0cf-62ad-40c0-947c-f942bbf55123+5:2389:x1875738116634752:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:1.0:1788843790.254311:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd008624700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd5af0cf-62ad-40c0-947c-f942bbf55123+5:2389:x1875738116634752:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 24us (586us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843790.254318:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 96 00000100:00100000:2.0:1788843790.254429:0:18656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116634496 00000100:00100000:2.0:1788843790.254437:0:18656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116634496 00000100:00100000:2.0:1788843790.254507:0:18656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 33 00000100:00100000:2.0:1788843790.254521:0:18656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd008625500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6921b2ba-4cb8-4cf7-a5c0-1c37d97b5fd0+5:2389:x1875738116634496:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:2.0:1788843790.254584:0:18656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd008625500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6921b2ba-4cb8-4cf7-a5c0-1c37d97b5fd0+5:2389:x1875738116634496:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 67us (883us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843790.254596:0:18656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 33 00000100:00080000:3.0:1788843790.255073:0:17146:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788843790.255080:0:17146:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788843790.255083:0:17146:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000040:00080000:3.0:1788843790.362394:0:17185:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788843790.362405:0:17185:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788843790.362427:0:17185:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1788843790.362436:0:17185:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:2.0:1788843790.683650:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788843790.748680:0:19469:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of cd5af0cf-62ad-40c0-947c-f942bbf55123 00000020:00000080:1.0:1788843790.748692:0:19469:0:(genops.c:885:class_export_put()) final put ffff9bd127b88000/cd5af0cf-62ad-40c0-947c-f942bbf55123 00000001:00100000:1.0:1788843790.748720:0:19469:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 6921b2ba-4cb8-4cf7-a5c0-1c37d97b5fd0 00000020:00000080:1.0:1788843790.748722:0:19469:0:(genops.c:885:class_export_put()) final put ffff9bd1074ca000/6921b2ba-4cb8-4cf7-a5c0-1c37d97b5fd0 00000020:00000080:3.0:1788843790.748767:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd127b88000/cd5af0cf-62ad-40c0-947c-f942bbf55123 for lustre-OST0001 00000020:00000080:3.0:1788843790.749011:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd1074ca000/6921b2ba-4cb8-4cf7-a5c0-1c37d97b5fd0 for lustre-OST0001 00000020:00000080:3.0:1788843790.749432:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9bd127b8e800 for lustre-OST0001 00000020:00000080:3.0:1788843790.749440:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9bd1074cf000 for lustre-OST0001 00000001:00100000:0.0:1788843790.749560:0:18651:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of cd5af0cf-62ad-40c0-947c-f942bbf55123 00000020:00000080:0.0:1788843790.749566:0:18651:0:(genops.c:885:class_export_put()) final put ffff9bd12e2b2800/cd5af0cf-62ad-40c0-947c-f942bbf55123 00000020:00000080:3.0:1788843790.750511:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd12e2b2800/cd5af0cf-62ad-40c0-947c-f942bbf55123 for lustre-OST0000 00000020:00000080:3.0:1788843790.750566:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9bd12e2b3800 for lustre-OST0000 00010000:00010000:3.0:1788843791.707604:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788843791.832402:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843791.832505:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116635008 00000100:00100000:3.0:1788843791.832516:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116635008 00000100:00100000:3.0:1788843791.832582:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 13 00000100:00100000:3.0:1788843791.832594:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd008625180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6921b2ba-4cb8-4cf7-a5c0-1c37d97b5fd0+13:16346:x1875738116635008:12345-192.168.203.33@tcp:35:umount.0 00000001:00080000:3.0:1788843791.832828:0:17152:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934624 00000001:00080000:3.0:1788843791.832926:0:17152:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934625 00000100:00100000:3.0:1788843791.833054:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd008625180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6921b2ba-4cb8-4cf7-a5c0-1c37d97b5fd0+16:16346:x1875738116635008:12345-192.168.203.33@tcp:35:umount.0 Request processed in 462us (662us total) trans 8589934626 rc 0/0 00000100:00100000:3.0:1788843791.833062:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 13 00000020:00080000:3.0:1788843791.833067:0:17152:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:1.0:1788843791.838023:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1788843791.838067:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1788843791.838098:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843791.838186:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116635136 00000100:00100000:3.0:1788843791.838198:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116635136 00000100:00100000:3.0:1788843791.838252:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116635392 00000100:00100000:3.0:1788843791.838255:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116635392 00000100:00100000:3.0:1788843791.838269:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116635264 00000100:00100000:3.0:1788843791.838271:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116635264 00000100:00100000:3.0:1788843791.838288:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 3 00000100:00100000:3.0:1788843791.838298:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141ae8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6f839db8-0699-423e-a998-0395c59fee9e+15:2387:x1875738116635136:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788843791.838316:0:17135:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788843791.838353:0:17135:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd100030a00/0xa762dfcbd58d2640 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490c99 expref: 15 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843791.838373:0:17135:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788843791.838437:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141ae8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6f839db8-0699-423e-a998-0395c59fee9e+14:2387:x1875738116635136:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 140us (424us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843791.838458:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 3 00000100:00100000:3.0:1788843791.838478:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 4 00000100:00100000:3.0:1788843791.838484:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0013ab450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6f839db8-0699-423e-a998-0395c59fee9e+13:2387:x1875738116635392:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788843791.838493:0:17135:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788843791.838503:0:17135:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd1420e4800/0xa762dfcbd58d26cc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490d80 expref: 13 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843791.838531:0:17135:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788843791.838551:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0013ab450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6f839db8-0699-423e-a998-0395c59fee9e+12:2387:x1875738116635392:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 67us (484us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843791.838557:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 4 00000100:00100000:3.0:1788843791.838595:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 5 00000100:00100000:3.0:1788843791.838602:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141ae8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6f839db8-0699-423e-a998-0395c59fee9e+11:2387:x1875738116635264:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788843791.838610:0:17135:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788843791.838619:0:17135:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd100031600/0xa762dfcbd58d2647 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490cca expref: 11 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843791.838629:0:17135:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788843791.838646:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141ae8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6f839db8-0699-423e-a998-0395c59fee9e+10:2387:x1875738116635264:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 45us (547us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843791.838653:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 5 00000100:00100000:2.0:1788843791.841406:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1788843791.841570:0:18654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116635520 00000100:00100000:1.0:1788843791.841582:0:18654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116635520 00000100:00100000:1.0:1788843791.841643:0:18654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 30 00000100:00100000:1.0:1788843791.841655:0:18654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f8d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6921b2ba-4cb8-4cf7-a5c0-1c37d97b5fd0+5:2386:x1875738116635520:12345-192.168.203.33@tcp:9:umount.0 00000020:00000080:1.0:1788843791.841693:0:18654:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa762dfcbd58d2663 00000100:00080000:1.0:1788843791.841715:0:18654:0:(import.c:65:import_set_state_nolock()) ffff9bd006521000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788843791.841777:0:18654:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934600 00000100:00100000:1.0:1788843791.841948:0:18654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f8d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6921b2ba-4cb8-4cf7-a5c0-1c37d97b5fd0+2:2386:x1875738116635520:12345-192.168.203.33@tcp:9:umount.0 Request processed in 295us (549us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843791.841956:0:18654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 30 00010000:00010000:3.0:1788843791.843492:0:19636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788843791.853886:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843791.854088:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116636416 00000100:00100000:2.0:1788843791.854101:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116636416 00000100:00100000:2.0:1788843791.854210:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 67 00000100:00100000:2.0:1788843791.854221:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141ae8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6921b2ba-4cb8-4cf7-a5c0-1c37d97b5fd0+16:2386:x1875738116636416:12345-192.168.203.33@tcp:39:umount.0 00000020:00000080:2.0:1788843791.854258:0:17151:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa762dfcbd58d2655 00000020:00010000:2.0:1788843791.854275:0:17151:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9bd1074cc800: total 0 00000100:00080000:2.0:1788843791.854280:0:17151:0:(import.c:65:import_set_state_nolock()) ffff9bd1074c8800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788843791.854322:0:17151:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934626 00000100:00100000:2.0:1788843791.854507:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141ae8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6921b2ba-4cb8-4cf7-a5c0-1c37d97b5fd0+15:2386:x1875738116636416:12345-192.168.203.33@tcp:39:umount.0 Request processed in 287us (651us total) trans 8589934627 rc 0/0 00000100:00100000:2.0:1788843791.854515:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 67 00000020:00010000:3.0:1788843791.855334:0:17138:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9bd1074cc800: total 0 00010000:00010000:3.0:1788843791.855405:0:17138:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9bd1074cc800, canceled 0 locks, left on hash table 8. 00010000:00010000:3.0:1788843791.855442:0:17138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9bd0071deb00) 00010000:00010000:3.0:1788843791.855446:0:17138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788843791.855467:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10f7af400/0xa762dfcbd58d2720 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490d87 expref: 14 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843791.855495:0:17138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9bd1420eed00) 00010000:00010000:3.0:1788843791.855498:0:17138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788843791.855502:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c600/0xa762dfcbd58d2800 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490dc6 expref: 13 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843791.855536:0:17138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9bd105fa2a00) 00010000:00010000:3.0:1788843791.855538:0:17138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788843791.855543:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d800/0xa762dfcbd58d28af lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490e05 expref: 12 pid: 19944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843791.855568:0:17138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9bd105fa2a00) 00010000:00010000:3.0:1788843791.855570:0:17138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788843791.855574:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3cc00/0xa762dfcbd58d287e lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490df0 expref: 11 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843791.855585:0:17138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9bd105fa2a00) 00010000:00010000:3.0:1788843791.855588:0:17138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788843791.855591:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f71000/0xa762dfcbd58d296c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490e3d expref: 10 pid: 19944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843791.855607:0:17138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9bd1420eee00) 00010000:00010000:3.0:1788843791.855610:0:17138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788843791.855614:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946000/0xa762dfcbd58d273c lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490d8e expref: 9 pid: 19944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843791.855629:0:17138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bd105fa2200) 00010000:00010000:3.0:1788843791.855631:0:17138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788843791.855635:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd100030e00/0xa762dfcbd58d277b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490d9c expref: 8 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843791.855649:0:17138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9bd105fa2000) 00010000:00010000:3.0:1788843791.855651:0:17138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788843791.855662:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd1153e6c00/0xa762dfcbd58d290a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490e1a expref: 7 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843791.855676:0:17138:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9bd1074cc800, canceled 8 locks, left on hash table 0. 00010000:00010000:3.0:1788843791.855690:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788843791.855693:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788843791.855695:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788843791.868819:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843791.869027:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116636544 00000100:00100000:2.0:1788843791.869038:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116636544 00000100:00100000:2.0:1788843791.869110:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 68 00000100:00100000:2.0:1788843791.869329:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007ac8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6921b2ba-4cb8-4cf7-a5c0-1c37d97b5fd0+5:2386:x1875738116636544:12345-192.168.203.33@tcp:39:umount.0 00000020:00000080:2.0:1788843791.869519:0:17149:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa762dfcbd58d265c 00000100:00080000:2.0:1788843791.869540:0:17149:0:(import.c:65:import_set_state_nolock()) ffff9bd1074cc000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788843791.869732:0:17149:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000100:00100000:2.0:1788843791.870203:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007ac8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6921b2ba-4cb8-4cf7-a5c0-1c37d97b5fd0+3:2386:x1875738116636544:12345-192.168.203.33@tcp:39:umount.0 Request processed in 1079us (1393us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1788843791.870215:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 68 00010000:00010000:3.0:1788843791.870404:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788843792.731061:0:19636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788843793.754379:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788843793.819074:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd1074fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1875738134543744:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788843793.819194:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843793.819343:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134543744 00000100:00100000:2.0:1788843793.819352:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134543744 00000100:00100000:2.0:1788843793.819408:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788843793.819419:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007ac9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3631:x1875738134543744:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788843793.819461:0:17155:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446293504 avail 1300054016 00000100:00100000:2.0:1788843793.819527:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007ac9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3631:x1875738134543744:12345-0@lo:41:osp-pre-0-1.0 Request processed in 109us (332us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843793.819534:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788843793.819580:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd1074fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1875738134543744:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788843793.820090:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f8d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1875738134543872:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788843793.820137:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843793.820274:0:18657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134543872 00000100:00100000:2.0:1788843793.820280:0:18657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134543872 00000100:00100000:2.0:1788843793.820333:0:18657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788843793.820341:0:18657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007ac8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3632:x1875738134543872:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788843793.820393:0:18657:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915857920 avail 3684335616 00000100:00100000:2.0:1788843793.820430:0:18657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007ac8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3632:x1875738134543872:12345-0@lo:13:osp-pre-0-1.0 Request processed in 89us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843793.820437:0:18657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788843793.820936:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f8d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1875738134543872:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1788843793.821349:0:17146:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788843794.010063:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1788843794.010112:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1788843794.010200:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1788843794.011283:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116636800 00000100:00100000:0.0:1788843794.011300:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116636800 00000100:00100000:0.0:1788843794.011366:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116636672 00000100:00100000:0.0:1788843794.011370:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116636672 00000100:00100000:0.0:1788843794.011384:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116636928 00000100:00100000:0.0:1788843794.011387:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116636928 00000100:00100000:0.0:1788843794.011406:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 6 00000100:00100000:0.0:1788843794.011417:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007acaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6f839db8-0699-423e-a998-0395c59fee9e+12:2390:x1875738116636800:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788843794.011436:0:17136:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788843794.011462:0:17136:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd100031400/0xa762dfcbd58d2686 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490d3a expref: 12 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843794.011485:0:17136:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788843794.011578:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007acaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6f839db8-0699-423e-a998-0395c59fee9e+11:2390:x1875738116636800:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 161us (1529us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843794.011587:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 6 00000100:00100000:0.0:1788843794.011608:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7 00000100:00100000:0.0:1788843794.011615:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007ac9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6f839db8-0699-423e-a998-0395c59fee9e+10:2390:x1875738116636672:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788843794.011624:0:17136:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788843794.011635:0:17136:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd1420e5a00/0xa762dfcbd58d267f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490d09 expref: 10 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843794.011646:0:17136:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788843794.011665:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007ac9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6f839db8-0699-423e-a998-0395c59fee9e+9:2390:x1875738116636672:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 50us (1553us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843794.011671:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7 00000100:00100000:0.0:1788843794.011683:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 8 00000100:00100000:0.0:1788843794.011690:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0079b8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6f839db8-0699-423e-a998-0395c59fee9e+8:2390:x1875738116636928:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788843794.011699:0:17136:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788843794.011709:0:17136:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd1420e4200/0xa762dfcbd58d26c5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490d79 expref: 8 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843794.011720:0:17136:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788843794.011769:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0079b8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6f839db8-0699-423e-a998-0395c59fee9e+7:2390:x1875738116636928:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 79us (1569us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843794.011776:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 8 00000040:00080000:3.0:1788843794.014385:0:17908:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788843794.048297:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843794.048461:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116637184 00000100:00100000:2.0:1788843794.048471:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116637184 00000100:00100000:2.0:1788843794.048618:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 69 00000100:00100000:2.0:1788843794.048631:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0079ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd5af0cf-62ad-40c0-947c-f942bbf55123+6:2386:x1875738116637184:12345-192.168.203.33@tcp:39:umount.0 00000020:00000080:2.0:1788843794.048679:0:17151:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa762dfcbd58d2694 00000020:00010000:2.0:1788843794.048687:0:17151:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9bd006523800: total 0 00000100:00080000:2.0:1788843794.048692:0:17151:0:(import.c:65:import_set_state_nolock()) ffff9bd006526000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788843794.048736:0:17151:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934627 00000100:00100000:2.0:1788843794.048912:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0079ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd5af0cf-62ad-40c0-947c-f942bbf55123+5:2386:x1875738116637184:12345-192.168.203.33@tcp:39:umount.0 Request processed in 283us (626us total) trans 8589934628 rc 0/0 00000100:00100000:2.0:1788843794.048919:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 69 00000020:00010000:1.0:1788843794.048972:0:17139:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9bd006523800: total 0 00010000:00010000:1.0:1788843794.048977:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843794.049039:0:17139:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9bd006523800, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1788843794.049077:0:17139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bd105fa2200) 00010000:00010000:1.0:1788843794.049081:0:17139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788843794.049088:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c200/0xa762dfcbd58d2789 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490da3 expref: 4 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843794.049117:0:17139:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9bd006523800, canceled 1 locks, left on hash table 0. 00010000:00010000:1.0:1788843794.049126:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843794.049128:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843794.049200:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788843794.049301:0:17146:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788843794.072493:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843794.073095:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116637312 00000100:00100000:3.0:1788843794.073108:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116637312 00000100:00100000:3.0:1788843794.073245:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 70 00000100:00100000:3.0:1788843794.073259:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0079b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cd5af0cf-62ad-40c0-947c-f942bbf55123+5:2386:x1875738116637312:12345-192.168.203.33@tcp:39:umount.0 00000020:00000080:3.0:1788843794.073308:0:17150:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa762dfcbd58d269b 00000100:00080000:3.0:1788843794.073320:0:17150:0:(import.c:65:import_set_state_nolock()) ffff9bd006526800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788843794.073348:0:17150:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934593 00000100:00100000:3.0:1788843794.073545:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0079b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cd5af0cf-62ad-40c0-947c-f942bbf55123+3:2386:x1875738116637312:12345-192.168.203.33@tcp:39:umount.0 Request processed in 277us (1054us total) trans 8589934594 rc 0/0 00000100:00100000:3.0:1788843794.073553:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 70 00000100:00080000:0.0:1788843794.074255:0:17146:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:1.0:1788843794.074339:0:19636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788843794.133780:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1788843794.133976:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116637568 00000100:00100000:0.0:1788843794.133988:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116637568 00000100:00100000:0.0:1788843794.134070:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 175 00000100:00100000:0.0:1788843794.134105:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0059e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f839db8-0699-423e-a998-0395c59fee9e+7:2386:x1875738116637568:12345-192.168.203.33@tcp:251:umount.0 00000020:00000080:0.0:1788843794.134209:0:17144:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa762dfcbd58d2632 00000020:00010000:0.0:1788843794.134219:0:17144:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9bd006630000: total 0 00000100:00080000:0.0:1788843794.134224:0:17144:0:(import.c:65:import_set_state_nolock()) ffff9bd006630800 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1788843794.134305:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0059e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f839db8-0699-423e-a998-0395c59fee9e+3:2386:x1875738116637568:12345-192.168.203.33@tcp:251:umount.0 Request processed in 202us (543us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843794.134314:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 175 00000020:00010000:3.0:1788843794.135190:0:17138:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9bd006630000: total 0 00010000:00010000:3.0:1788843794.135263:0:17138:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9bd006630000, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1788843794.135302:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd1420e4600/0xa762dfcbd58d2639 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490c92 expref: 2 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843794.135340:0:17138:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9bd006630000, canceled 1 locks, left on hash table 0. 00000020:00000080:3.0:1788843794.135351:0:17138:0:(genops.c:885:class_export_put()) final put ffff9bd006630000/6f839db8-0699-423e-a998-0395c59fee9e 00010000:00010000:3.0:1788843794.135429:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788843794.135433:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788843794.135435:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788843794.137426:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd006630000/6f839db8-0699-423e-a998-0395c59fee9e for MGS 00000020:00000080:0.0:1788843794.137514:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9bd006630800 for MGS 00000100:00100000:1.0:1788843794.330506:0:3632:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788843794.330536:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd1074fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1875738134544000:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788843794.330641:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843794.330969:0:17890:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134544000 00000100:00100000:3.0:1788843794.330979:0:17890:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134544000 00000100:00100000:3.0:1788843794.331039:0:17890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788843794.331049:0:17890:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0079bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3632:x1875738134544000:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788843794.331092:0:17890:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788843794.331191:0:17890:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0079bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3632:x1875738134544000:12345-0@lo:41:osp-pre-1-0.0 Request processed in 143us (550us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843794.331199:0:17890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788843794.331415:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd1074fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1875738134544000:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1788843794.779571:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788843795.355580:0:3631:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788843795.355608:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd1074fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1875738134544128:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788843795.355694:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843795.355773:0:19943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134544128 00000100:00100000:3.0:1788843795.355781:0:19943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134544128 00000100:00100000:3.0:1788843795.355840:0:19943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788843795.355851:0:19943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1074fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3631:x1875738134544128:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788843795.355901:0:19943:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1788843795.355947:0:19943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1074fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3631:x1875738134544128:12345-0@lo:13:osp-pre-1-0.0 Request processed in 98us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843795.355955:0:19943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788843795.356007:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd1074fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1875738134544128:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788843795.356304:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f963480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3630:1875738134544640:0@lo:400:kworker.0 00000100:00100000:0.0:1788843795.356421:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843795.356448:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f961c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3630:1875738134545152:0@lo:400:kworker.0 00000100:00100000:0.0:1788843795.356472:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843795.356491:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f962300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3630:1875738134545664:0@lo:400:kworker.0 00000100:00100000:0.0:1788843795.356514:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843795.357498:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1788843795.357513:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f962680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:20b96c6c-8494-483a-b913-89dfc06b1440:3630:1875738134544256:0@lo:400:kworker.0 00000100:00100000:0.0:1788843795.357647:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843795.357690:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f961880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1875738134544768:0@lo:400:kworker.0 00000100:00100000:0.0:1788843795.357722:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843795.357745:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f962d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3630:1875738134545280:0@lo:400:kworker.0 00000100:00100000:0.0:1788843795.357769:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788843795.357807:0:17146:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788843795.357823:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f960380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1875738134544384:0@lo:400:kworker.0 00000100:00100000:0.0:1788843795.357851:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843795.357910:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f960000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1875738134544896:0@lo:400:kworker.0 00000100:00100000:0.0:1788843795.357937:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843795.357955:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f960700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3632:1875738134545408:0@lo:400:kworker.0 00000100:00100000:0.0:1788843795.357976:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843795.357992:0:3632:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1788843795.357999:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f963800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1875738134544512:0@lo:400:kworker.0 00000100:00100000:0.0:1788843795.358020:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843795.358040:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f963b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1875738134545024:0@lo:400:kworker.0 00000100:00100000:0.0:1788843795.358063:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843795.358082:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f963100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3632:1875738134545536:0@lo:400:kworker.0 00000100:00100000:0.0:1788843795.358124:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843795.358177:0:19944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134544640 00000100:00100000:0.0:1788843795.358186:0:19944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134544640 00000100:00100000:0.0:1788843795.358228:0:19944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134545152 00000100:00100000:0.0:1788843795.358231:0:19944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134545152 00000100:00100000:0.0:1788843795.358244:0:19944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134545664 00000100:00100000:0.0:1788843795.358247:0:19944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134545664 00000100:00100000:0.0:1788843795.358272:0:19944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134545280 00000100:00100000:0.0:1788843795.358275:0:19944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134545280 00000100:00100000:0.0:1788843795.358287:0:19944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134545408 00000100:00100000:0.0:1788843795.358289:0:19944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134545408 00000100:00100000:0.0:1788843795.358302:0:19944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134545536 00000100:00100000:0.0:1788843795.358304:0:19944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134545536 00000100:00100000:0.0:1788843795.358319:0:19944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1788843795.359400:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1788843795.359427:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd12036b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3630:x1875738134545152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788843795.359512:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd12036b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3630:x1875738134545152:12345-0@lo:400:kworker.0 Request processed in 90us (3038us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843795.359519:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1788843795.359558:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1788843795.359566:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141ae0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3630:x1875738134545664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788843795.359600:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141ae0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3630:x1875738134545664:12345-0@lo:400:kworker.0 Request processed in 35us (3086us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843795.359606:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1788843795.359619:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1788843795.359626:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141ae1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3630:x1875738134545280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788843795.359654:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141ae1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3630:x1875738134545280:12345-0@lo:400:kworker.0 Request processed in 30us (1884us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843795.359659:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1788843795.359671:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1788843795.359676:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd127be3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3632:x1875738134545408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788843795.359704:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd127be3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3632:x1875738134545408:12345-0@lo:400:kworker.0 Request processed in 28us (1727us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843795.359709:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1788843795.359722:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1788843795.359729:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f956a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3632:x1875738134545536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788843795.359755:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f956a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3632:x1875738134545536:12345-0@lo:400:kworker.0 Request processed in 27us (1631us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843795.359761:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1788843795.359783:0:18655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134544896 00000100:00100000:3.0:1788843795.359797:0:18655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134544896 00000100:00100000:3.0:1788843795.359843:0:18655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134544512 00000100:00100000:3.0:1788843795.359846:0:18655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134544512 00000100:00100000:3.0:1788843795.359877:0:18655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134545024 00000100:00100000:3.0:1788843795.359880:0:18655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134545024 00000100:00100000:3.0:1788843795.359898:0:18655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788843795.359903:0:18655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd127be1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3632:x1875738134544896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788843795.359939:0:18655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd127be1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3632:x1875738134544896:12345-0@lo:400:kworker.0 Request processed in 36us (2000us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843795.359945:0:18655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788843795.359956:0:18655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788843795.359962:0:18655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd127be2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3632:x1875738134544512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788843795.359990:0:18655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd127be2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3632:x1875738134544512:12345-0@lo:400:kworker.0 Request processed in 28us (1969us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843795.359995:0:18655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788843795.360005:0:18655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788843795.360011:0:18655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd127be1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3632:x1875738134545024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788843795.360038:0:18655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd127be1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3632:x1875738134545024:12345-0@lo:400:kworker.0 Request processed in 28us (1975us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843795.360043:0:18655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788843795.360067:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788843795.360081:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd1074fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1875738134545920:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788843795.360120:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843795.360200:0:18659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134545920 00000100:00100000:3.0:1788843795.360205:0:18659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134545920 00000100:00100000:3.0:1788843795.360229:0:18659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788843795.360236:0:18659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1074fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1875738134545920:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788843795.360260:0:18659:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1788843795.360296:0:18659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1074fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1875738134545920:12345-0@lo:13:osp-pre-1-1.0 Request processed in 61us (176us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843795.360303:0:18659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788843795.360344:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd1074fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1875738134545920:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788843795.363132:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f963800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1875738134544512:0@lo:400:kworker.0 00000100:00100000:1.0:1788843795.363179:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f963b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1875738134545024:0@lo:400:kworker.0 00000100:00100000:1.0:1788843795.363192:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f963100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3632:1875738134545536:0@lo:400:kworker.0 00000100:00100000:1.0:1788843795.363207:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f960000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1875738134544896:0@lo:400:kworker.0 00010000:00080000:1.0:1788843795.363225:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd10f960700 x1875738134545408/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843811 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788843795.363237:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f960700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3632:1875738134545408:0@lo:400:kworker.0 00000100:00100000:0.0:1788843795.364232:0:19944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007998e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3630:x1875738134544640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788843795.364360:0:19944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007998e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3630:x1875738134544640:12345-0@lo:400:kworker.0 Request processed in 6030us (7936us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843795.364371:0:19944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788843795.364449:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134544256 00000100:00100000:0.0:1788843795.364457:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134544256 00000100:00100000:0.0:1788843795.364514:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1788843795.364523:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0059e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20b96c6c-8494-483a-b913-89dfc06b1440+24:3630:x1875738134544256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788843795.364561:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0059e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20b96c6c-8494-483a-b913-89dfc06b1440+24:3630:x1875738134544256:12345-0@lo:400:kworker.0 Request processed in 38us (6913us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843795.364567:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1788843795.364605:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134544768 00000100:00100000:0.0:1788843795.364609:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134544768 00000100:00100000:0.0:1788843795.364637:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134544384 00000100:00100000:0.0:1788843795.364640:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134544384 00000100:00100000:0.0:1788843795.364656:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788843795.364662:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141ae0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3630:x1875738134544768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788843795.364697:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141ae0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3630:x1875738134544768:12345-0@lo:400:kworker.0 Request processed in 35us (6975us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843795.364704:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788843795.364716:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788843795.364722:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141ae1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3632:x1875738134544384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788843795.364753:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141ae1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3632:x1875738134544384:12345-0@lo:400:kworker.0 Request processed in 32us (6902us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843795.364759:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00080000:0.0:1788843795.364799:0:17146:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788843795.364805:0:17146:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788843795.364809:0:17146:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788843795.364812:0:17146:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788843795.364832:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f8d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1875738134545792:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788843795.364880:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843795.364929:0:18657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134545792 00000100:00100000:0.0:1788843795.364939:0:18657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134545792 00000100:00100000:0.0:1788843795.364970:0:18657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788843795.364977:0:18657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f954e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3631:x1875738134545792:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788843795.365021:0:18657:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915857920 avail 3684335616 00000100:00100000:0.0:1788843795.365060:0:18657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f954e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3631:x1875738134545792:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (180us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843795.365066:0:18657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788843795.365110:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f8d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1875738134545792:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788843795.365174:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f962680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:20b96c6c-8494-483a-b913-89dfc06b1440:3630:1875738134544256:0@lo:400:kworker.0 00000100:00100000:0.0:1788843795.365188:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f961880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1875738134544768:0@lo:400:kworker.0 00000100:00100000:0.0:1788843795.365201:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f962d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3630:1875738134545280:0@lo:400:kworker.0 00000100:00100000:0.0:1788843795.365214:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f963480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3630:1875738134544640:0@lo:400:kworker.0 00000100:00100000:0.0:1788843795.365226:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f961c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3630:1875738134545152:0@lo:400:kworker.0 00010000:00080000:0.0:1788843795.365242:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd10f962300 x1875738134545664/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843811 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788843795.365253:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f962300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3630:1875738134545664:0@lo:400:kworker.0 00000100:00100000:0.0:1788843795.371650:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f960380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1875738134544384:0@lo:400:kworker.0 00010000:00010000:1.0:1788843795.805688:0:19636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788843796.398094:0:20722:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:0.0:1788843796.410283:0:20722:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:0.0:1788843796.410346:0:20722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd007947000/0xa762dfcbd58d21f5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d21fc expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843796.410361:0:20722:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd007947000/0xa762dfcbd58d21f5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xa762dfcbd58d21fc expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843796.410380:0:20722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd007947000/0xa762dfcbd58d21f5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xa762dfcbd58d21fc expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843796.410388:0:20722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.133@tcp lock: ffff9bd007947000/0xa762dfcbd58d21f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xa762dfcbd58d21fc expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843796.410448:0:20722:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788843796.410453:0:20722:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1788843796.410489:0:20722:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788843796.410494:0:20722:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1788843796.410499:0:20722:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1788843796.410527:0:20722:0:(import.c:65:import_set_state_nolock()) ffff9bd007220800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1788843796.410720:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f955500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3629:1875738134546048:0@lo:39:umount.0 00000100:00100000:1.0:1788843796.410797:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843796.410900:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134546048 00000100:00100000:2.0:1788843796.410910:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134546048 00000100:00100000:2.0:1788843796.411008:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788843796.411020:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f960380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3629:x1875738134546048:12345-0@lo:39:umount.0 00010000:00010000:3.0:1788843796.411030:0:17138:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788843796.411039:0:17138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.133@tcp lock: ffff9bd007947000/0xa762dfcbd58d21f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xa762dfcbd58d21fc expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:2.0:1788843796.411049:0:17150:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa762dfcbd58d2226 00010000:00010000:3.0:1788843796.411050:0:17138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd007947000 already unused, calling callback (ffffffffc12a7c20) 10000000:00010000:3.0:1788843796.411057:0:17138:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.133@tcp lock: ffff9bd007947000/0xa762dfcbd58d21f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xa762dfcbd58d21fc expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788843796.411059:0:17150:0:(import.c:65:import_set_state_nolock()) ffff9bd10f7bc800 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1788843796.411071:0:17138:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.133@tcp lock: ffff9bd007947000/0xa762dfcbd58d21f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0xa762dfcbd58d21fc expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788843796.411080:0:17138:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.133@tcp lock: ffff9bd007947000/0xa762dfcbd58d21f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0xa762dfcbd58d21fc expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788843796.411086:0:17138:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788843796.411089:0:17138:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1788843796.411091:0:17138:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1788843796.411119:0:17138:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.133@tcp lock: ffff9bd007947000/0xa762dfcbd58d21f5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xa762dfcbd58d21fc expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843796.411125:0:17138:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788843796.411168:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f960380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+1:3629:x1875738134546048:12345-0@lo:39:umount.0 Request processed in 147us (368us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843796.411177:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000020:00000080:2.0:1788843796.411189:0:17150:0:(genops.c:885:class_export_put()) final put ffff9bd10f7bc000/lustre-MDT0000-lwp-MDT0000_UUID 00010000:00010000:1.0:1788843796.411196:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788843796.411257:0:3632:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:3.0:1788843796.411272:0:17138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.133@tcp lock: ffff9bd007947000/0xa762dfcbd58d21f5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xa762dfcbd58d21fc expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843796.411293:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.133@tcp lock: ffff9bd007947000/0xa762dfcbd58d21f5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xa762dfcbd58d21fc expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843796.411305:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788843796.411307:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788843796.411308:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788843796.411590:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd10f7bc000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:2.0:1788843796.411738:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9bd10f7bc800 for lustre-MDT0000 00000100:00080000:2.0:1788843796.411774:0:3629:0:(import.c:65:import_set_state_nolock()) ffff9bd007220800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1788843796.411826:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f955500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3629:1875738134546048:0@lo:39:umount.0 00000100:00080000:0.0:1788843796.411888:0:20722:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788843796.411891:0:20722:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1788843796.411896:0:20722:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00100000:1.0:1788843796.412444:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd1074fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:20b96c6c-8494-483a-b913-89dfc06b1440:3632:1875738134546176:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788843796.412508:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843796.412624:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134546176 00000100:00100000:2.0:1788843796.412631:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134546176 00000100:00100000:2.0:1788843796.412687:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788843796.412696:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f962300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20b96c6c-8494-483a-b913-89dfc06b1440+24:3632:x1875738134546176:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788843796.412710:0:17135:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788843796.412728:0:17135:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd007947600/0xa762dfcbd58d21fc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa762dfcbd58d21f5 expref: 24 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843796.412745:0:17135:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788843796.412790:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f962300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20b96c6c-8494-483a-b913-89dfc06b1440+23:3632:x1875738134546176:12345-0@lo:103:ldlm_bl.0 Request processed in 95us (282us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843796.412797:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788843796.412871:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd1074fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:20b96c6c-8494-483a-b913-89dfc06b1440:3632:1875738134546176:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788843796.413690:0:20722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd007946400/0xa762dfcbd58d2146 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d214d expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843796.413704:0:20722:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd007946400/0xa762dfcbd58d2146 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xa762dfcbd58d214d expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843796.413713:0:20722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd007946400/0xa762dfcbd58d2146 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xa762dfcbd58d214d expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843796.413721:0:20722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.133@tcp lock: ffff9bd007946400/0xa762dfcbd58d2146 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xa762dfcbd58d214d expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843796.413735:0:20722:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788843796.413753:0:20722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd007be3800/0xa762dfcbd58d248e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d2495 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843796.413760:0:20722:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd007be3800/0xa762dfcbd58d248e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa762dfcbd58d2495 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843796.413767:0:20722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd007be3800/0xa762dfcbd58d248e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xa762dfcbd58d2495 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843796.413773:0:20722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.133@tcp lock: ffff9bd007be3800/0xa762dfcbd58d248e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xa762dfcbd58d2495 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843796.413793:0:20722:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788843796.413800:0:20722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd10f7af800/0xa762dfcbd58d26fd lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d2704 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843796.413807:0:20722:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd10f7af800/0xa762dfcbd58d26fd lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xa762dfcbd58d2704 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843796.413813:0:20722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd10f7af800/0xa762dfcbd58d26fd lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xa762dfcbd58d2704 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843796.413819:0:20722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.133@tcp lock: ffff9bd10f7af800/0xa762dfcbd58d26fd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xa762dfcbd58d2704 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843796.413836:0:20722:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1788843796.413842:0:20722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd007947800/0xa762dfcbd58d2138 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d213f expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843796.413858:0:20722:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd007947800/0xa762dfcbd58d2138 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa762dfcbd58d213f expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843796.413871:0:20722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd007947800/0xa762dfcbd58d2138 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xa762dfcbd58d213f expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843796.413878:0:20722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.133@tcp lock: ffff9bd007947800/0xa762dfcbd58d2138 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xa762dfcbd58d213f expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843796.413886:0:20722:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 10000000:01000000:0.0:1788843796.413889:0:20722:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00010000:00010000:1.0:1788843796.413912:0:19636:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00000020:01000004:0.0:1788843796.413921:0:20722:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0000 00010000:00010000:1.0:1788843796.413922:0:19636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.133@tcp lock: ffff9bd007946400/0xa762dfcbd58d2146 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xa762dfcbd58d214d expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000000:0.0:1788843796.413927:0:20722:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:0.0:1788843796.413934:0:20722:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788843796.413941:0:20722:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 4/13 00010000:00010000:1.0:1788843796.413949:0:19636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd007946400 already unused, calling callback (ffffffffc12a7c20) 00000020:00080000:0.0:1788843796.413950:0:20722:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9bd008461000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 10000000:00010000:1.0:1788843796.413956:0:19636:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.133@tcp lock: ffff9bd007946400/0xa762dfcbd58d2146 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xa762dfcbd58d214d expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1788843796.413960:0:20722:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9bd132a9a000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788843796.413974:0:20722:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9bd0059c6000 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00010000:00010000:1.0:1788843796.413975:0:19636:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.133@tcp lock: ffff9bd007946400/0xa762dfcbd58d2146 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0xa762dfcbd58d214d expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1788843796.413988:0:20722:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9bd00644c800 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 10000000:00010000:1.0:1788843796.413991:0:19636:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.133@tcp lock: ffff9bd007946400/0xa762dfcbd58d2146 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0xa762dfcbd58d214d expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1788843796.414001:0:20722:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff9bd006523800 cd5af0cf-62ad-40c0-947c-f942bbf55123 192.168.203.33@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 8589934599 stale:0 10000000:01000000:1.0:1788843796.414002:0:19636:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788843796.414007:0:19636:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 10000000:01000000:1.0:1788843796.414011:0:19636:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 00000020:00080000:0.0:1788843796.414015:0:20722:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff9bd1074cc800 6921b2ba-4cb8-4cf7-a5c0-1c37d97b5fd0 192.168.203.33@tcp 5 (0 5 0) 1 0 0 0: 0000000000000000 8589934623 stale:0 00000020:00080000:0.0:1788843796.414021:0:20722:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff9bd10fbb3370) has exports, disconnecting them 00000020:00080000:0.0:1788843796.414026:0:20722:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9bd008461000), last request at 1788843795 00000020:00000080:0.0:1788843796.414033:0:20722:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa762dfcbd58d245d 00010000:00010000:1.0:1788843796.414040:0:19636:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.133@tcp lock: ffff9bd007946400/0xa762dfcbd58d2146 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xa762dfcbd58d214d expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843796.414047:0:19636:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00080000:0.0:1788843796.414052:0:20722:0:(import.c:65:import_set_state_nolock()) ffff9bd008464800 : changing import state from FULL to CLOSED 00010000:00010000:1.0:1788843796.414074:0:19636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.133@tcp lock: ffff9bd007946400/0xa762dfcbd58d2146 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xa762dfcbd58d214d expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843796.414083:0:19636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.133@tcp lock: ffff9bd007946400/0xa762dfcbd58d2146 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xa762dfcbd58d214d expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843796.414096:0:19636:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00000020:00080000:0.0:1788843796.414099:0:20722:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9bd008461000): rc 0 00010000:00010000:1.0:1788843796.414102:0:19636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.133@tcp lock: ffff9bd007be3800/0xa762dfcbd58d248e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xa762dfcbd58d2495 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:0.0:1788843796.414104:0:20722:0:(genops.c:885:class_export_put()) final put ffff9bd008461000/lustre-MDT0000-lwp-OST0001_UUID 00010000:00010000:1.0:1788843796.414113:0:19636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd007be3800 already unused, calling callback (ffffffffc12a7c20) 10000000:00010000:1.0:1788843796.414117:0:19636:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.133@tcp lock: ffff9bd007be3800/0xa762dfcbd58d248e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xa762dfcbd58d2495 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1788843796.414119:0:20722:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9bd132a9a000), last request at 1788843795 00010000:00010000:1.0:1788843796.414133:0:19636:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.133@tcp lock: ffff9bd007be3800/0xa762dfcbd58d248e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xa762dfcbd58d2495 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:0.0:1788843796.414133:0:20722:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa762dfcbd58d23c3 00000100:00080000:0.0:1788843796.414165:0:20722:0:(import.c:65:import_set_state_nolock()) ffff9bd132a9c000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1788843796.414174:0:20722:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9bd132a9a000): rc 0 00000020:00000080:0.0:1788843796.414177:0:20722:0:(genops.c:885:class_export_put()) final put ffff9bd132a9a000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:0.0:1788843796.414181:0:20722:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9bd0059c6000), last request at 1788843722 00000020:00000080:0.0:1788843796.414184:0:20722:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa762dfcbd58d2314 00000100:00080000:0.0:1788843796.414187:0:20722:0:(import.c:65:import_set_state_nolock()) ffff9bd0059c6800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1788843796.414192:0:20722:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9bd0059c6000): rc 0 00000020:00000080:0.0:1788843796.414193:0:20722:0:(genops.c:885:class_export_put()) final put ffff9bd0059c6000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:0.0:1788843796.414197:0:20722:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9bd00644c800), last request at 1788843722 00000020:00000080:0.0:1788843796.414200:0:20722:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa762dfcbd58d22ab 00000100:00080000:0.0:1788843796.414203:0:20722:0:(import.c:65:import_set_state_nolock()) ffff9bd10481e800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788843796.414209:0:20722:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934628 00000020:00080000:0.0:1788843796.414290:0:20722:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9bd00644c800): rc 0 00000004:00000080:0.0:1788843796.414295:0:20722:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffb2dcc1977ae0 00000100:00080000:0.0:1788843796.414321:0:20722:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1788843796.414325:0:20722:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 3 10000000:00010000:1.0:1788843796.414460:0:19636:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.133@tcp lock: ffff9bd007be3800/0xa762dfcbd58d248e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xa762dfcbd58d2495 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788843796.414525:0:19636:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:1.0:1788843796.414528:0:19636:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:1.0:1788843796.414530:0:19636:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:1.0:1788843796.414546:0:19636:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.133@tcp lock: ffff9bd007be3800/0xa762dfcbd58d248e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xa762dfcbd58d2495 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843796.414552:0:19636:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788843796.414560:0:19636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.133@tcp lock: ffff9bd007be3800/0xa762dfcbd58d248e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xa762dfcbd58d2495 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843796.414831:0:19636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.133@tcp lock: ffff9bd007be3800/0xa762dfcbd58d248e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xa762dfcbd58d2495 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843796.414843:0:19636:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788843796.414856:0:19636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.133@tcp lock: ffff9bd10f7af800/0xa762dfcbd58d26fd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xa762dfcbd58d2704 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843796.414863:0:19636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd10f7af800 already unused, calling callback (ffffffffc12a7c20) 10000000:00010000:1.0:1788843796.414866:0:19636:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.133@tcp lock: ffff9bd10f7af800/0xa762dfcbd58d26fd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xa762dfcbd58d2704 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843796.414874:0:19636:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.133@tcp lock: ffff9bd10f7af800/0xa762dfcbd58d26fd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xa762dfcbd58d2704 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788843796.414891:0:19636:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.133@tcp lock: ffff9bd10f7af800/0xa762dfcbd58d26fd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xa762dfcbd58d2704 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788843796.414897:0:19636:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1788843796.414900:0:19636:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1788843796.414901:0:19636:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1788843796.414916:0:19636:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.133@tcp lock: ffff9bd10f7af800/0xa762dfcbd58d26fd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xa762dfcbd58d2704 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843796.414922:0:19636:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788843796.414939:0:19636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.133@tcp lock: ffff9bd10f7af800/0xa762dfcbd58d26fd lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xa762dfcbd58d2704 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843796.414946:0:19636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.133@tcp lock: ffff9bd10f7af800/0xa762dfcbd58d26fd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xa762dfcbd58d2704 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843796.414955:0:19636:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788843796.414959:0:19636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.133@tcp lock: ffff9bd007947800/0xa762dfcbd58d2138 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xa762dfcbd58d213f expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843796.414965:0:19636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd007947800 already unused, calling callback (ffffffffc12a7c20) 10000000:00010000:1.0:1788843796.414968:0:19636:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.133@tcp lock: ffff9bd007947800/0xa762dfcbd58d2138 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xa762dfcbd58d213f expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843796.414975:0:19636:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.133@tcp lock: ffff9bd007947800/0xa762dfcbd58d2138 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xa762dfcbd58d213f expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788843796.414982:0:19636:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.133@tcp lock: ffff9bd007947800/0xa762dfcbd58d2138 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xa762dfcbd58d213f expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788843796.414996:0:19636:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:1.0:1788843796.414999:0:19636:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:1.0:1788843796.415001:0:19636:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:1.0:1788843796.415012:0:19636:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.133@tcp lock: ffff9bd007947800/0xa762dfcbd58d2138 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xa762dfcbd58d213f expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843796.415018:0:19636:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788843796.415024:0:19636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.133@tcp lock: ffff9bd007947800/0xa762dfcbd58d2138 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xa762dfcbd58d213f expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843796.415031:0:19636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.133@tcp lock: ffff9bd007947800/0xa762dfcbd58d2138 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xa762dfcbd58d213f expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843796.415042:0:19636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843796.415044:0:19636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843796.415046:0:19636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788843796.415063:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f961c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:20b96c6c-8494-483a-b913-89dfc06b1440:3630:1875738134546304:0@lo:103:ldlm_bl.0 00000100:00080000:0.0:1788843796.415109:0:20722:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00100000:1.0:1788843796.415118:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788843796.415125:0:20722:0:(import.c:65:import_set_state_nolock()) ffff9bd12e2ab000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1788843796.415184:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788843796.415191:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f963480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:20b96c6c-8494-483a-b913-89dfc06b1440:3630:1875738134546432:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788843796.415215:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843796.415254:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f961880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:20b96c6c-8494-483a-b913-89dfc06b1440:3633:1875738134546688:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788843796.415256:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134546304 00000100:00100000:2.0:1788843796.415265:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134546304 00000100:00100000:1.0:1788843796.415278:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843796.415296:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788843796.415302:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f962d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:20b96c6c-8494-483a-b913-89dfc06b1440:3633:1875738134546560:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788843796.415306:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134546432 00000100:00100000:2.0:1788843796.415311:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134546432 00000100:00100000:1.0:1788843796.415321:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843796.415333:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134546688 00000100:00100000:2.0:1788843796.415337:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134546688 00000100:00100000:1.0:1788843796.415345:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134546560 00000100:00100000:1.0:1788843796.415355:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134546560 00000100:00100000:2.0:1788843796.415359:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788843796.415369:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f962680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20b96c6c-8494-483a-b913-89dfc06b1440+26:3630:x1875738134546304:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788843796.415384:0:17137:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788843796.415399:0:17137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd10fa3de00/0xa762dfcbd58d214d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa762dfcbd58d2146 expref: 26 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843796.415413:0:17137:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788843796.415465:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f962680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20b96c6c-8494-483a-b913-89dfc06b1440+25:3630:x1875738134546304:12345-0@lo:103:ldlm_bl.0 Request processed in 97us (347us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843796.415472:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788843796.415488:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788843796.415494:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0013a8850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20b96c6c-8494-483a-b913-89dfc06b1440+24:3630:x1875738134546432:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788843796.415501:0:17137:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788843796.415510:0:17137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd007be3000/0xa762dfcbd58d2495 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa762dfcbd58d248e expref: 24 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843796.415518:0:17137:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788843796.415538:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0013a8850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20b96c6c-8494-483a-b913-89dfc06b1440+23:3630:x1875738134546432:12345-0@lo:103:ldlm_bl.0 Request processed in 45us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843796.415545:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788843796.415586:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788843796.415592:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f960700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20b96c6c-8494-483a-b913-89dfc06b1440+22:3633:x1875738134546688:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788843796.415599:0:17137:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788843796.415607:0:17137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd10fa3d600/0xa762dfcbd58d213f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa762dfcbd58d2138 expref: 22 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843796.415615:0:17137:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788843796.415642:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f960700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20b96c6c-8494-483a-b913-89dfc06b1440+21:3633:x1875738134546688:12345-0@lo:103:ldlm_bl.0 Request processed in 50us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843796.415648:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788843796.415660:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788843796.415665:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f960000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20b96c6c-8494-483a-b913-89dfc06b1440+20:3633:x1875738134546560:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788843796.415673:0:17137:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788843796.415681:0:17137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd1420e4400/0xa762dfcbd58d2704 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa762dfcbd58d26fd expref: 20 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843796.415696:0:17137:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788843796.415717:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f960000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20b96c6c-8494-483a-b913-89dfc06b1440+19:3633:x1875738134546560:12345-0@lo:103:ldlm_bl.0 Request processed in 52us (396us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843796.415723:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00010000:2.0:1788843796.415825:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788843796.415862:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f962d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:20b96c6c-8494-483a-b913-89dfc06b1440:3633:1875738134546560:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788843796.415873:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f961880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:20b96c6c-8494-483a-b913-89dfc06b1440:3633:1875738134546688:0@lo:103:ldlm_bl.0 00000020:00000080:2.0:1788843796.415899:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd008461000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:2.0:1788843796.415934:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd132a9a000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:2.0:1788843796.415952:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd0059c6000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:2.0:1788843796.415972:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9bd008464800 for lustre-MDT0000 00000020:00000080:2.0:1788843796.415976:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9bd132a9c000 for lustre-MDT0000 00000020:00000080:2.0:1788843796.415980:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9bd0059c6800 for lustre-MDT0000 00000100:00100000:2.0:1788843796.415993:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f955f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3629:1875738134546816:0@lo:39:umount.0 00000100:00100000:2.0:1788843796.416023:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843796.416056:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134546816 00000100:00100000:2.0:1788843796.416060:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134546816 00000100:00100000:2.0:1788843796.416087:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788843796.416094:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f8d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3629:x1875738134546816:12345-0@lo:39:umount.0 00000020:00000080:2.0:1788843796.416114:0:17154:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa762dfcbd58d233e 00000100:00080000:2.0:1788843796.416121:0:17154:0:(import.c:65:import_set_state_nolock()) ffff9bd13fab8000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788843796.416162:0:17154:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:1.0:1788843796.416178:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f963480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:20b96c6c-8494-483a-b913-89dfc06b1440:3630:1875738134546432:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788843796.416187:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f961c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:20b96c6c-8494-483a-b913-89dfc06b1440:3630:1875738134546304:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788843796.416268:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f8d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+3:3629:x1875738134546816:12345-0@lo:39:umount.0 Request processed in 174us (243us total) trans 8589934595 rc 0/0 00000100:00100000:2.0:1788843796.416275:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:1.0:1788843796.416297:0:3629:0:(import.c:65:import_set_state_nolock()) ffff9bd12e2ab000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00010000:00010000:2.0:1788843796.416307:0:19636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788843796.416307:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f955f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3629:1875738134546816:0@lo:39:umount.0 00000100:00080000:1.0:1788843796.416461:0:20722:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1788843796.416466:0:20722:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934598 gen 3 00010000:00010000:3.0:1788843796.416478:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1788843796.416483:0:20722:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1788843796.416606:0:20722:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:1.0:1788843796.416621:0:20722:0:(import.c:65:import_set_state_nolock()) ffff9bd118910000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:1.0:1788843796.416640:0:20722:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788843796.416642:0:20722:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934594 gen 3 00000004:00080000:1.0:1788843796.416653:0:20722:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1788843796.416780:0:20722:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:1.0:1788843796.416790:0:20722:0:(import.c:65:import_set_state_nolock()) ffff9bd13e8a4000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:1.0:1788843796.416828:0:20722:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff9bd10fbb3370) has no exports 00000100:00100000:2.0:1788843796.416993:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f961c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3629:1875738134546944:0@lo:9:umount.0 00000100:00100000:2.0:1788843796.417033:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843796.418410:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f963480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3629:1875738134547072:0@lo:9:umount.0 00000100:00100000:2.0:1788843796.418454:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843796.421718:0:18654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134546944 00000100:00100000:2.0:1788843796.421732:0:18654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134546944 00000100:00100000:2.0:1788843796.421792:0:18654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134547072 00000100:00100000:2.0:1788843796.421796:0:18654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134547072 00000100:00100000:2.0:1788843796.421837:0:18654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788843796.421861:0:18654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f8d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3629:x1875738134546944:12345-0@lo:9:umount.0 00000020:00000080:2.0:1788843796.421894:0:18654:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa762dfcbd58d249c 00000100:00080000:2.0:1788843796.421905:0:18654:0:(import.c:65:import_set_state_nolock()) ffff9bd006634000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788843796.421946:0:18654:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934600 00000100:00100000:2.0:1788843796.422112:0:18654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f8d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2:3629:x1875738134546944:12345-0@lo:9:umount.0 Request processed in 265us (5076us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843796.422121:0:18654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788843796.422174:0:18654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788843796.422184:0:18654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f8d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3629:x1875738134547072:12345-0@lo:9:umount.0 00000020:00000080:2.0:1788843796.422197:0:18654:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa762dfcbd58d24a3 00000100:00080000:2.0:1788843796.422203:0:18654:0:(import.c:65:import_set_state_nolock()) ffff9bd006636800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788843796.422229:0:18654:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:2.0:1788843796.422356:0:18654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f8d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2:3629:x1875738134547072:12345-0@lo:9:umount.0 Request processed in 174us (3900us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843796.422364:0:18654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00010000:2.0:1788843796.422396:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788843796.422406:0:19636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788843796.422459:0:3629:0:(import.c:65:import_set_state_nolock()) ffff9bd118910000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1788843796.422882:0:3629:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1788843796.422888:0:3629:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788843796.422895:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f961c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3629:1875738134546944:0@lo:9:umount.0 00000100:00080000:2.0:1788843796.422923:0:3629:0:(import.c:65:import_set_state_nolock()) ffff9bd13e8a4000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1788843796.422938:0:3629:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1788843796.422941:0:3629:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788843796.422947:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f963480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3629:1875738134547072:0@lo:9:umount.0 00000020:00080000:1.0:1788843796.430896:0:20722:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff9bd10fbb3370) has no exports 00000020:00000080:1.0:1788843796.471834:0:20722:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa762dfcbd58d2193 00000020:00000080:1.0:1788843796.471861:0:20722:0:(genops.c:885:class_export_put()) final put ffff9bd141a7b000/lustre-QMT0000_UUID 00000020:01000000:1.0:1788843796.471927:0:20722:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:1.0:1788843796.471938:0:20722:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788843796.471947:0:20722:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788843796.471951:0:20722:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff9bd1333999b8) has no exports 00000020:00000080:1.0:1788843796.472272:0:20722:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa762dfcbd58d218c 00000020:00000080:1.0:1788843796.472277:0:20722:0:(genops.c:885:class_export_put()) final put ffff9bd11ae52800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788843796.472337:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd141a7b000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:3.0:1788843796.472447:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd11ae52800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788843796.472505:0:20722:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788843796.472513:0:20722:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1788843796.472516:0:20722:0:(genops.c:885:class_export_put()) final put ffff9bd118910800/lustre-QMT0000_UUID 00000020:00000080:1.0:1788843796.472518:0:20722:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd118910800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:1.0:1788843796.472538:0:20722:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00010000:00010000:3.0:1788843796.826686:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788843797.850571:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788843797.919387:0:17130:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1788843797.919398:0:17130:0:(genops.c:885:class_export_put()) final put ffff9bd00644c800/lustre-MDT0001-mdtlov_UUID 00000001:00100000:1.0:1788843797.919447:0:17130:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of cd5af0cf-62ad-40c0-947c-f942bbf55123 00000001:00080000:1.0:1788843797.919455:0:17130:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934628 is committed 00000020:00000080:1.0:1788843797.919458:0:17130:0:(genops.c:885:class_export_put()) final put ffff9bd006523800/cd5af0cf-62ad-40c0-947c-f942bbf55123 00000001:00100000:1.0:1788843797.919464:0:17130:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 6921b2ba-4cb8-4cf7-a5c0-1c37d97b5fd0 00000001:00080000:1.0:1788843797.919467:0:17130:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934627 is committed 00000020:00000080:1.0:1788843797.919474:0:17130:0:(genops.c:885:class_export_put()) final put ffff9bd1074cc800/6921b2ba-4cb8-4cf7-a5c0-1c37d97b5fd0 00000020:00000080:0.0:1788843797.919912:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd00644c800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:0.0:1788843797.919977:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd006523800/cd5af0cf-62ad-40c0-947c-f942bbf55123 for lustre-MDT0000 00000020:00000080:0.0:1788843797.920005:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd1074cc800/6921b2ba-4cb8-4cf7-a5c0-1c37d97b5fd0 for lustre-MDT0000 00000020:00000080:0.0:1788843797.920031:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9bd10481e800 for lustre-MDT0000 00000020:00000080:0.0:1788843797.920037:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9bd006526000 for lustre-MDT0000 00000020:00000080:0.0:1788843797.920040:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9bd1074c8800 for lustre-MDT0000 00000001:00100000:3.0:1788843797.920723:0:17882:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:3.0:1788843797.920906:0:17882:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934595 is committed 00000020:00000080:3.0:1788843797.920910:0:17882:0:(genops.c:885:class_export_put()) final put ffff9bd13fabe800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:3.0:1788843797.920929:0:17882:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of cd5af0cf-62ad-40c0-947c-f942bbf55123 00000001:00080000:3.0:1788843797.920934:0:17882:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934594 is committed 00000020:00000080:3.0:1788843797.920937:0:17882:0:(genops.c:885:class_export_put()) final put ffff9bd006521800/cd5af0cf-62ad-40c0-947c-f942bbf55123 00000001:00100000:3.0:1788843797.920942:0:17882:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 6921b2ba-4cb8-4cf7-a5c0-1c37d97b5fd0 00000001:00080000:3.0:1788843797.920945:0:17882:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934593 is committed 00000020:00000080:3.0:1788843797.920947:0:17882:0:(genops.c:885:class_export_put()) final put ffff9bd1074c8000/6921b2ba-4cb8-4cf7-a5c0-1c37d97b5fd0 00000020:00000080:2.0:1788843797.921206:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd13fabe800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:2.0:1788843797.921266:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd006521800/cd5af0cf-62ad-40c0-947c-f942bbf55123 for lustre-MDT0001 00000020:00000080:2.0:1788843797.921302:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd1074c8000/6921b2ba-4cb8-4cf7-a5c0-1c37d97b5fd0 for lustre-MDT0001 00000020:00000080:2.0:1788843797.921987:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9bd13fab8000 for lustre-MDT0001 00000020:00000080:2.0:1788843797.921995:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9bd006526800 for lustre-MDT0001 00000020:00000080:2.0:1788843797.921997:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9bd1074cc000 for lustre-MDT0001 00000001:00100000:0.0:1788843797.922073:0:18651:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788843797.922078:0:18651:0:(genops.c:885:class_export_put()) final put ffff9bd006633000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:0.0:1788843797.922236:0:18651:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 6921b2ba-4cb8-4cf7-a5c0-1c37d97b5fd0 00000020:00000080:0.0:1788843797.922252:0:18651:0:(genops.c:885:class_export_put()) final put ffff9bd006522000/6921b2ba-4cb8-4cf7-a5c0-1c37d97b5fd0 00000020:00000080:3.0:1788843797.922317:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd006633000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:3.0:1788843797.922351:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd006522000/6921b2ba-4cb8-4cf7-a5c0-1c37d97b5fd0 for lustre-OST0000 00000020:00000080:3.0:1788843797.922367:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9bd006634000 for lustre-OST0000 00000020:00000080:3.0:1788843797.922371:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9bd006521000 for lustre-OST0000 00000020:01000000:1.0:1788843798.490817:0:20722:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9bd00655a5a0 - data ffff9bd10836ee58/ffff9bd007239000 00000020:01000000:1.0:1788843798.491004:0:20722:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9bd00655ad20 - data ffff9bd005c13870/ffff9bd104786800 00000001:00000004:1.0:1788843798.503595:0:20722:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934628 00000100:00080000:3.0:1788843798.621046:0:20722:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788843798.621058:0:20722:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1788843798.621091:0:20722:0:(client.c:3163:ptlrpc_free_committed()) @@@ free request with old gen req@ffff9bd10f955f80 x1875738134546816/t8589934595(8589934595) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788843806 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788843798.621122:0:20722:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:3.0:1788843798.627653:0:20722:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788843798.627663:0:20722:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934598 gen 4 00000004:00080000:3.0:1788843798.627683:0:20722:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788843798.627685:0:20722:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1788843798.629325:0:17173:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1788843798.629332:0:17173:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 2 count 1 00000040:00080000:1.0:1788843798.629359:0:17173:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 2 count 2 00000100:00080000:3.0:1788843798.630200:0:20722:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1788843798.630206:0:20722:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934594 gen 4 00000004:00080000:3.0:1788843798.630223:0:20722:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788843798.630226:0:20722:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1788843798.631166:0:17175:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1788843798.631173:0:17175:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xc:0x0] index 1 count 1 00000040:00080000:1.0:1788843798.631186:0:17175:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 2 count 2 00000020:00000080:3.0:1788843798.636493:0:20722:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa762dfcbd58d215b 00000020:00000080:3.0:1788843798.636518:0:20722:0:(genops.c:885:class_export_put()) final put ffff9bd12e2aa000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788843798.638091:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd12e2aa000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1788843798.651607:0:20722:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa762dfcbd58d2170 00000020:00000080:3.0:1788843798.651625:0:20722:0:(genops.c:885:class_export_put()) final put ffff9bd1060cc800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1788843798.651647:0:20722:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:3.0:1788843798.651654:0:20722:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788843798.651663:0:20722:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788843798.651668:0:20722:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff9bd10fbb19b8) has no exports 00000004:01000000:3.0:1788843798.651881:0:20722:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:3.0:1788843798.651892:0:20722:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa762dfcbd58d21d2 00000020:00000080:3.0:1788843798.651897:0:20722:0:(genops.c:885:class_export_put()) final put ffff9bd141b0b800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1788843798.651901:0:20722:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:3.0:1788843798.651904:0:20722:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788843798.651909:0:20722:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788843798.651912:0:20722:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff9bd13e91b370) has no exports 00000020:00000080:3.0:1788843798.651920:0:20722:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa762dfcbd58d21cb 00000020:00000080:3.0:1788843798.651924:0:20722:0:(genops.c:885:class_export_put()) final put ffff9bd13e8a7000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788843798.653678:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd1060cc800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:1.0:1788843798.653695:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd141b0b800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1788843798.653700:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd13e8a7000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:3.0:1788843798.656363:0:20722:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:3.0:1788843798.656373:0:20722:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1788843798.656378:0:20722:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934594 gen 5 00000004:00080000:3.0:1788843798.656386:0:20722:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788843798.656402:0:20722:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788843798.656454:0:20722:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788843798.656466:0:20722:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788843798.656474:0:20722:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa762dfcbd58d21bd 00000020:00000080:3.0:1788843798.656485:0:20722:0:(genops.c:885:class_export_put()) final put ffff9bd13e8a5800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1788843798.656492:0:20722:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:3.0:1788843798.656496:0:20722:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788843798.656510:0:20722:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788843798.656515:0:20722:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff9bd13339cd28) has no exports 00000020:00000080:3.0:1788843798.656522:0:20722:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa762dfcbd58d21b6 00000020:00000080:3.0:1788843798.656526:0:20722:0:(genops.c:885:class_export_put()) final put ffff9bd118912800/lustre-MDT0000-osd_UUID 00010000:01000000:3.0:1788843798.656910:0:20722:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:3.0:1788843798.656914:0:20722:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788843798.656916:0:20722:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934598 gen 5 00000004:00080000:3.0:1788843798.656920:0:20722:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788843798.656921:0:20722:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788843798.656947:0:20722:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788843798.656951:0:20722:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:3.0:1788843798.656965:0:20722:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:3.0:1788843798.656971:0:20722:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa762dfcbd58d21a8 00000020:00000080:3.0:1788843798.656976:0:20722:0:(genops.c:885:class_export_put()) final put ffff9bd141a7f000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1788843798.656979:0:20722:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:3.0:1788843798.656983:0:20722:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788843798.656986:0:20722:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788843798.656989:0:20722:0:(genops.c:1558:class_disconnect_exports()) OBD device 8 (ffff9bd13eb119b8) has no exports 00000020:00000080:3.0:1788843798.656992:0:20722:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa762dfcbd58d21a1 00000020:00000080:3.0:1788843798.656995:0:20722:0:(genops.c:885:class_export_put()) final put ffff9bd12e2af000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788843798.658599:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9bd13e8a4000 for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1788843798.658612:0:8:0:(genops.c:885:class_export_put()) final put ffff9bd13e8a0000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788843798.658615:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd13e8a0000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:1.0:1788843798.658623:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788843798.658723:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd13e8a5800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1788843798.658730:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd118912800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788843798.658751:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9bd118910000 for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1788843798.658757:0:8:0:(genops.c:885:class_export_put()) final put ffff9bd141a7e800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788843798.658759:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd141a7e800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:1.0:1788843798.658762:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788843798.658795:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd141a7f000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:1.0:1788843798.658800:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd12e2af000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:0.0:1788843798.762402:0:20722:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:0.0:1788843798.762412:0:20722:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1788843798.762416:0:20722:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788843798.762425:0:20722:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788843798.762481:0:20722:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788843798.762494:0:20722:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788843798.762532:0:20722:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788843798.762536:0:20722:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788843798.762542:0:20722:0:(genops.c:885:class_export_put()) final put ffff9bd12e2ac000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788843798.762547:0:20722:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd12e2ac000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:0.0:1788843798.762560:0:20722:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788843798.762667:0:20722:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa762dfcbd58d2177 00000020:00000080:0.0:1788843798.762674:0:20722:0:(genops.c:885:class_export_put()) final put ffff9bd1060c9800/lustre-MDD0000_UUID 00000020:01000000:0.0:1788843798.762679:0:20722:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:0.0:1788843798.762683:0:20722:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788843798.762687:0:20722:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788843798.762691:0:20722:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff9bd13339b370) has no exports 00000020:00000080:0.0:1788843798.762721:0:20722:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788843798.762724:0:20722:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:0.0:1788843798.762728:0:20722:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa762dfcbd58d217e 00000020:00000080:0.0:1788843798.762732:0:20722:0:(genops.c:885:class_export_put()) final put ffff9bd1060ce800/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1788843798.762741:0:20722:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9bd137acd000 from lustre-MDT0000, refs=3 00000020:01000004:0.0:1788843798.762744:0:20722:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9bd137acd000 3 00000020:01000004:0.0:1788843798.762747:0:20722:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9bd137acd000 from lustre-MDT0000 00000020:00000080:0.0:1788843798.762767:0:20722:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788843798.762771:0:20722:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:0.0:1788843798.762773:0:20722:0:(genops.c:885:class_export_put()) final put ffff9bd12e2a9000/lustre-MDT0000_UUID 00000020:00000080:0.0:1788843798.762775:0:20722:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd12e2a9000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:0.0:1788843798.762782:0:20722:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:0.0:1788843798.762810:0:20722:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:0.0:1788843798.762831:0:20722:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:0.0:1788843798.762843:0:20722:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:0.0:1788843798.762846:0:20722:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788843798.762849:0:20722:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788843798.762856:0:20722:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff9bd13fac0800 20b96c6c-8494-483a-b913-89dfc06b1440 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788843798.762862:0:20722:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff9bd13e9199b8) has exports, disconnecting them 00000020:00080000:0.0:1788843798.762866:0:20722:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff9bd13fac0800), last request at 1788843707 00000020:00000080:0.0:1788843798.762883:0:20722:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa762dfcbd58d211c 00000020:00010000:0.0:1788843798.762887:0:20722:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9bd13fac0800: total 2 00000100:00080000:0.0:1788843798.762891:0:20722:0:(import.c:65:import_set_state_nolock()) ffff9bd13fac2800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1788843798.762912:0:20722:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9bd13fac0800): rc 0 00000020:00080000:0.0:1788843798.762916:0:20722:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff9bd13e9199b8) has no exports 00000100:00100000:0.0:1788843798.762966:0:17145:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff9bd105295400:17145] 2 exiting: rc = 0 00000100:00100000:1.0:1788843798.763285:0:17142:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff9bd105295800:17142] 0 exiting: rc = 1 00000100:00100000:1.0:1788843798.763342:0:17144:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff9bd105295c00:17144] 1 exiting: rc = 0 00000020:00000080:1.0:1788843798.763380:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9bd12e2ab000 for lustre-MDT0001-osp-MDT0000 00000020:00000080:1.0:1788843798.763388:0:8:0:(genops.c:885:class_export_put()) final put ffff9bd141a7d000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788843798.763390:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd141a7d000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:1.0:1788843798.763394:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788843798.763445:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd1060c9800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:1.0:1788843798.763449:0:8:0:(genops.c:885:class_export_put()) final put ffff9bd12e2a9800/lustre-MDD0000_UUID 00000020:00000080:1.0:1788843798.763451:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd12e2a9800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:1.0:1788843798.763453:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:1.0:1788843798.763476:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd1060ce800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00010000:1.0:1788843798.763513:0:19636:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9bd13fac0800: total 0 00010000:00010000:1.0:1788843798.763534:0:19636:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9bd13fac0800, canceled 0 locks, left on hash table 13. 00010000:00010000:1.0:1788843798.763565:0:19636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd10fa3d400/0xa762dfcbd58d2384 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa762dfcbd58d237d expref: 14 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843798.763580:0:19636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd13fbea600/0xa762dfcbd58d2242 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa762dfcbd58d223b expref: 13 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843798.763594:0:19636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd13fbeb800/0xa762dfcbd58d2250 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa762dfcbd58d2249 expref: 12 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843798.763619:0:19636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd100031800/0xa762dfcbd58d26e8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa762dfcbd58d26e1 expref: 11 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843798.763629:0:19636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd007be2800/0xa762dfcbd58d225e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa762dfcbd58d2257 expref: 10 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843798.763641:0:19636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd007be3200/0xa762dfcbd58d2131 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa762dfcbd58d212a expref: 9 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843798.763650:0:19636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd007be2a00/0xa762dfcbd58d241e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa762dfcbd58d2417 expref: 8 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843798.763658:0:19636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd13fbeb600/0xa762dfcbd58d23ae lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa762dfcbd58d23a7 expref: 7 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843798.763667:0:19636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd100030c00/0xa762dfcbd58d26da lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa762dfcbd58d26d3 expref: 6 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843798.763677:0:19636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd10fa3c400/0xa762dfcbd58d22ff lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa762dfcbd58d22f8 expref: 5 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843798.763686:0:19636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd007be3600/0xa762dfcbd58d2448 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa762dfcbd58d2441 expref: 4 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843798.763709:0:19636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd100031200/0xa762dfcbd58d26f6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa762dfcbd58d26ef expref: 3 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843798.763722:0:19636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd007946200/0xa762dfcbd58d2487 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa762dfcbd58d2480 expref: 2 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843798.763744:0:19636:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9bd13fac0800, canceled 13 locks, left on hash table 0. 00000020:00000080:1.0:1788843798.763758:0:19636:0:(genops.c:885:class_export_put()) final put ffff9bd13fac0800/20b96c6c-8494-483a-b913-89dfc06b1440 00010000:00010000:1.0:1788843798.763769:0:19636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843798.763771:0:19636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843798.763773:0:19636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788843798.763779:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd13fac0800/20b96c6c-8494-483a-b913-89dfc06b1440 for MGS 00000020:00000080:1.0:1788843798.763807:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9bd13fac2800 for MGS 00000100:00100000:0.0:1788843798.767009:0:20722:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843798.767020:0:20722:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843798.767026:0:20722:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843798.767031:0:20722:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843798.767036:0:20722:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843798.767042:0:20722:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843798.767049:0:20722:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843798.767054:0:20722:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843798.767061:0:20722:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843798.767068:0:20722:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843798.767073:0:20722:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843798.767079:0:20722:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843798.767084:0:20722:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843798.767089:0:20722:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843798.767095:0:20722:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843798.767101:0:20722:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843798.767106:0:20722:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843798.767111:0:20722:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843798.767118:0:20722:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843798.767123:0:20722:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843798.767173:0:20722:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843798.767179:0:20722:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843798.767185:0:20722:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843798.767190:0:20722:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843798.767196:0:20722:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843798.767201:0:20722:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843798.767207:0:20722:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843798.767211:0:20722:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843798.767217:0:20722:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843798.767222:0:20722:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843798.767228:0:20722:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843798.767234:0:20722:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843798.767239:0:20722:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843798.767244:0:20722:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843798.767250:0:20722:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843798.767256:0:20722:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843798.767262:0:20722:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843798.767267:0:20722:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843798.767272:0:20722:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843798.767277:0:20722:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843798.767283:0:20722:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843798.767288:0:20722:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843798.767297:0:20722:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843798.767302:0:20722:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843798.767308:0:20722:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843798.767313:0:20722:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843798.767319:0:20722:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843798.767324:0:20722:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843798.767330:0:20722:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843798.767336:0:20722:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843798.767341:0:20722:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843798.767346:0:20722:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843798.767360:0:20722:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843798.767365:0:20722:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843798.767371:0:20722:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843798.767383:0:20722:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843798.767388:0:20722:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843798.767393:0:20722:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843798.767399:0:20722:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843798.767404:0:20722:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843798.767409:0:20722:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843798.767414:0:20722:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843798.767420:0:20722:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843798.767425:0:20722:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:0.0:1788843798.773633:0:20722:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9bd0071b7e40 - data ffff9bd005c44798/ffff9bd127b1c400 00000020:01000000:0.0:1788843798.774646:0:20722:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9bd141c904e0 - data ffff9bd131903948/ffff9bd10fb74400 00000020:00000080:0.0:1788843798.780051:0:20722:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa762dfcbd58d2107 00000020:00000080:0.0:1788843798.780066:0:20722:0:(genops.c:885:class_export_put()) final put ffff9bd103343800/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1788843798.780089:0:20722:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9bd137acd000 from MGS, refs=2 00000020:01000004:0.0:1788843798.780092:0:20722:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9bd137acd000 2 00000020:01000004:0.0:1788843798.780096:0:20722:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9bd137acd000 from MGS 00000020:00000080:0.0:1788843798.780123:0:20722:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788843798.780131:0:20722:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:0.0:1788843798.780135:0:20722:0:(genops.c:885:class_export_put()) final put ffff9bd103346800/MGS 00000020:00000080:0.0:1788843798.780137:0:20722:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd103346800/MGS for MGS 00000020:01000000:0.0:1788843798.780159:0:20722:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:00000080:1.0:1788843798.780666:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd103343800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:0.0:1788843798.781075:0:20722:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:0.0:1788843798.781081:0:20722:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788843798.781931:0:20722:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788843798.781939:0:20722:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff9bd008465800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788843798.781946:0:20722:0:(genops.c:1553:class_disconnect_exports()) OBD device 11 (ffff9bd0078bcd28) has exports, disconnecting them 00000020:00080000:0.0:1788843798.781951:0:20722:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff9bd008465800), last request at 1788843708 00000020:00000080:0.0:1788843798.781956:0:20722:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa762dfcbd58d220a 00000020:00080000:0.0:1788843798.781971:0:20722:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9bd008465800): rc 0 00000020:00000080:0.0:1788843798.781975:0:20722:0:(genops.c:885:class_export_put()) final put ffff9bd008465800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1788843798.782221:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd008465800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:0.0:1788843798.783641:0:20722:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:0.0:1788843798.783648:0:20722:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788843798.783666:0:20722:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788843798.783673:0:20722:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788843798.783857:0:20722:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788843798.783865:0:20722:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:0.0:1788843798.783872:0:20722:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9bd137acd000 1 00000020:00000080:0.0:1788843798.783878:0:20722:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa762dfcbd58d20f9 00000020:00000080:0.0:1788843798.783885:0:20722:0:(genops.c:885:class_export_put()) final put ffff9bd103345800/lustre-MDT0000-osd_UUID 00000020:01000000:0.0:1788843798.783890:0:20722:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:0.0:1788843798.783894:0:20722:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788843798.783897:0:20722:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788843798.783900:0:20722:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff9bd0078b99b8) has no exports 00000020:00000080:0.0:1788843798.813133:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9bd007220800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1788843798.813179:0:38:0:(genops.c:885:class_export_put()) final put ffff9bd141b0a000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:0.0:1788843798.813184:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd141b0a000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:0.0:1788843798.813201:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:0.0:1788843798.814750:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd103345800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000100:00100000:1.0:1788843798.942713:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f954a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1875738134547200:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788843798.942804:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843798.942895:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134547200 00000100:00100000:1.0:1788843798.942904:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134547200 00000100:00100000:1.0:1788843798.942948:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788843798.942955:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f963100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3630:x1875738134547200:12345-0@lo:41:osp-pre-0-1.0 00000020:00080000:1.0:1788843798.942964:0:17155:0:(tgt_handler.c:807:tgt_request_handle()) operation 41 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1788843798.943007:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f963100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3630:x1875738134547200:12345-0@lo:41:osp-pre-0-1.0 Request processed in 51us (204us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788843798.943013:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:02020000:1.0:1788843798.943050:0:3630:0:(client.c:1505:ptlrpc_check_status()) lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 00000100:00100000:0.0:1788843798.960314:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f956680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1875738134547328:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788843798.960418:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843798.960500:0:19943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134547328 00000100:00100000:0.0:1788843798.960508:0:19943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134547328 00000100:00100000:0.0:1788843798.960571:0:19943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788843798.960581:0:19943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f954380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3631:x1875738134547328:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788843798.960621:0:19943:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915857920 avail 3684335616 00000100:00100000:0.0:1788843798.960669:0:19943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f954380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3631:x1875738134547328:12345-0@lo:13:osp-pre-0-1.0 Request processed in 90us (251us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843798.960677:0:19943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:0.0:1788843798.960708:0:17146:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788843798.960750:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f956680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1875738134547328:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1788843798.975944:0:3630:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788843798.975956:0:3630:0:(import.c:65:import_set_state_nolock()) ffff9bd00644e000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1788843798.975962:0:3630:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1788843799.030797:0:3630:0:(import.c:65:import_set_state_nolock()) ffff9bd00644e000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788843799.030874:0:3630:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 500 00000100:00080000:1.0:1788843799.030906:0:3630:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9bd00644e000 using connection 192.168.203.133@tcp/0@lo 00000100:00100000:1.0:1788843799.030968:0:3630:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bd10f963b80 x1875738134547456/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788843799.031190:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f963b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3629:1875738134547456:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:2.0:1788843799.031575:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843799.031650:0:17890:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134547456 00000100:00100000:2.0:1788843799.031660:0:17890:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134547456 00000100:00100000:2.0:1788843799.031704:0:17890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788843799.031711:0:17890:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f8d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3629:x1875738134547456:12345-0@lo:38:ptlrpcd_00_00.0 00010000:00020000:2.0:1788843799.031807:0:17890:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788843799.157915:0:17890:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f8d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3629:x1875738134547456:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 126193us (126331us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788843799.157932:0:17890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:0.0:1788843799.160630:0:3629:0:(import.c:65:import_set_state_nolock()) ffff9bd00644e000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788843799.160647:0:3629:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788843799.160653:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f963b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3629:1875738134547456:0@lo:38:ptlrpcd_00_00.0 00000020:00000080:0.0:1788843799.300281:0:20722:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788843799.300301:0:20722:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:0.0:1788843799.300309:0:20722:0:(genops.c:885:class_export_put()) final put ffff9bd137acc800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788843799.300315:0:20722:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd137acc800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:0.0:1788843799.300331:0:20722:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00010000:00010000:3.0:1788843799.300682:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788843799.300760:0:20722:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9bd137ac8000 00000020:02000400:0.0:1788843799.301268:0:20722:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:2.0:1788843800.350612:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788843800.479004:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788843800.479012:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788843800.479016:0:8:0:(import.c:65:import_set_state_nolock()) ffff9bd00644e000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788843800.479025:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 577 00000100:00080000:2.0:1788843800.479038:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788843800.479045:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9bd00644e000 using connection 192.168.203.133@tcp/0@lo 00000100:00100000:2.0:1788843800.479073:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bd10f8d3480 x1875738134547712/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788843800.479183:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f8d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1875738134547840:0@lo:400:kworker.0 00000100:00100000:2.0:1788843800.479262:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843800.479325:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f8d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3633:1875738134548352:0@lo:400:kworker.0 00000100:00100000:2.0:1788843800.479352:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843800.479376:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1788843800.479381:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f8d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:20b96c6c-8494-483a-b913-89dfc06b1440:3633:1875738134547584:0@lo:400:kworker.0 00000400:00000100:2.0:1788843800.479399:0:3633:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875738134547584 offset 0 length 224: 4 00000100:00100000:2.0:1788843800.479417:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f8d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3633:1875738134548224:0@lo:400:kworker.0 00000100:00100000:2.0:1788843800.479440:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843800.479463:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f8d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3629:1875738134547712:0@lo:38:kworker.0 00000100:00100000:2.0:1788843800.479487:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843800.479517:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f8d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1875738134547968:0@lo:400:kworker.0 00000100:00100000:2.0:1788843800.479551:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843800.479570:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f8d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3630:1875738134548480:0@lo:400:kworker.0 00000100:00100000:2.0:1788843800.479594:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843800.479614:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788843800.479619:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f8d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3630:1875738134548096:0@lo:400:kworker.0 00000100:00100000:2.0:1788843800.479640:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843800.479655:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f8d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3630:1875738134548608:0@lo:400:kworker.0 00000100:00100000:2.0:1788843800.479677:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843800.480014:0:18656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134547840 00000100:00100000:2.0:1788843800.480022:0:18656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134547840 00000100:00100000:2.0:1788843800.480076:0:18656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134547968 00000100:00100000:2.0:1788843800.480079:0:18656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134547968 00000100:00100000:2.0:1788843800.480105:0:18656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788843800.480115:0:18656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141ae8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3633:x1875738134547840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788843800.480187:0:18656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141ae8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3633:x1875738134547840:12345-0@lo:400:kworker.0 Request processed in 74us (926us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843800.480206:0:18656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788843800.480223:0:18656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788843800.480230:0:18656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007ba2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3630:x1875738134547968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788843800.480262:0:18656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007ba2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3630:x1875738134547968:12345-0@lo:400:kworker.0 Request processed in 33us (711us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843800.480269:0:18656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788843800.480287:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134548352 00000100:00100000:2.0:1788843800.480291:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134548352 00000100:00100000:2.0:1788843800.480323:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134548224 00000100:00100000:2.0:1788843800.480326:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134548224 00000100:00100000:2.0:1788843800.480336:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134548480 00000100:00100000:2.0:1788843800.480339:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134548480 00000100:00100000:2.0:1788843800.480346:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134548096 00000100:00100000:2.0:1788843800.480349:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134548096 00000100:00100000:2.0:1788843800.480356:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134548608 00000100:00100000:2.0:1788843800.480358:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134548608 00000100:00100000:2.0:1788843800.480373:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788843800.480378:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007acaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3633:x1875738134548352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788843800.480406:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007acaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3633:x1875738134548352:12345-0@lo:400:kworker.0 Request processed in 29us (1054us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843800.480412:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788843800.480432:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788843800.480438:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007ba3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3630:x1875738134548608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788843800.480465:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007ba3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3630:x1875738134548608:12345-0@lo:400:kworker.0 Request processed in 28us (787us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843800.480471:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788843800.480483:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788843800.480486:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007ac9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3633:x1875738134548224:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1788843800.480492:0:17151:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1788843800.480516:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007ac9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3633:x1875738134548224:12345-0@lo:400:kworker.0 Request processed in 28us (1075us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788843800.480522:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788843800.480533:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788843800.480536:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007ba1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3630:x1875738134548480:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1788843800.480541:0:17151:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1788843800.480561:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007ba1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3630:x1875738134548480:12345-0@lo:400:kworker.0 Request processed in 23us (967us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788843800.480567:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788843800.480578:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788843800.480582:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007ba2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3630:x1875738134548096:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1788843800.480586:0:17151:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1788843800.480605:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007ba2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3630:x1875738134548096:12345-0@lo:400:kworker.0 Request processed in 22us (965us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788843800.480610:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788843800.480628:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134547712 00000100:00100000:2.0:1788843800.480632:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134547712 00000100:00100000:2.0:1788843800.480651:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788843800.480655:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0079b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3629:x1875738134547712:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1788843800.480684:0:17154:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788843800.480727:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0079b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3629:x1875738134547712:12345-0@lo:38:kworker.0 Request processed in 71us (1239us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788843800.480733:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00080000:2.0:1788843800.480761:0:17146:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788843800.480765:0:17146:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788843800.480767:0:17146:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788843800.480802:0:3629:0:(import.c:65:import_set_state_nolock()) ffff9bd00644e000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788843800.480807:0:3629:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788843800.480811:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f8d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3629:1875738134547712:0@lo:38:kworker.0 00000100:00080000:2.0:1788843800.480874:0:3630:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1788843800.480878:0:3630:0:(import.c:65:import_set_state_nolock()) ffff9bd13fab9800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1788843800.480881:0:3630:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:3.0:1788843800.482125:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f956680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1875738134548736:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788843800.482215:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843800.483533:0:18659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134548736 00000100:00100000:0.0:1788843800.483545:0:18659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134548736 00000100:00100000:0.0:1788843800.483593:0:18659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788843800.483601:0:18659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1074fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3632:x1875738134548736:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788843800.483632:0:18659:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1788843800.483688:0:18659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1074fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3632:x1875738134548736:12345-0@lo:13:osp-pre-1-1.0 Request processed in 87us (1472us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843800.483696:0:18659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788843800.483782:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f956680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1875738134548736:0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1788843800.504007:0:3630:0:(import.c:65:import_set_state_nolock()) ffff9bd13fab9800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788843800.504022:0:3630:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 500 00000100:00080000:2.0:1788843800.504033:0:3630:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9bd13fab9800 using connection 192.168.203.133@tcp/0@lo 00000100:00080000:2.0:1788843800.504099:0:3633:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1788843800.504104:0:3633:0:(import.c:65:import_set_state_nolock()) ffff9bd006525800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1788843800.504107:0:3633:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1788843800.504110:0:3633:0:(import.c:65:import_set_state_nolock()) ffff9bd006525800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788843800.504114:0:3633:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 514 00000100:00080000:2.0:1788843800.504118:0:3633:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9bd006525800 using connection 192.168.203.133@tcp/0@lo 00000100:00100000:2.0:1788843800.504209:0:3633:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bd007ba1180 x1875738134548864/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788843800.504253:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f8d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3633:1875738134548224:0@lo:400:kworker.0 00000100:00100000:2.0:1788843800.504285:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f8d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1875738134547840:0@lo:400:kworker.0 00010000:00080000:2.0:1788843800.504298:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff9bd10f8d3100 x1875738134548352/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843816 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788843800.508765:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f8d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3633:1875738134548352:0@lo:400:kworker.0 00000100:00100000:2.0:1788843800.508840:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007ba1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3629:1875738134548864:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:2.0:1788843800.508922:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843800.509019:0:3630:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bd007ba3480 x1875738134548992/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788843800.511792:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f8d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3630:1875738134548096:0@lo:400:kworker.0 00000100:00100000:0.0:1788843800.512697:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134548864 00000100:00100000:0.0:1788843800.512709:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134548864 00000100:00100000:0.0:1788843800.512760:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788843800.512769:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007ba0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3629:x1875738134548864:12345-0@lo:38:ptlrpcd_00_03.0 00010000:00020000:0.0:1788843800.512791:0:17151:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788843800.512883:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007ba0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3629:x1875738134548864:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 113us (3960us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788843800.512891:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788843800.514512:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007ba3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3629:1875738134548992:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:2.0:1788843800.514587:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788843800.514640:0:3629:0:(import.c:65:import_set_state_nolock()) ffff9bd006525800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788843800.514646:0:3629:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788843800.514650:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007ba1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3629:1875738134548864:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:2.0:1788843800.514692:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134548992 00000100:00100000:2.0:1788843800.514697:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134548992 00000100:00100000:2.0:1788843800.514728:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788843800.514734:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007ba3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3629:x1875738134548992:12345-0@lo:38:ptlrpcd_00_00.0 00010000:00020000:2.0:1788843800.514753:0:17150:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788843800.514791:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007ba3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3629:x1875738134548992:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 55us (206us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788843800.514807:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:2.0:1788843800.514849:0:3629:0:(import.c:65:import_set_state_nolock()) ffff9bd13fab9800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788843800.514853:0:3629:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788843800.514856:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007ba3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3629:1875738134548992:0@lo:38:ptlrpcd_00_00.0 00010000:00080000:2.0:1788843800.514886:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff9bd10f8d1180 x1875738134548608/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843816 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788843800.514899:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f8d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3630:1875738134548608:0@lo:400:kworker.0 00000100:00100000:2.0:1788843800.514913:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f8d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1875738134547968:0@lo:400:kworker.0 00000100:00080000:2.0:1788843800.514925:0:3630:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1788843800.514930:0:3630:0:(import.c:65:import_set_state_nolock()) ffff9bd006524800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1788843800.514933:0:3630:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1788843800.514938:0:3630:0:(import.c:65:import_set_state_nolock()) ffff9bd006524800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788843800.514943:0:3630:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 529 00000100:00080000:2.0:1788843800.514949:0:3630:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9bd006524800 using connection 192.168.203.133@tcp/0@lo 00000100:00100000:2.0:1788843800.515003:0:3630:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bd007ba3480 x1875738134549120/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788843800.515049:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f8d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3630:1875738134548480:0@lo:400:kworker.0 00000100:00100000:2.0:1788843800.515063:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007ba3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3629:1875738134549120:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:2.0:1788843800.515114:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843800.515189:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134549120 00000100:00100000:2.0:1788843800.515193:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134549120 00000100:00100000:2.0:1788843800.515213:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788843800.515225:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007ba1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3629:x1875738134549120:12345-0@lo:38:ptlrpcd_00_00.0 00010000:00020000:2.0:1788843800.515256:0:17151:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788843800.515288:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007ba1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3629:x1875738134549120:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 62us (184us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788843800.515294:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00080000:2.0:1788843800.515331:0:3629:0:(import.c:65:import_set_state_nolock()) ffff9bd006524800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788843800.515335:0:3629:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788843800.515339:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007ba3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3629:1875738134549120:0@lo:38:ptlrpcd_00_00.0 00010000:00010000:3.0:1788843801.370537:0:19636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788843802.015606:0:19469:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788843802.015615:0:19469:0:(genops.c:885:class_export_put()) final put ffff9bd006632800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788843802.017978:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd006632800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:2.0:1788843802.018039:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9bd006636800 for lustre-OST0001 00010000:00010000:3.0:1788843802.396319:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788843803.422210:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788843804.059443:0:3632:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788843804.059819:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007ba3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1875738134549248:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788843804.060182:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843804.061121:0:18657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134549248 00000100:00100000:1.0:1788843804.061131:0:18657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134549248 00000100:00100000:1.0:1788843804.063245:0:18657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788843804.063262:0:18657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007ba1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3632:x1875738134549248:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788843804.063298:0:18657:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915857920 avail 3684335616 00000100:00100000:1.0:1788843804.063396:0:18657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007ba1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3632:x1875738134549248:12345-0@lo:13:osp-pre-0-1.0 Request processed in 139us (3214us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843804.063403:0:18657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:2.0:1788843804.063973:0:17146:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788843804.064024:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007ba3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1875738134549248:0@lo:13:osp-pre-0-1.0 00000040:00080000:0.0:1788843804.252326:0:17908:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788843804.442802:0:19636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788843804.567059:0:20923:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:0.0:1788843804.577324:0:20923:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0001 00010000:00010000:0.0:1788843804.577395:0:20923:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd13fbeaa00/0xa762dfcbd58d22f8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d22ff expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843804.577410:0:20923:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd13fbeaa00/0xa762dfcbd58d22f8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xa762dfcbd58d22ff expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843804.577417:0:20923:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd13fbeaa00/0xa762dfcbd58d22f8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xa762dfcbd58d22ff expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843804.577423:0:20923:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.133@tcp lock: ffff9bd13fbeaa00/0xa762dfcbd58d22f8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xa762dfcbd58d22ff expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843804.577440:0:20923:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788843804.577445:0:20923:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1788843804.577469:0:20923:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788843804.577473:0:20923:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:0.0:1788843804.577480:0:20923:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1788843804.577487:0:20923:0:(import.c:65:import_set_state_nolock()) ffff9bd13fab9800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:0.0:1788843804.577491:0:20923:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788843804.577493:0:20923:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1788843804.577496:0:20923:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1788843804.578863:0:20923:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd007946600/0xa762dfcbd58d2257 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d225e expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843804.579084:0:20923:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd007946600/0xa762dfcbd58d2257 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xa762dfcbd58d225e expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843804.579092:0:20923:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd007946600/0xa762dfcbd58d2257 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xa762dfcbd58d225e expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843804.579110:0:20923:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.133@tcp lock: ffff9bd007946600/0xa762dfcbd58d2257 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xa762dfcbd58d225e expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843804.579130:0:20923:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788843804.579137:0:20923:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd10fa3d200/0xa762dfcbd58d2480 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d2487 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843804.579160:0:20923:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd10fa3d200/0xa762dfcbd58d2480 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa762dfcbd58d2487 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843804.579165:0:20923:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd10fa3d200/0xa762dfcbd58d2480 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xa762dfcbd58d2487 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843804.579171:0:20923:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.133@tcp lock: ffff9bd10fa3d200/0xa762dfcbd58d2480 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xa762dfcbd58d2487 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843804.579185:0:20923:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1788843804.579190:0:20923:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd10f7afc00/0xa762dfcbd58d26ef lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d26f6 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843804.579197:0:20923:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd10f7afc00/0xa762dfcbd58d26ef lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa762dfcbd58d26f6 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843804.579203:0:20923:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd10f7afc00/0xa762dfcbd58d26ef lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xa762dfcbd58d26f6 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843804.579208:0:20923:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.133@tcp lock: ffff9bd10f7afc00/0xa762dfcbd58d26ef lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xa762dfcbd58d26f6 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843804.579227:0:20923:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:0.0:1788843804.579232:0:20923:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd007946e00/0xa762dfcbd58d2249 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d2250 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843804.579239:0:20923:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd007946e00/0xa762dfcbd58d2249 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa762dfcbd58d2250 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843804.579245:0:20923:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd007946e00/0xa762dfcbd58d2249 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xa762dfcbd58d2250 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843804.579251:0:20923:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.133@tcp lock: ffff9bd007946e00/0xa762dfcbd58d2249 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xa762dfcbd58d2250 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843804.579258:0:20923:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 10000000:01000000:0.0:1788843804.579261:0:20923:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0001 (0) 00000020:01000004:0.0:1788843804.579283:0:20923:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0001 00000020:01000000:0.0:1788843804.579288:0:20923:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001 (flags='F') 00000020:00000080:0.0:1788843804.579292:0:20923:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788843804.579298:0:20923:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001: forcing exports to disconnect: 2/5 00000020:00080000:0.0:1788843804.579305:0:20923:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff9bd007068000 lustre-MDT0001-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788843804.579311:0:20923:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff9bd132a9e000 lustre-MDT0001-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788843804.579316:0:20923:0:(genops.c:1553:class_disconnect_exports()) OBD device 14 (ffff9bd13eb13370) has exports, disconnecting them 00000020:00080000:0.0:1788843804.579321:0:20923:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff9bd007068000), last request at 1788843800 00000020:00000080:0.0:1788843804.579380:0:20923:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa762dfcbd58d2472 00000100:00080000:0.0:1788843804.579397:0:20923:0:(import.c:65:import_set_state_nolock()) ffff9bd00706c800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1788843804.579438:0:20923:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9bd007068000): rc 0 00000020:00000080:0.0:1788843804.579441:0:20923:0:(genops.c:885:class_export_put()) final put ffff9bd007068000/lustre-MDT0001-lwp-OST0001_UUID 00000020:00080000:0.0:1788843804.579452:0:20923:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff9bd132a9e000), last request at 1788843800 00000020:00000080:0.0:1788843804.579462:0:20923:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa762dfcbd58d23d8 00000100:00080000:0.0:1788843804.579467:0:20923:0:(import.c:65:import_set_state_nolock()) ffff9bd132a9d000 : changing import state from FULL to CLOSED 00000020:00000080:0.0:1788843804.579479:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd007068000/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001 00000020:00000080:0.0:1788843804.579532:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9bd00706c800 for lustre-MDT0001 00000020:00080000:0.0:1788843804.579550:0:20923:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9bd132a9e000): rc 0 00000020:00000080:0.0:1788843804.579552:0:20923:0:(genops.c:885:class_export_put()) final put ffff9bd132a9e000/lustre-MDT0001-lwp-OST0000_UUID 00000004:00000080:0.0:1788843804.579561:0:20923:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=400866e7 len=0 karg=ffffb2dcc1cd7ae0 00000020:00000080:0.0:1788843804.579571:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd132a9e000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000020:00000080:0.0:1788843804.579594:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9bd132a9d000 for lustre-MDT0001 00000100:00080000:0.0:1788843804.579613:0:20923:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788843804.579624:0:20923:0:(client.c:3601:ptlrpc_abort_inflight()) @@@ aborting waiting req req@ffff9bd10f954a80 x1875738134547200/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788843814 ref 1 fl Rpc:RSQU/200/0 rc -107/-107 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788843804.579638:0:20923:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 3 00010000:00010000:2.0:1788843804.580722:0:17139:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1788843804.580732:0:17139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.133@tcp lock: ffff9bd13fbeaa00/0xa762dfcbd58d22f8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xa762dfcbd58d22ff expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843804.580742:0:17139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd13fbeaa00 already unused, calling callback (ffffffffc12a7c20) 10000000:00010000:2.0:1788843804.580746:0:17139:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.133@tcp lock: ffff9bd13fbeaa00/0xa762dfcbd58d22f8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xa762dfcbd58d22ff expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843804.580757:0:17139:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.133@tcp lock: ffff9bd13fbeaa00/0xa762dfcbd58d22f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0xa762dfcbd58d22ff expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788843804.580779:0:17139:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.133@tcp lock: ffff9bd13fbeaa00/0xa762dfcbd58d22f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0xa762dfcbd58d22ff expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788843804.580785:0:17139:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788843804.580788:0:17139:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1788843804.580801:0:17139:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1788843804.580839:0:17139:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.133@tcp lock: ffff9bd13fbeaa00/0xa762dfcbd58d22f8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xa762dfcbd58d22ff expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843804.580846:0:17139:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788843804.580864:0:17139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.133@tcp lock: ffff9bd13fbeaa00/0xa762dfcbd58d22f8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xa762dfcbd58d22ff expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843804.580871:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.133@tcp lock: ffff9bd13fbeaa00/0xa762dfcbd58d22f8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xa762dfcbd58d22ff expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843804.580883:0:17139:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1788843804.580887:0:17139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.133@tcp lock: ffff9bd007946600/0xa762dfcbd58d2257 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xa762dfcbd58d225e expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843804.580892:0:17139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd007946600 already unused, calling callback (ffffffffc12a7c20) 10000000:00010000:2.0:1788843804.580895:0:17139:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.133@tcp lock: ffff9bd007946600/0xa762dfcbd58d2257 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xa762dfcbd58d225e expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843804.580902:0:17139:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.133@tcp lock: ffff9bd007946600/0xa762dfcbd58d2257 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0xa762dfcbd58d225e expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788843804.580908:0:17139:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.133@tcp lock: ffff9bd007946600/0xa762dfcbd58d2257 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0xa762dfcbd58d225e expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788843804.580923:0:17139:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788843804.580926:0:17139:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0001: stopping, won't requeue 10000000:01000000:2.0:1788843804.580928:0:17139:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0001 00010000:00010000:2.0:1788843804.580940:0:17139:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.133@tcp lock: ffff9bd007946600/0xa762dfcbd58d2257 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xa762dfcbd58d225e expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843804.580946:0:17139:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788843804.580952:0:17139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.133@tcp lock: ffff9bd007946600/0xa762dfcbd58d2257 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xa762dfcbd58d225e expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843804.580959:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.133@tcp lock: ffff9bd007946600/0xa762dfcbd58d2257 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xa762dfcbd58d225e expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843804.580967:0:17139:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788843804.580970:0:17139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.133@tcp lock: ffff9bd10fa3d200/0xa762dfcbd58d2480 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xa762dfcbd58d2487 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843804.580976:0:17139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd10fa3d200 already unused, calling callback (ffffffffc12a7c20) 10000000:00010000:2.0:1788843804.580979:0:17139:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.133@tcp lock: ffff9bd10fa3d200/0xa762dfcbd58d2480 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xa762dfcbd58d2487 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843804.580986:0:17139:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.133@tcp lock: ffff9bd10fa3d200/0xa762dfcbd58d2480 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xa762dfcbd58d2487 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788843804.580993:0:17139:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.133@tcp lock: ffff9bd10fa3d200/0xa762dfcbd58d2480 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xa762dfcbd58d2487 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788843804.580998:0:17139:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:2.0:1788843804.581000:0:17139:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:2.0:1788843804.581006:0:17139:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:2.0:1788843804.581019:0:17139:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.133@tcp lock: ffff9bd10fa3d200/0xa762dfcbd58d2480 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xa762dfcbd58d2487 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843804.581026:0:17139:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788843804.581042:0:17139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.133@tcp lock: ffff9bd10fa3d200/0xa762dfcbd58d2480 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xa762dfcbd58d2487 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843804.581049:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.133@tcp lock: ffff9bd10fa3d200/0xa762dfcbd58d2480 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xa762dfcbd58d2487 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843804.581061:0:17139:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788843804.581065:0:17139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.133@tcp lock: ffff9bd10f7afc00/0xa762dfcbd58d26ef lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xa762dfcbd58d26f6 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843804.581071:0:17139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd10f7afc00 already unused, calling callback (ffffffffc12a7c20) 10000000:00010000:2.0:1788843804.581075:0:17139:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.133@tcp lock: ffff9bd10f7afc00/0xa762dfcbd58d26ef lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xa762dfcbd58d26f6 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843804.581080:0:17139:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.133@tcp lock: ffff9bd10f7afc00/0xa762dfcbd58d26ef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xa762dfcbd58d26f6 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788843804.581098:0:17139:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.133@tcp lock: ffff9bd10f7afc00/0xa762dfcbd58d26ef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xa762dfcbd58d26f6 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788843804.581104:0:17139:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1788843804.581106:0:17139:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1788843804.581108:0:17139:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1788843804.581120:0:17139:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.133@tcp lock: ffff9bd10f7afc00/0xa762dfcbd58d26ef lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xa762dfcbd58d26f6 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843804.581126:0:17139:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788843804.581138:0:17139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.133@tcp lock: ffff9bd10f7afc00/0xa762dfcbd58d26ef lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xa762dfcbd58d26f6 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843804.581160:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.133@tcp lock: ffff9bd10f7afc00/0xa762dfcbd58d26ef lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xa762dfcbd58d26f6 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843804.581170:0:17139:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788843804.581173:0:17139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.133@tcp lock: ffff9bd007946e00/0xa762dfcbd58d2249 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xa762dfcbd58d2250 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843804.581179:0:17139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd007946e00 already unused, calling callback (ffffffffc12a7c20) 10000000:00010000:2.0:1788843804.581181:0:17139:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.133@tcp lock: ffff9bd007946e00/0xa762dfcbd58d2249 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xa762dfcbd58d2250 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843804.581189:0:17139:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.133@tcp lock: ffff9bd007946e00/0xa762dfcbd58d2249 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xa762dfcbd58d2250 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788843804.581194:0:17139:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.133@tcp lock: ffff9bd007946e00/0xa762dfcbd58d2249 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xa762dfcbd58d2250 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788843804.581199:0:17139:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:2.0:1788843804.581201:0:17139:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:2.0:1788843804.581212:0:17139:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:2.0:1788843804.581226:0:17139:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.133@tcp lock: ffff9bd007946e00/0xa762dfcbd58d2249 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xa762dfcbd58d2250 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843804.581231:0:17139:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788843804.581236:0:17139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.133@tcp lock: ffff9bd007946e00/0xa762dfcbd58d2249 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xa762dfcbd58d2250 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843804.581241:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.133@tcp lock: ffff9bd007946e00/0xa762dfcbd58d2249 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xa762dfcbd58d2250 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843804.581261:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788843804.581263:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788843804.581264:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788843804.581284:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007ba0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:20b96c6c-8494-483a-b913-89dfc06b1440:3631:1875738134549504:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788843804.581352:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843804.581411:0:3631:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1788843804.581418:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007ba3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:20b96c6c-8494-483a-b913-89dfc06b1440:3631:1875738134549376:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788843804.581439:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843804.581456:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007ba0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:20b96c6c-8494-483a-b913-89dfc06b1440:3631:1875738134549888:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788843804.582324:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f954a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1875738134547200:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788843804.582330:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843804.582371:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007ba2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:20b96c6c-8494-483a-b913-89dfc06b1440:3632:1875738134549632:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788843804.582393:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843804.582407:0:3632:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788843804.582412:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007ba3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:20b96c6c-8494-483a-b913-89dfc06b1440:3632:1875738134549760:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788843804.582431:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843804.582577:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134549504 00000100:00100000:2.0:1788843804.582586:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134549504 00010000:00010000:3.0:1788843804.582615:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788843804.582615:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134549376 00000100:00100000:2.0:1788843804.582618:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134549376 00010000:00010000:3.0:1788843804.582621:0:19636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788843804.582626:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134549888 00000100:00100000:2.0:1788843804.582628:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134549888 00000100:00100000:2.0:1788843804.582634:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134549632 00000100:00100000:2.0:1788843804.582635:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134549632 00000100:00100000:2.0:1788843804.582642:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134549760 00000100:00100000:2.0:1788843804.582644:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134549760 00000100:00100000:2.0:1788843804.582656:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788843804.582664:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007ba1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3631:x1875738134549504:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1788843804.582679:0:17137:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788843804 with bad export cookie 12061448818605760796 00000100:00080000:0.0:1788843804.583004:0:20923:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1788843804.583010:0:20923:0:(import.c:65:import_set_state_nolock()) ffff9bd00644e000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:0.0:1788843804.584213:0:20923:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1788843804.584219:0:20923:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 3 00000004:00080000:0.0:1788843804.584234:0:20923:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1788843804.584299:0:20923:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:0.0:1788843804.584321:0:20923:0:(import.c:65:import_set_state_nolock()) ffff9bd104818000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:0.0:1788843804.584405:0:20923:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1788843804.584408:0:20923:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 3 00000004:00080000:0.0:1788843804.584416:0:20923:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1788843804.584632:0:20923:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:0.0:1788843804.584643:0:20923:0:(import.c:65:import_set_state_nolock()) ffff9bd141b67000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:0.0:1788843804.584680:0:20923:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff9bd13eb13370) has no exports 00000100:00100000:2.0:1788843804.594921:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f954a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3629:1875738134550016:0@lo:9:umount.0 00000100:00100000:2.0:1788843804.594994:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843804.595040:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f957800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3629:1875738134550144:0@lo:9:umount.0 00000100:00100000:2.0:1788843804.595064:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843804.595106:0:18656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134550016 00000100:00100000:2.0:1788843804.595114:0:18656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134550016 00000100:00100000:2.0:1788843804.595188:0:18656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134550144 00000100:00100000:2.0:1788843804.595192:0:18656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134550144 00000100:00100000:2.0:1788843804.595223:0:18656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788843804.595232:0:18656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007ba0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3629:x1875738134550016:12345-0@lo:9:umount.0 00000020:00000080:2.0:1788843804.595259:0:18656:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa762dfcbd58d2402 00000100:00080000:2.0:1788843804.595270:0:18656:0:(import.c:65:import_set_state_nolock()) ffff9bd007068800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788843804.595307:0:18656:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934600 00000100:00100000:2.0:1788843804.595436:0:18656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007ba0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+2:3629:x1875738134550016:12345-0@lo:9:umount.0 Request processed in 204us (441us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843804.595445:0:18656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788843804.595462:0:18656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788843804.595469:0:18656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f8d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3629:x1875738134550144:12345-0@lo:9:umount.0 00000020:00000080:2.0:1788843804.595481:0:18656:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa762dfcbd58d24aa 00000100:00080000:2.0:1788843804.595485:0:18656:0:(import.c:65:import_set_state_nolock()) ffff9bd006632000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788843804.595514:0:18656:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:2.0:1788843804.595580:0:18656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f8d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+2:3629:x1875738134550144:12345-0@lo:9:umount.0 Request processed in 112us (515us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843804.595586:0:18656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:2.0:1788843804.595604:0:17146:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788843804.595635:0:3629:0:(import.c:65:import_set_state_nolock()) ffff9bd104818000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00010000:00010000:3.0:1788843804.595666:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1788843804.595670:0:3629:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1788843804.595672:0:3629:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788843804.595676:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f954a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3629:1875738134550016:0@lo:9:umount.0 00000100:00080000:2.0:1788843804.595691:0:3629:0:(import.c:65:import_set_state_nolock()) ffff9bd141b67000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1788843804.595707:0:3629:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1788843804.595710:0:3629:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788843804.595713:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f957800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3629:1875738134550144:0@lo:9:umount.0 00010000:00010000:2.0:1788843804.595735:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788843804.595781:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007ba1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3631:x1875738134549504:12345-0@lo:103:ldlm_bl.0 Request processed in 13117us (14430us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788843804.595789:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:3.0:1788843804.595959:0:3631:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.203.133@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1788843804.595964:0:3631:0:(import.c:65:import_set_state_nolock()) ffff9bd008551800 MGS: changing import state from FULL to DISCONN 00000100:02020000:3.0:1788843804.595968:0:3631:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.203.133@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00100000:2.0:1788843804.600283:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788843804.600297:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007ba0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3631:x1875738134549376:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1788843804.600306:0:17137:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788843804 with bad export cookie 12061448818605760796 00000100:00100000:2.0:1788843804.600391:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007ba0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3631:x1875738134549376:12345-0@lo:103:ldlm_bl.0 Request processed in 95us (18950us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788843804.600399:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788843804.600415:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788843804.600420:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007ba1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3631:x1875738134549888:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1788843804.600424:0:17137:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788843804 with bad export cookie 12061448818605760796 00000100:00100000:2.0:1788843804.600455:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007ba1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3631:x1875738134549888:12345-0@lo:103:ldlm_bl.0 Request processed in 33us (18125us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788843804.600512:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788843804.600585:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788843804.600590:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007ba2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3632:x1875738134549632:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1788843804.600595:0:17137:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788843804 with bad export cookie 12061448818605760796 00000100:00100000:2.0:1788843804.600695:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007ba2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3632:x1875738134549632:12345-0@lo:103:ldlm_bl.0 Request processed in 104us (18301us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788843804.600714:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788843804.600728:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788843804.600733:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0013ab050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3632:x1875738134549760:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1788843804.600736:0:17137:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788843804 with bad export cookie 12061448818605760796 00000100:00100000:2.0:1788843804.600762:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0013ab050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3632:x1875738134549760:12345-0@lo:103:ldlm_bl.0 Request processed in 29us (18330us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788843804.600767:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:3.0:1788843804.605677:0:3631:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.203.133@tcp not replayable, auto-deactivating 00000100:00080000:3.0:1788843804.605684:0:3631:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1788843804.605695:0:3631:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9bd10f8d2d80 x1875738134547584/t0(0) o400->MGC192.168.203.133@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788843816 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788843804.605717:0:3631:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9bd007ba0000 x1875738134549504/t0(0) o103->MGC192.168.203.133@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788843820 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788843804.605727:0:3631:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9bd007ba3480 x1875738134549376/t0(0) o103->MGC192.168.203.133@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788843820 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788843804.605734:0:3631:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9bd007ba0700 x1875738134549888/t0(0) o103->MGC192.168.203.133@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788843820 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788843804.605742:0:3631:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9bd007ba2300 x1875738134549632/t0(0) o103->MGC192.168.203.133@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788843820 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788843804.607000:0:3631:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9bd007ba3100 x1875738134549760/t0(0) o103->MGC192.168.203.133@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788843820 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788843804.607105:0:3632:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.203.133@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788843804.607109:0:3632:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff9bd008551800 already not connected (conn 1, was 1): DISCONN 00000100:00100000:1.0:1788843804.607130:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007ba3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:20b96c6c-8494-483a-b913-89dfc06b1440:3632:1875738134549760:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788843804.607136:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007ba2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:20b96c6c-8494-483a-b913-89dfc06b1440:3632:1875738134549632:0@lo:103:ldlm_bl.0 10000000:01000000:3.0:1788843804.607205:0:3631:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1788843804.607208:0:3631:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 00000100:00100000:2.0:1788843804.607211:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f8d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:20b96c6c-8494-483a-b913-89dfc06b1440:3633:1875738134547584:0@lo:400:kworker.0 10000000:01000000:3.0:1788843804.607228:0:3631:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:3.0:1788843804.608020:0:3631:0:(import.c:65:import_set_state_nolock()) ffff9bd008551800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788843804.608028:0:3631:0:(import.c:510:import_select_connection()) MGC192.168.203.133@tcp: connect to NID 0@lo last attempt 485 00000100:00080000:3.0:1788843804.608038:0:3631:0:(import.c:624:import_select_connection()) MGC192.168.203.133@tcp: import ffff9bd008551800 using connection 192.168.203.133@tcp/0@lo 00000100:00100000:1.0:1788843804.608468:0:3631:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bd10f963800 x1875738134550272/t0(0) o250->MGC192.168.203.133@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788843804.608498:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007ba3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:20b96c6c-8494-483a-b913-89dfc06b1440:3631:1875738134549376:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788843804.608505:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007ba0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:20b96c6c-8494-483a-b913-89dfc06b1440:3631:1875738134549888:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788843804.608509:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007ba0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:20b96c6c-8494-483a-b913-89dfc06b1440:3631:1875738134549504:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788843804.608608:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f963800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:20b96c6c-8494-483a-b913-89dfc06b1440:3629:1875738134550272:0@lo:250:ptlrpcd_00_01.0 00000400:00000100:2.0:1788843804.608654:0:3629:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875738134550272 offset 0 length 520: 4 00000020:00080000:1.0:1788843804.614220:0:20923:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff9bd13eb13370) has no exports 00000020:01000000:0.0:1788843804.679381:0:20923:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9bd00655aae0 - data ffff9bd131bc81b0/ffff9bd124e0b000 00000020:01000000:0.0:1788843804.679550:0:20923:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9bd11aebe2a0 - data ffff9bd005c14bd0/ffff9bd124c14400 00000001:00000004:0.0:1788843804.695560:0:20923:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934595 00000100:00080000:2.0:1788843804.776337:0:20923:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788843804.776347:0:20923:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788843804.776355:0:20923:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:2.0:1788843804.783918:0:20923:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788843804.783926:0:20923:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 4 00000004:00080000:2.0:1788843804.783946:0:20923:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788843804.783949:0:20923:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1788843804.785375:0:17891:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1788843804.785381:0:17891:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 1 count 1 00000040:00080000:1.0:1788843804.785392:0:17891:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 2 count 2 00000100:00080000:2.0:1788843804.786309:0:20923:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788843804.786314:0:20923:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 4 00000004:00080000:2.0:1788843804.786339:0:20923:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788843804.786342:0:20923:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1788843804.787439:0:17893:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1788843804.787445:0:17893:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 1 count 1 00000040:00080000:0.0:1788843804.787455:0:17893:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 2 count 2 00000020:00000080:2.0:1788843804.790823:0:20923:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa762dfcbd58d226c 00000020:00000080:2.0:1788843804.790834:0:20923:0:(genops.c:885:class_export_put()) final put ffff9bd10481d000/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1788843804.791297:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd10481d000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:2.0:1788843804.795011:0:20923:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa762dfcbd58d2281 00000020:00000080:2.0:1788843804.795026:0:20923:0:(genops.c:885:class_export_put()) final put ffff9bd12e00c800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:2.0:1788843804.795049:0:20923:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-mdtlov (flags='') 00000020:00000080:2.0:1788843804.795056:0:20923:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788843804.795076:0:20923:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788843804.795089:0:20923:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff9bd13eb14d28) has no exports 00000020:00000080:0.0:1788843804.795401:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd12e00c800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000004:01000000:2.0:1788843804.796269:0:20923:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:2.0:1788843804.796280:0:20923:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa762dfcbd58d22d5 00000020:00000080:2.0:1788843804.796285:0:20923:0:(genops.c:885:class_export_put()) final put ffff9bd007a54000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:2.0:1788843804.796293:0:20923:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0001 (flags='') 00000020:00000080:2.0:1788843804.796298:0:20923:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788843804.796304:0:20923:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1788843804.796308:0:20923:0:(genops.c:1558:class_disconnect_exports()) OBD device 18 (ffff9bd1203f0000) has no exports 00000020:00000080:2.0:1788843804.796314:0:20923:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa762dfcbd58d22ce 00000020:00000080:2.0:1788843804.796317:0:20923:0:(genops.c:885:class_export_put()) final put ffff9bd141b60800/lustre-MDT0001-osd_UUID 00010000:01000000:1.0:1788843804.796760:0:20923:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0001: client import never connected 00000100:00080000:1.0:1788843804.796766:0:20923:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788843804.796770:0:20923:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 5 00000004:00080000:1.0:1788843804.796776:0:20923:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788843804.796779:0:20923:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788843804.796824:0:20923:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788843804.796831:0:20923:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1788843804.796836:0:20923:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa762dfcbd58d22c0 00000020:00000080:1.0:1788843804.796842:0:20923:0:(genops.c:885:class_export_put()) final put ffff9bd132a98000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:1.0:1788843804.796845:0:20923:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0001 (flags='') 00000020:00000080:1.0:1788843804.796849:0:20923:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788843804.796853:0:20923:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788843804.796855:0:20923:0:(genops.c:1558:class_disconnect_exports()) OBD device 17 (ffff9bd13e918000) has no exports 00000020:00000080:1.0:1788843804.796860:0:20923:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa762dfcbd58d22b9 00000020:00000080:1.0:1788843804.796863:0:20923:0:(genops.c:885:class_export_put()) final put ffff9bd104819800/lustre-MDT0001-osd_UUID 00010000:01000000:1.0:1788843804.797340:0:20923:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0001: client import never connected 00000100:00080000:1.0:1788843804.797344:0:20923:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1788843804.797347:0:20923:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 5 00000004:00080000:1.0:1788843804.797351:0:20923:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788843804.797352:0:20923:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788843804.797378:0:20923:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788843804.797383:0:20923:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000004:01000000:1.0:1788843804.797395:0:20923:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:1.0:1788843804.797401:0:20923:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa762dfcbd58d22a4 00000020:00000080:1.0:1788843804.797406:0:20923:0:(genops.c:885:class_export_put()) final put ffff9bd120395800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:1.0:1788843804.797410:0:20923:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osp-MDT0001 (flags='F') 00000020:00000080:1.0:1788843804.797413:0:20923:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788843804.797417:0:20923:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osp-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788843804.797420:0:20923:0:(genops.c:1558:class_disconnect_exports()) OBD device 16 (ffff9bd13df30000) has no exports 00000020:00000080:1.0:1788843804.797432:0:20923:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa762dfcbd58d229d 00000020:00000080:1.0:1788843804.797435:0:20923:0:(genops.c:885:class_export_put()) final put ffff9bd00644d800/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1788843804.798291:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd007a54000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:00000080:0.0:1788843804.798300:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd141b60800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:0.0:1788843804.798306:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9bd141b67000 for lustre-OST0001-osc-MDT0001 00000020:00000080:0.0:1788843804.798311:0:36:0:(genops.c:885:class_export_put()) final put ffff9bd132a9a800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1788843804.798314:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd132a9a800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:01000000:0.0:1788843804.798318:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788843804.798399:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd132a98000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:00000080:0.0:1788843804.798404:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd104819800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:0.0:1788843804.798408:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9bd104818000 for lustre-OST0000-osc-MDT0001 00000020:00000080:0.0:1788843804.798412:0:36:0:(genops.c:885:class_export_put()) final put ffff9bd120390800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1788843804.798414:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd120390800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:01000000:0.0:1788843804.798417:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788843804.798442:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd120395800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:00000080:0.0:1788843804.798446:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd00644d800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:0.0:1788843804.799238:0:20923:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-osp-MDT0001: client import never connected 00000100:00080000:0.0:1788843804.799243:0:20923:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788843804.799246:0:20923:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788843804.799252:0:20923:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788843804.799292:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9bd00644e000 for lustre-MDT0000-osp-MDT0001 00000020:00000080:0.0:1788843804.799296:0:20923:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788843804.799313:0:20923:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788843804.799320:0:20923:0:(genops.c:885:class_export_put()) final put ffff9bd10481f800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1788843804.799323:0:20923:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd10481f800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:01000000:0.0:1788843804.799338:0:20923:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osp-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788843804.799464:0:20923:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788843804.799469:0:20923:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788843804.799473:0:20923:0:(genops.c:885:class_export_put()) final put ffff9bd10481b000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1788843804.799475:0:20923:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd10481b000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:0.0:1788843804.799479:0:20923:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-mdtlov (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788843804.799718:0:20923:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa762dfcbd58d2288 00000020:00000080:0.0:1788843804.799724:0:20923:0:(genops.c:885:class_export_put()) final put ffff9bd12e008800/lustre-MDD0001_UUID 00000020:01000000:0.0:1788843804.799742:0:20923:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0001 (flags='') 00000020:00000080:0.0:1788843804.799747:0:20923:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788843804.799751:0:20923:0:(obd_config.c:956:class_cleanup()) lustre-MDD0001: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788843804.799755:0:20923:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff9bd13eb10000) has no exports 00000020:00000080:0.0:1788843804.799775:0:20923:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788843804.799778:0:20923:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000020:00000080:0.0:1788843804.799782:0:20923:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa762dfcbd58d228f 00000020:00000080:0.0:1788843804.799785:0:20923:0:(genops.c:885:class_export_put()) final put ffff9bd12e00d800/lustre-MDT0001-osd_UUID 00000020:01000004:0.0:1788843804.799802:0:20923:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9bd10f7b9800 from lustre-MDT0001, refs=2 00000020:01000004:0.0:1788843804.799806:0:20923:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9bd10f7b9800 2 00000020:01000004:0.0:1788843804.799809:0:20923:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9bd10f7b9800 from lustre-MDT0001 00000020:00000080:0.0:1788843804.799829:0:20923:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788843804.799833:0:20923:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:00000080:0.0:1788843804.799835:0:20923:0:(genops.c:885:class_export_put()) final put ffff9bd10481b800/lustre-MDT0001_UUID 00000020:00000080:0.0:1788843804.799837:0:20923:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd10481b800/lustre-MDT0001_UUID for lustre-MDT0001 00000020:01000000:0.0:1788843804.799843:0:20923:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001 (lustre-MDT0001_UUID) 00000020:00000080:2.0:1788843804.800099:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd12e008800/lustre-MDD0001_UUID for lustre-MDD0001 00000020:00000080:2.0:1788843804.800104:0:36:0:(genops.c:885:class_export_put()) final put ffff9bd10481d800/lustre-MDD0001_UUID 00000020:00000080:2.0:1788843804.800106:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd10481d800/lustre-MDD0001_UUID for lustre-MDD0001 00000020:01000000:2.0:1788843804.800115:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0001 (lustre-MDD0001_UUID) 00000020:00000080:2.0:1788843804.800234:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd12e00d800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000004:0.0:1788843804.800965:0:20923:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000000:0.0:1788843804.800970:0:20923:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0001 (flags='F') 00000020:00000080:0.0:1788843804.800974:0:20923:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788843804.800980:0:20923:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788843804.800992:0:20923:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0001: ACTIVE ffff9bd0059c4800 lustre-MDT0000-lwp-MDT0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788843804.800998:0:20923:0:(genops.c:1553:class_disconnect_exports()) OBD device 19 (ffff9bd13e91cd28) has exports, disconnecting them 00000020:00080000:0.0:1788843804.801003:0:20923:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0001: disconnecting export at 0@lo (ffff9bd0059c4800), last request at 1788843722 00000020:00000080:0.0:1788843804.801007:0:20923:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa762dfcbd58d230d 00000020:00080000:0.0:1788843804.801077:0:20923:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9bd0059c4800): rc 0 00000020:00000080:0.0:1788843804.801081:0:20923:0:(genops.c:885:class_export_put()) final put ffff9bd0059c4800/lustre-MDT0000-lwp-MDT0001 00000020:00000080:2.0:1788843804.802551:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd0059c4800/lustre-MDT0000-lwp-MDT0001 for lustre-MDT0000-lwp-MDT0001 00010000:01000000:2.0:1788843804.842342:0:20923:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0001: client import never connected 00000100:00080000:2.0:1788843804.842353:0:20923:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788843804.842357:0:20923:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788843804.842365:0:20923:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788843804.842401:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9bd13fab9800 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:2.0:1788843804.842595:0:20923:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788843804.842604:0:20923:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000020:00000080:2.0:1788843804.842609:0:20923:0:(genops.c:885:class_export_put()) final put ffff9bd13fabe000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00000080:2.0:1788843804.842613:0:20923:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd13fabe000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000-lwp-MDT0001 00000020:01000000:2.0:1788843804.842623:0:20923:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0001 (lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000004:2.0:1788843804.842687:0:20923:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9bd10f7b9800 1 00000020:00000080:2.0:1788843804.842694:0:20923:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa762dfcbd58d2234 00000020:00000080:2.0:1788843804.842711:0:20923:0:(genops.c:885:class_export_put()) final put ffff9bd12e2b3000/lustre-MDT0001-osd_UUID 00000020:01000000:2.0:1788843804.842720:0:20923:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osd (flags='') 00000020:00000080:2.0:1788843804.842728:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd12e2b3000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:2.0:1788843804.842737:0:20923:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788843804.842742:0:20923:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788843804.842746:0:20923:0:(genops.c:1558:class_disconnect_exports()) OBD device 12 (ffff9bd133398000) has no exports 00000020:00000080:1.0:1788843805.052400:0:20923:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788843805.052415:0:20923:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00000020:00000080:1.0:1788843805.052422:0:20923:0:(genops.c:885:class_export_put()) final put ffff9bd11238a000/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1788843805.052427:0:20923:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd11238a000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:1.0:1788843805.052437:0:20923:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osd (lustre-MDT0001-osd_UUID) 00000020:01000004:1.0:1788843805.052586:0:20923:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9bd112389800 00000020:01000000:1.0:1788843805.052609:0:20923:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:1.0:1788843805.052614:0:20923:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788843805.052619:0:20923:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788843805.052624:0:20923:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff9bd10fbb4d28) has no exports 00000100:00100000:2.0:1788843805.053044:0:17150:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff9bd006446400:17150] 1 exiting: rc = 0 00000100:00100000:2.0:1788843805.053199:0:19944:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff9bd124d98800:19944] 3 exiting: rc = 0 00000100:00100000:0.0:1788843805.053597:0:17151:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff9bd006447600:17151] 2 exiting: rc = 0 00000100:00100000:2.0:1788843805.058426:0:17149:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff9bd006447200:17149] 0 exiting: rc = 1 00000100:00100000:0.0:1788843805.058606:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.058617:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.058624:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.058631:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.058637:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.058879:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.058891:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.058897:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.058902:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.058907:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.058913:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.058920:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.058926:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.058932:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.058937:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.058943:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.058948:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.058954:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.058960:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.058965:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.058970:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.058976:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.058982:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.058987:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.058993:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.058999:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.059074:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.059080:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.059085:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.059363:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.059371:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.059376:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.059382:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.059388:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.059394:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.059400:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.059405:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.059411:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.059417:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.059422:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.059428:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.059434:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.059440:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.059445:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.059451:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.059456:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.059461:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.059465:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.059471:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.059476:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.059480:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.059485:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.059490:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.059497:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.059503:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.059509:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.059514:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.059519:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.059525:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.059529:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.059535:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.059549:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.059555:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.059560:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843805.073393:0:17153:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff9bd006447400:17153] 1 exiting: rc = 0 00000100:00100000:2.0:1788843805.075281:0:17152:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff9bd0079eb200:17152] 0 exiting: rc = 1 00000100:00100000:1.0:1788843805.075566:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843805.075575:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843805.075583:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843805.075588:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843805.075594:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843805.075599:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843805.075605:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843805.075610:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843805.075634:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843805.075640:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843805.075646:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843805.075651:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843805.075656:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843805.075662:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843805.075667:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843805.075673:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843805.075699:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843805.075719:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843805.075725:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843805.075731:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843805.075736:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843805.075770:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843805.075776:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843805.075796:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843805.075802:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843805.075807:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843805.075812:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843805.075825:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843805.075831:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843805.075836:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843805.075840:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843805.075845:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843805.075850:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843805.075863:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843805.075869:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843805.075874:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843805.075879:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843805.075893:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843805.075898:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843805.075904:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843805.075909:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843805.075914:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843805.075926:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843805.075933:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843805.075939:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843805.075944:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843805.075957:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843805.075962:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843805.075968:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843805.075973:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843805.075986:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843805.075992:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843805.075997:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843805.076002:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843805.076007:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843805.076030:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843805.076045:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843805.076050:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843805.076055:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843805.076068:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843805.076074:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843805.076080:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843805.076092:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843805.076099:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843805.076967:0:17155:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff9bd1049f6200:17155] 1 exiting: rc = 0 00000100:00100000:3.0:1788843805.077544:0:17890:0:(service.c:3183:ptlrpc_main()) mdt_out00_002: service thread [ffff9bd00184ee00:17890] 2 exiting: rc = 0 00000100:00100000:3.0:1788843805.077914:0:17154:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff9bd1049f6a00:17154] 0 exiting: rc = 1 00000100:00100000:1.0:1788843805.078438:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843805.078445:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843805.078452:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843805.078458:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843805.078464:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843805.078470:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843805.078476:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843805.078482:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843805.078500:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843805.078509:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843805.078515:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843805.078521:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843805.078527:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843805.078544:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843805.078551:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843805.078557:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843805.078562:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843805.078569:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843805.078575:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843805.078581:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843805.078603:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843805.078613:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843805.078619:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843805.078626:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843805.078632:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843805.078638:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843805.078667:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843805.078674:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843805.078681:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843805.078687:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843805.078694:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843805.078700:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843805.078982:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843805.078990:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843805.078996:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843805.079003:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843805.079020:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843805.079028:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843805.079034:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843805.079041:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843805.079047:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843805.079054:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843805.079061:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843805.079067:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843805.079086:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843805.079093:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843805.079098:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843805.079104:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843805.079110:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843805.079116:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843805.079121:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843805.079127:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843805.079134:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843805.079277:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843805.079286:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843805.079295:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843805.079316:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843805.079322:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843805.079329:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843805.079336:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843805.079344:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843805.079355:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843805.079362:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843805.079369:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843805.095605:0:17157:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff9bd0066fd200:17157] 1 exiting: rc = 0 00000100:00100000:1.0:1788843805.095856:0:17156:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff9bd106ba5400:17156] 0 exiting: rc = 1 00000100:00100000:0.0:1788843805.096495:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.096504:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.096510:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.096516:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.096522:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.096527:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.096531:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.096537:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.096543:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.096548:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.096554:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.096559:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.096564:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.096569:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.096574:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.096579:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.096585:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.096590:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.096596:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.096601:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.096606:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.096611:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.096616:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.096621:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.096626:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.096632:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.096636:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.096641:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.096645:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.096663:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.096669:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.096674:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.096691:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.096696:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.096702:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.096708:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.096713:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.096719:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.096724:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.096730:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.096735:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.096741:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.096746:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.096752:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.096766:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.096772:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.096777:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.096782:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.096788:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.096801:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.096806:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.096810:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.096815:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.096821:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.096827:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.096832:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.096837:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.096843:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.096848:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.096854:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.096859:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.096864:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.096869:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.096875:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843805.097288:0:17159:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff9bd0066fd400:17159] 1 exiting: rc = 0 00000100:00100000:3.0:1788843805.097579:0:17158:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff9bd13e858a00:17158] 0 exiting: rc = 1 00000100:00100000:0.0:1788843805.098319:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.098326:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.098332:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.098347:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.098351:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.098356:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.098362:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.098367:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.098372:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.098377:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.098383:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.098388:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.098393:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.098398:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.098404:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.098409:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.098415:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.098420:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.098426:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.098430:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.098434:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.098439:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.098443:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.098448:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.098453:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.098458:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.098464:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.098470:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.098475:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.098480:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.098485:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.098491:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.098496:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.098501:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.098507:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.098512:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.098517:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.098522:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.098535:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.098540:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.098546:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.098551:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.098557:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.098562:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.098566:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.098571:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.098576:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.098581:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.098586:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.098591:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.098596:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.098601:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.098605:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.098610:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.098615:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.098620:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.098625:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.098631:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.098636:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.098641:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.098659:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.098667:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.098672:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.098676:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.099050:0:17160:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff9bd13306ba00:17160] 0 exiting: rc = 1 00000100:00100000:0.0:1788843805.099831:0:17161:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff9bd11582ca00:17161] 1 exiting: rc = 0 00000100:00100000:0.0:1788843805.099899:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.099906:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.099912:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.099917:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.099923:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.099928:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.100390:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.100611:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.100615:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.100620:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.100625:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.100630:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.100634:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.100639:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.100644:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.100704:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.100711:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.100716:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.100721:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.100726:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.100731:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.100736:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.100742:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.100747:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.100752:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.101220:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.101226:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.101232:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.101237:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.101242:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.101247:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.101746:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.101823:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.101831:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.101836:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.101842:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.101847:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.101852:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.101857:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.101863:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.101867:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.101873:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.101892:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.101897:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.101902:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.101907:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.101912:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.101918:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.101923:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.101928:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.101934:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.101938:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.101943:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.101948:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.101953:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.101958:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.101962:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.101967:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.101972:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.101976:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.101981:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.101986:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.101991:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.101997:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.102677:0:17163:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff9bd0079a1200:17163] 1 exiting: rc = 0 00000100:00100000:2.0:1788843805.105863:0:17162:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff9bd0079a1600:17162] 0 exiting: rc = 1 00000100:00100000:2.0:1788843805.106091:0:17164:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff9bd0079a1800:17164] 2 exiting: rc = 0 00000100:00100000:0.0:1788843805.106610:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.106619:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.106625:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.106630:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.106636:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.106642:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.106659:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.106666:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.106680:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.106686:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.106692:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.106698:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.106721:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.106727:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.106733:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.106739:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.106745:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.106750:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.106756:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.106761:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.106766:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.106772:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.106808:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.106816:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.106821:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.106827:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.106832:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.106837:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.106842:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.106848:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.106853:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.106858:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.106863:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.106868:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.106874:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.106880:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.106886:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.106891:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.106897:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.106903:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.106909:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.106914:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.106920:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.106925:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.106931:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.106937:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.106957:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.106969:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.106974:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.106980:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.106986:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.106992:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.106997:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.107004:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.107022:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.107028:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.107034:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.107040:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.107047:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.107052:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.107057:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.107062:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.107069:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843805.107075:0:20923:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1788843805.122624:0:20923:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788843805.122638:0:20923:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:0.0:1788843805.122644:0:20923:0:(genops.c:885:class_export_put()) final put ffff9bd008556800/MDS_uuid 00000020:00000080:0.0:1788843805.122649:0:20923:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd008556800/MDS_uuid for MDS 00000020:01000000:0.0:1788843805.122655:0:20923:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:0.0:1788843805.122825:0:20923:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0001 complete 00010000:00010000:0.0:1788843805.469317:0:19636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788843805.594622:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 20b96c6c-8494-483a-b913-89dfc06b1440->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788843805.594630:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 20b96c6c-8494-483a-b913-89dfc06b1440->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788843805.594632:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788843805.594634:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788843805.594638:0:36:0:(import.c:65:import_set_state_nolock()) ffff9bd006525800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788843805.594645:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 578 00000100:00080000:3.0:1788843805.594650:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788843805.594657:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9bd006525800 using connection 192.168.203.133@tcp/0@lo 00000100:00100000:3.0:1788843805.594704:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bd1074fc380 x1875738134550400/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788843805.594773:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd1074fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3629:1875738134550400:0@lo:38:kworker.0 00000400:00000100:2.0:1788843805.594842:0:3629:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875738134550400 offset 0 length 520: 4 00000100:00080000:3.0:1788843805.594931:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:2.0:1788843805.594933:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd1074ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3631:1875738134550528:0@lo:400:kworker.0 00000100:00080000:3.0:1788843805.594935:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788843805.594937:0:36:0:(import.c:65:import_set_state_nolock()) ffff9bd006524800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788843805.594941:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 578 00000100:00080000:3.0:1788843805.594944:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788843805.594947:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9bd006524800 using connection 192.168.203.133@tcp/0@lo 00000400:00000100:2.0:1788843805.594953:0:3631:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875738134550528 offset 0 length 224: 4 00000100:00100000:3.0:1788843805.594959:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bd1074ff480 x1875738134550656/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788843805.594995:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd1074ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3629:1875738134550656:0@lo:38:kworker.0 00000400:00000100:2.0:1788843805.595012:0:3629:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875738134550656 offset 0 length 520: 4 00000100:00100000:3.0:1788843805.595020:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd1074fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3632:1875738134550784:0@lo:400:kworker.0 00000400:00000100:3.0:1788843805.595042:0:3632:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875738134550784 offset 0 length 224: 4 00010000:00010000:2.0:1788843806.490348:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843807.522176:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788843808.542962:0:19636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788843809.562302:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788843809.626835:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 20b96c6c-8494-483a-b913-89dfc06b1440->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788843809.626847:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) 20b96c6c-8494-483a-b913-89dfc06b1440->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788843809.626851:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788843809.626854:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788843809.626925:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788843809.626929:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788843809.626973:0:3632:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788843809.626995:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f962a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3632:1875738134550912:0@lo:400:kworker.0 00000400:00000100:1.0:1788843809.627062:0:3632:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875738134550912 offset 0 length 224: 4 00000100:00100000:1.0:1788843809.627130:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f961180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3630:1875738134551040:0@lo:400:kworker.0 00000400:00000100:1.0:1788843809.627171:0:3630:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875738134551040 offset 0 length 224: 4 00000001:00100000:1.0:1788843809.693974:0:19469:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1788843809.693985:0:19469:0:(genops.c:885:class_export_put()) final put ffff9bd006631000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788843809.695873:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd006631000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001 00000020:00000080:3.0:1788843809.695930:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9bd006632000 for lustre-OST0001 00000001:00100000:2.0:1788843809.696486:0:18651:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1788843809.696493:0:18651:0:(genops.c:885:class_export_put()) final put ffff9bd00706d800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1788843809.696603:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd00706d800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:0.0:1788843809.696641:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9bd007068800 for lustre-OST0000 00000020:01000004:2.0:1788843810.277866:0:21125:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:2.0:1788843810.291319:0:21125:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0000 00010000:00010000:2.0:1788843810.291425:0:21125:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd13fbea200/0xa762dfcbd58d23a7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d23ae expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843810.291468:0:21125:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd13fbea200/0xa762dfcbd58d23a7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xa762dfcbd58d23ae expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843810.291476:0:21125:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd13fbea200/0xa762dfcbd58d23a7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xa762dfcbd58d23ae expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843810.291483:0:21125:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.133@tcp lock: ffff9bd13fbea200/0xa762dfcbd58d23a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xa762dfcbd58d23ae expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843810.291506:0:21125:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788843810.291673:0:21125:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1788843810.291705:0:21125:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788843810.291814:0:21125:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9bd1074fc380 x1875738134550400/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788843820 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788843810.291838:0:21125:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1788843810.291846:0:21125:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788843810.291853:0:21125:0:(import.c:65:import_set_state_nolock()) ffff9bd006525800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:2.0:1788843810.291859:0:21125:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788843810.291869:0:21125:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9bd1074fc380 x1875738134550400/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788843820 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788843810.291876:0:21125:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788843810.291879:0:21125:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 13s for inflight to error out 00010000:00010000:0.0:1788843810.292447:0:17139:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788843810.292459:0:17139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.133@tcp lock: ffff9bd13fbea200/0xa762dfcbd58d23a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xa762dfcbd58d23ae expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843810.292469:0:17139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd13fbea200 already unused, calling callback (ffffffffc12a7c20) 10000000:00010000:0.0:1788843810.292474:0:17139:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.133@tcp lock: ffff9bd13fbea200/0xa762dfcbd58d23a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xa762dfcbd58d23ae expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843810.292497:0:17139:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.133@tcp lock: ffff9bd13fbea200/0xa762dfcbd58d23a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0xa762dfcbd58d23ae expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788843810.292506:0:17139:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.133@tcp lock: ffff9bd13fbea200/0xa762dfcbd58d23a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0xa762dfcbd58d23ae expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788843810.292513:0:17139:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788843810.292519:0:17139:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1788843810.292522:0:17139:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1788843810.292549:0:17139:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9bd008551800 00010000:00010000:0.0:1788843810.292554:0:17139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.133@tcp lock: ffff9bd13fbea200/0xa762dfcbd58d23a7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0xa762dfcbd58d23ae expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843810.292560:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.133@tcp lock: ffff9bd13fbea200/0xa762dfcbd58d23a7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0xa762dfcbd58d23ae expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843810.292576:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843810.292578:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843810.292580:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788843810.292958:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd1074fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3629:1875738134550400:0@lo:38:kworker.0 00000100:00080000:1.0:1788843810.296251:0:21125:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1788843810.296273:0:21125:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9bd1074ff800 x1875738134550528/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843821 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788843810.296302:0:21125:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9bd10f962a00 x1875738134550912/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843825 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788843810.296320:0:21125:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1788843810.296348:0:21125:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:1.0:1788843810.296374:0:21125:0:(import.c:65:import_set_state_nolock()) ffff9bd008711000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1788843810.296413:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f963100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3629:1875738134551168:0@lo:39:umount.0 00000400:00000100:1.0:1788843810.296495:0:3629:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875738134551168 offset 0 length 224: 4 00000100:00100000:0.0:1788843810.298275:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd1074ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3631:1875738134550528:0@lo:400:kworker.0 00000100:00100000:3.0:1788843810.299365:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f962a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3632:1875738134550912:0@lo:400:kworker.0 00010000:00010000:2.0:1788843810.590974:0:19636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788843810.650459:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 20b96c6c-8494-483a-b913-89dfc06b1440->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788843810.650473:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) 20b96c6c-8494-483a-b913-89dfc06b1440->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788843810.650476:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788843810.650480:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788843810.650635:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f962a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3631:1875738134551296:0@lo:400:kworker.0 00000400:00000100:0.0:1788843810.650715:0:3631:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875738134551296 offset 0 length 224: 4 00010000:00010000:2.0:1788843811.616347:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843812.634406:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788843813.658486:0:19636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788843814.428859:0:3629:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788843804/real 1788843804] req@ffff9bd10f963800 x1875738134550272/t0(0) o250->MGC192.168.203.133@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788843814 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788843814.428891:0:3629:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9bd10f963800 x1875738134550272/t0(0) o250->MGC192.168.203.133@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788843814 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788843814.428914:0:3629:0:(import.c:65:import_set_state_nolock()) ffff9bd008551800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788843814.428946:0:3629:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:1.0:1788843814.428950:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f963800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:20b96c6c-8494-483a-b913-89dfc06b1440:3629:1875738134550272:0@lo:250:ptlrpcd_00_01.0 00000100:00080000:2.0:1788843814.429044:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 20b96c6c-8494-483a-b913-89dfc06b1440->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788843814.429050:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1788843814.429067:0:36:0:(import.c:65:import_set_state_nolock()) ffff9bd008551800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788843814.429072:0:36:0:(import.c:510:import_select_connection()) MGC192.168.203.133@tcp: connect to NID 0@lo last attempt 582 00000100:00080000:2.0:1788843814.429077:0:36:0:(import.c:589:import_select_connection()) MGC192.168.203.133@tcp: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788843814.429083:0:36:0:(import.c:624:import_select_connection()) MGC192.168.203.133@tcp: import ffff9bd008551800 using connection 192.168.203.133@tcp/0@lo 00000100:00100000:2.0:1788843814.429114:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bd10f8d2d80 x1875738134551424/t0(0) o250->MGC192.168.203.133@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788843814.429138:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788843814.429169:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788843814.429254:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788843814.429282:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f8d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3633:1875738134551552:0@lo:400:kworker.0 00000400:00000100:0.0:1788843814.429353:0:3633:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875738134551552 offset 0 length 224: 4 00000100:00100000:1.0:1788843814.430862:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f8d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:20b96c6c-8494-483a-b913-89dfc06b1440:3629:1875738134551424:0@lo:250:kworker.0 00000400:00000100:1.0:1788843814.430916:0:3629:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875738134551424 offset 0 length 520: 4 00010000:00010000:2.0:1788843814.686508:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843815.706425:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788843816.730757:0:19636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788843817.756082:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843818.781114:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788843819.802548:0:19636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788843819.930884:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 20b96c6c-8494-483a-b913-89dfc06b1440->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788843819.930893:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 20b96c6c-8494-483a-b913-89dfc06b1440->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788843819.930897:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788843819.930901:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788843819.931032:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f963800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3633:1875738134551680:0@lo:400:kworker.0 00000400:00000100:0.0:1788843819.931107:0:3633:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875738134551680 offset 0 length 224: 4 00000100:00100000:1.0:1788843820.570989:0:3629:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788843810/real 1788843810] req@ffff9bd10f963100 x1875738134551168/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788843820 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788843820.571054:0:3629:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9bd10f963100 x1875738134551168/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788843820 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788843820.571068:0:3629:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788843805/real 1788843805] req@ffff9bd1074ff480 x1875738134550656/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 1 dl 1788843820 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788843820.571083:0:3629:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9bd1074ff480 x1875738134550656/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 1 dl 1788843820 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788843820.571106:0:3629:0:(import.c:65:import_set_state_nolock()) ffff9bd008711000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1788843820.571125:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f963100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3629:1875738134551168:0@lo:39:umount.0 00000100:00080000:1.0:1788843820.571132:0:3629:0:(import.c:65:import_set_state_nolock()) ffff9bd006524800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788843820.571179:0:3629:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788843820.571184:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd1074ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3629:1875738134550656:0@lo:38:kworker.0 00000100:00080000:3.0:1788843820.571369:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 20b96c6c-8494-483a-b913-89dfc06b1440->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788843820.571376:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) 20b96c6c-8494-483a-b913-89dfc06b1440->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788843820.571378:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788843820.571381:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788843820.571384:0:8:0:(import.c:65:import_set_state_nolock()) ffff9bd006524800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788843820.571389:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 583 00000100:00080000:3.0:1788843820.571395:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788843820.571402:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9bd006524800 using connection 192.168.203.133@tcp/0@lo 00000100:00100000:3.0:1788843820.571440:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bd1074fc000 x1875738134551808/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788843820.571515:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd1074ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3630:1875738134551936:0@lo:400:kworker.0 00000400:00000100:3.0:1788843820.571599:0:3630:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875738134551936 offset 0 length 224: 4 00000100:00100000:0.0:1788843820.571742:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd1074fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3629:1875738134551808:0@lo:38:kworker.0 00000400:00000100:0.0:1788843820.571768:0:3629:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875738134551808 offset 0 length 520: 4 00000100:00080000:2.0:1788843820.572264:0:21125:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1788843820.572270:0:21125:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788843820.572277:0:21125:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1788843820.573233:0:21125:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd007946c00/0xa762dfcbd58d237d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d2384 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843820.573251:0:21125:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd007946c00/0xa762dfcbd58d237d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xa762dfcbd58d2384 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843820.573258:0:21125:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd007946c00/0xa762dfcbd58d237d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xa762dfcbd58d2384 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843820.573265:0:21125:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.133@tcp lock: ffff9bd007946c00/0xa762dfcbd58d237d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xa762dfcbd58d2384 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843820.573288:0:21125:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788843820.573315:0:21125:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd118f70600/0xa762dfcbd58d26e1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d26e8 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843820.573322:0:21125:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd118f70600/0xa762dfcbd58d26e1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa762dfcbd58d26e8 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843820.573329:0:21125:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd118f70600/0xa762dfcbd58d26e1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xa762dfcbd58d26e8 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843820.573334:0:21125:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.133@tcp lock: ffff9bd118f70600/0xa762dfcbd58d26e1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xa762dfcbd58d26e8 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843820.573346:0:21125:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:2.0:1788843820.573350:0:21125:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:2.0:1788843820.573379:0:21125:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0000 00000020:01000000:2.0:1788843820.573384:0:21125:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:2.0:1788843820.573388:0:21125:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788843820.573394:0:21125:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788843820.573399:0:21125:0:(genops.c:1558:class_disconnect_exports()) OBD device 22 (ffff9bd0078bb370) has no exports 00000020:00080000:2.0:1788843820.573428:0:21125:0:(genops.c:1558:class_disconnect_exports()) OBD device 22 (ffff9bd0078bb370) has no exports 00000020:01000000:2.0:1788843820.575177:0:21125:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9bd0071b7de0 - data ffff9bd1318625e8/ffff9bd006629000 00000020:01000000:2.0:1788843820.575383:0:21125:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9bd00596e6c0 - data ffff9bd131b48bd0/ffff9bd00711b000 00010000:00010000:0.0:1788843820.575785:0:17139:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788843820.575798:0:17139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.133@tcp lock: ffff9bd007946c00/0xa762dfcbd58d237d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xa762dfcbd58d2384 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843820.575809:0:17139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd007946c00 already unused, calling callback (ffffffffc12a7c20) 10000000:00010000:0.0:1788843820.575814:0:17139:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.133@tcp lock: ffff9bd007946c00/0xa762dfcbd58d237d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xa762dfcbd58d2384 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843820.575826:0:17139:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.133@tcp lock: ffff9bd007946c00/0xa762dfcbd58d237d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xa762dfcbd58d2384 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788843820.575834:0:17139:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.133@tcp lock: ffff9bd007946c00/0xa762dfcbd58d237d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xa762dfcbd58d2384 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788843820.575840:0:17139:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788843820.575842:0:17139:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:0.0:1788843820.575846:0:17139:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:0.0:1788843820.575867:0:17139:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9bd008551800 00010000:00010000:0.0:1788843820.575871:0:17139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.133@tcp lock: ffff9bd007946c00/0xa762dfcbd58d237d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xa762dfcbd58d2384 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843820.575877:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.133@tcp lock: ffff9bd007946c00/0xa762dfcbd58d237d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xa762dfcbd58d2384 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843820.575913:0:17139:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788843820.575918:0:17139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.133@tcp lock: ffff9bd118f70600/0xa762dfcbd58d26e1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xa762dfcbd58d26e8 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843820.575923:0:17139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd118f70600 already unused, calling callback (ffffffffc12a7c20) 10000000:00010000:0.0:1788843820.575926:0:17139:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.133@tcp lock: ffff9bd118f70600/0xa762dfcbd58d26e1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xa762dfcbd58d26e8 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843820.575932:0:17139:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.133@tcp lock: ffff9bd118f70600/0xa762dfcbd58d26e1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xa762dfcbd58d26e8 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788843820.575938:0:17139:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.133@tcp lock: ffff9bd118f70600/0xa762dfcbd58d26e1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xa762dfcbd58d26e8 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788843820.575942:0:17139:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1788843820.575944:0:17139:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1788843820.575946:0:17139:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1788843820.575951:0:17139:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9bd008551800 00010000:00010000:0.0:1788843820.575954:0:17139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.133@tcp lock: ffff9bd118f70600/0xa762dfcbd58d26e1 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xa762dfcbd58d26e8 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843820.575960:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.133@tcp lock: ffff9bd118f70600/0xa762dfcbd58d26e1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xa762dfcbd58d26e8 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843820.575968:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843820.575970:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843820.575972:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788843820.576521:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:1.0:1788843820.585898:0:21125:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1788843820.608002:0:21125:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa762dfcbd58d2392 00000020:00000080:2.0:1788843820.608018:0:21125:0:(genops.c:885:class_export_put()) final put ffff9bd008710800/lustre-OST0000-osd_UUID 00000020:01000004:2.0:1788843820.608043:0:21125:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9bd137ae8800 from lustre-OST0000, refs=2 00000020:01000004:2.0:1788843820.608047:0:21125:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9bd137ae8800 2 00000020:01000004:2.0:1788843820.608051:0:21125:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9bd137ae8800 from lustre-OST0000 00000020:00000080:2.0:1788843820.608080:0:21125:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788843820.608093:0:21125:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:2.0:1788843820.608096:0:21125:0:(genops.c:885:class_export_put()) final put ffff9bd008715000/lustre-OST0000_UUID 00000020:00000080:2.0:1788843820.608100:0:21125:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd008715000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:2.0:1788843820.608122:0:21125:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:2.0:1788843820.608213:0:21125:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:2.0:1788843820.608218:0:21125:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:2.0:1788843820.608222:0:21125:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788843820.608227:0:21125:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788843820.608234:0:21125:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff9bd006527800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788843820.608241:0:21125:0:(genops.c:1553:class_disconnect_exports()) OBD device 23 (ffff9bd13df319b8) has exports, disconnecting them 00000020:00080000:2.0:1788843820.608247:0:21125:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff9bd006527800), last request at 1788843736 00000020:00000080:2.0:1788843820.608252:0:21125:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa762dfcbd58d23bc 00000020:00080000:2.0:1788843820.608260:0:21125:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9bd006527800): rc 0 00000020:00000080:2.0:1788843820.608266:0:21125:0:(genops.c:885:class_export_put()) final put ffff9bd006527800/lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1788843820.609074:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd008710800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1788843820.609093:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd006527800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:3.0:1788843820.609542:0:21125:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:3.0:1788843820.609548:0:21125:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788843820.609577:0:21125:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1788843820.609584:0:21125:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788843820.609805:0:21125:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788843820.609814:0:21125:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:3.0:1788843820.609822:0:21125:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:3.0:1788843820.609827:0:21125:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788843820.609831:0:21125:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1788843820.609838:0:21125:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff9bd007397800 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788843820.609845:0:21125:0:(genops.c:1553:class_disconnect_exports()) OBD device 24 (ffff9bd005b64d28) has exports, disconnecting them 00000020:00080000:3.0:1788843820.609850:0:21125:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffff9bd007397800), last request at 1788843736 00000020:00000080:3.0:1788843820.609854:0:21125:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa762dfcbd58d23d1 00000020:00080000:3.0:1788843820.609870:0:21125:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9bd007397800): rc 0 00000020:00000080:3.0:1788843820.609876:0:21125:0:(genops.c:885:class_export_put()) final put ffff9bd007397800/lustre-MDT0001-lwp-OST0000 00000020:00000080:0.0:1788843820.610520:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9bd006525800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1788843820.610533:0:36:0:(genops.c:885:class_export_put()) final put ffff9bd006523000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:0.0:1788843820.610548:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd006523000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:0.0:1788843820.610556:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:0.0:1788843820.610654:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd007397800/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00010000:01000000:0.0:1788843820.620415:0:21125:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:0.0:1788843820.620427:0:21125:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1788843820.620432:0:21125:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788843820.620441:0:21125:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788843820.620486:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9bd008711000 for lustre-MDT0001-lwp-OST0000 00000020:00000080:0.0:1788843820.620738:0:21125:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788843820.620751:0:21125:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:00000080:0.0:1788843820.620757:0:21125:0:(genops.c:885:class_export_put()) final put ffff9bd008717000/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:0.0:1788843820.620762:0:21125:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd008717000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:0.0:1788843820.620777:0:21125:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:0.0:1788843820.620858:0:21125:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9bd137ae8800 1 00000020:00000080:0.0:1788843820.620865:0:21125:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa762dfcbd58d236f 00000020:00000080:0.0:1788843820.620873:0:21125:0:(genops.c:885:class_export_put()) final put ffff9bd132a9e800/lustre-OST0000-osd_UUID 00000020:01000000:0.0:1788843820.620882:0:21125:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:0.0:1788843820.620892:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd132a9e800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:0.0:1788843820.620902:0:21125:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788843820.620907:0:21125:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788843820.620911:0:21125:0:(genops.c:1558:class_disconnect_exports()) OBD device 20 (ffff9bd0078b8000) has no exports 00000020:00000080:0.0:1788843820.868173:0:21125:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788843820.868289:0:21125:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:0.0:1788843820.868296:0:21125:0:(genops.c:885:class_export_put()) final put ffff9bd10481c800/lustre-OST0000-osd_UUID 00000020:00000080:0.0:1788843820.868302:0:21125:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd10481c800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:0.0:1788843820.868317:0:21125:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:0.0:1788843820.868599:0:21125:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9bd141b0d800 00000020:02000400:0.0:1788843820.868667:0:21125:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:2.0:1788843820.910533:0:19636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000400:0.0:1788843821.786358:0:3632:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788843805/real 1788843805] req@ffff9bd1074fd880 x1875738134550784/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788843821 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788843821.812658:0:3632:0:(client.c:2547:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff9bd1074fd880 x1875738134550784/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788843821 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788843821.812689:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9bd006525000 lustre-MDT0001_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1788843821.812694:0:3632:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0001-lwp-OST0001: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1788843821.845747:0:3632:0:(import.c:418:ptlrpc_pinger_force()) lustre-MDT0001_UUID: waking up pinger s:DISCONN 00000100:00100000:3.0:1788843821.847166:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd1074fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3632:1875738134550784:0@lo:400:kworker.0 00000100:00080000:2.0:1788843821.847901:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 20b96c6c-8494-483a-b913-89dfc06b1440->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788843821.847909:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 20b96c6c-8494-483a-b913-89dfc06b1440->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788843821.847912:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788843821.847915:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788843821.847917:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788843821.847921:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1788843821.847925:0:38:0:(import.c:65:import_set_state_nolock()) ffff9bd006525000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788843821.847932:0:38:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 529 00000100:00080000:2.0:1788843821.847943:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff9bd006525000 using connection 192.168.203.133@tcp/0@lo 00000100:00100000:2.0:1788843821.847983:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bd10f8d1180 x1875738134552064/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788843821.848056:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f8d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3629:1875738134552064:0@lo:38:kworker.0 00000400:00000100:1.0:1788843821.848125:0:3629:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875738134552064 offset 0 length 520: 4 00010000:00010000:0.0:1788843821.915123:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788843822.941066:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788843823.962314:0:19636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843824.988788:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788843825.075522:0:21327:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:1.0:1788843825.098307:0:21327:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0001 00010000:00010000:1.0:1788843825.099540:0:21327:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd10fa3da00/0xa762dfcbd58d2441 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d2448 expref: -99 pid: 19468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843825.099563:0:21327:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd10fa3da00/0xa762dfcbd58d2441 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa762dfcbd58d2448 expref: -99 pid: 19468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843825.099572:0:21327:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd10fa3da00/0xa762dfcbd58d2441 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xa762dfcbd58d2448 expref: -99 pid: 19468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843825.099608:0:21327:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.133@tcp lock: ffff9bd10fa3da00/0xa762dfcbd58d2441 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xa762dfcbd58d2448 expref: -99 pid: 19468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843825.099635:0:21327:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788843825.099642:0:21327:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1788843825.101509:0:21327:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788843825.101537:0:21327:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9bd1074fc000 x1875738134551808/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788843840 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788843825.101565:0:21327:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:1.0:1788843825.101574:0:21327:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788843825.101582:0:21327:0:(import.c:65:import_set_state_nolock()) ffff9bd006524800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:1.0:1788843825.101589:0:21327:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788843825.101593:0:21327:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9bd1074fc000 x1875738134551808/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788843840 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788843825.101601:0:21327:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:1.0:1788843825.101604:0:21327:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00100000:3.0:1788843825.102319:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd1074fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3629:1875738134551808:0@lo:38:kworker.0 00010000:00010000:0.0:1788843825.106502:0:17138:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788843825.106521:0:17138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.133@tcp lock: ffff9bd10fa3da00/0xa762dfcbd58d2441 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xa762dfcbd58d2448 expref: -99 pid: 19468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843825.106536:0:17138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd10fa3da00 already unused, calling callback (ffffffffc12a7c20) 10000000:00010000:0.0:1788843825.106541:0:17138:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.133@tcp lock: ffff9bd10fa3da00/0xa762dfcbd58d2441 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xa762dfcbd58d2448 expref: -99 pid: 19468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843825.106554:0:17138:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.133@tcp lock: ffff9bd10fa3da00/0xa762dfcbd58d2441 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xa762dfcbd58d2448 expref: -99 pid: 19468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788843825.106563:0:17138:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.133@tcp lock: ffff9bd10fa3da00/0xa762dfcbd58d2441 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xa762dfcbd58d2448 expref: -99 pid: 19468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788843825.106570:0:17138:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788843825.106573:0:17138:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1788843825.106578:0:17138:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1788843825.106605:0:17138:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9bd008551800 00010000:00010000:0.0:1788843825.106609:0:17138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.133@tcp lock: ffff9bd10fa3da00/0xa762dfcbd58d2441 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xa762dfcbd58d2448 expref: -99 pid: 19468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843825.106646:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.133@tcp lock: ffff9bd10fa3da00/0xa762dfcbd58d2441 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xa762dfcbd58d2448 expref: -99 pid: 19468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843825.106686:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843825.106689:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843825.106691:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788843825.112391:0:21327:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1788843825.112427:0:21327:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9bd10f961180 x1875738134551040/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843825 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788843825.112449:0:21327:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9bd10f962a00 x1875738134551296/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843826 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788843825.112464:0:21327:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9bd10f8d0380 x1875738134551552/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843830 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788843825.112481:0:21327:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9bd10f963800 x1875738134551680/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843835 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788843825.112492:0:21327:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9bd1074ffb80 x1875738134551936/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843836 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788843825.112525:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f963800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3633:1875738134551680:0@lo:400:kworker.0 00000100:00100000:3.0:1788843825.112987:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f961180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3630:1875738134551040:0@lo:400:kworker.0 00000100:00100000:1.0:1788843825.113199:0:21327:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9bd10f8d1180 x1875738134552064/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788843831 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788843825.113219:0:21327:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:1.0:1788843825.113229:0:21327:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:0.0:1788843825.113290:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f8d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3633:1875738134551552:0@lo:400:kworker.0 00000100:00100000:0.0:1788843825.114362:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f962a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3631:1875738134551296:0@lo:400:kworker.0 00000100:00080000:2.0:1788843825.117463:0:3629:0:(import.c:65:import_set_state_nolock()) ffff9bd006525000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788843825.119116:0:3629:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-5) 00000100:00100000:2.0:1788843825.119168:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f8d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3629:1875738134552064:0@lo:38:kworker.0 00000100:00100000:3.0:1788843825.119703:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd1074ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3630:1875738134551936:0@lo:400:kworker.0 00000100:00080000:1.0:1788843825.119975:0:21327:0:(import.c:65:import_set_state_nolock()) ffff9bd006525000 lustre-MDT0001_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:1.0:1788843825.119987:0:21327:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1788843825.119992:0:21327:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:1.0:1788843825.119997:0:21327:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1788843825.121392:0:21327:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd13fbeae00/0xa762dfcbd58d2417 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d241e expref: -99 pid: 19468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843825.121476:0:21327:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd13fbeae00/0xa762dfcbd58d2417 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa762dfcbd58d241e expref: -99 pid: 19468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843825.121485:0:21327:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd13fbeae00/0xa762dfcbd58d2417 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xa762dfcbd58d241e expref: -99 pid: 19468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843825.121493:0:21327:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.133@tcp lock: ffff9bd13fbeae00/0xa762dfcbd58d2417 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xa762dfcbd58d241e expref: -99 pid: 19468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843825.121512:0:21327:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788843825.121521:0:21327:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd118f71c00/0xa762dfcbd58d26d3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d26da expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843825.121529:0:21327:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd118f71c00/0xa762dfcbd58d26d3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa762dfcbd58d26da expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843825.121537:0:21327:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd118f71c00/0xa762dfcbd58d26d3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xa762dfcbd58d26da expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843825.121564:0:21327:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.133@tcp lock: ffff9bd118f71c00/0xa762dfcbd58d26d3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xa762dfcbd58d26da expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843825.121585:0:21327:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:1.0:1788843825.121590:0:21327:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:1.0:1788843825.121623:0:21327:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0001 00000020:01000000:1.0:1788843825.121628:0:21327:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:1.0:1788843825.121634:0:21327:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788843825.121641:0:21327:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788843825.121646:0:21327:0:(genops.c:1558:class_disconnect_exports()) OBD device 26 (ffff9bd005b63370) has no exports 00000020:00080000:1.0:1788843825.121685:0:21327:0:(genops.c:1558:class_disconnect_exports()) OBD device 26 (ffff9bd005b63370) has no exports 00010000:00010000:2.0:1788843825.121820:0:19636:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788843825.121828:0:19636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.133@tcp lock: ffff9bd13fbeae00/0xa762dfcbd58d2417 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xa762dfcbd58d241e expref: -99 pid: 19468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843825.121836:0:19636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd13fbeae00 already unused, calling callback (ffffffffc12a7c20) 10000000:00010000:2.0:1788843825.121842:0:19636:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.133@tcp lock: ffff9bd13fbeae00/0xa762dfcbd58d2417 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xa762dfcbd58d241e expref: -99 pid: 19468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843825.121852:0:19636:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.133@tcp lock: ffff9bd13fbeae00/0xa762dfcbd58d2417 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xa762dfcbd58d241e expref: -99 pid: 19468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788843825.121860:0:19636:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.133@tcp lock: ffff9bd13fbeae00/0xa762dfcbd58d2417 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xa762dfcbd58d241e expref: -99 pid: 19468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788843825.121866:0:19636:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788843825.121869:0:19636:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:2.0:1788843825.121871:0:19636:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:2.0:1788843825.121890:0:19636:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9bd008551800 00010000:00010000:2.0:1788843825.121893:0:19636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.133@tcp lock: ffff9bd13fbeae00/0xa762dfcbd58d2417 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xa762dfcbd58d241e expref: -99 pid: 19468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843825.121900:0:19636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.133@tcp lock: ffff9bd13fbeae00/0xa762dfcbd58d2417 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xa762dfcbd58d241e expref: -99 pid: 19468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843825.121918:0:19636:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788843825.121921:0:19636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.133@tcp lock: ffff9bd118f71c00/0xa762dfcbd58d26d3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xa762dfcbd58d26da expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843825.121926:0:19636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd118f71c00 already unused, calling callback (ffffffffc12a7c20) 10000000:00010000:2.0:1788843825.121950:0:19636:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.133@tcp lock: ffff9bd118f71c00/0xa762dfcbd58d26d3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xa762dfcbd58d26da expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843825.121957:0:19636:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.133@tcp lock: ffff9bd118f71c00/0xa762dfcbd58d26d3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xa762dfcbd58d26da expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788843825.121964:0:19636:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.133@tcp lock: ffff9bd118f71c00/0xa762dfcbd58d26d3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xa762dfcbd58d26da expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788843825.121968:0:19636:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1788843825.121970:0:19636:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1788843825.121972:0:19636:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1788843825.121979:0:19636:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9bd008551800 00010000:00010000:2.0:1788843825.121982:0:19636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.133@tcp lock: ffff9bd118f71c00/0xa762dfcbd58d26d3 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xa762dfcbd58d26da expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843825.121987:0:19636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.133@tcp lock: ffff9bd118f71c00/0xa762dfcbd58d26d3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xa762dfcbd58d26da expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843825.122002:0:19636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788843825.122004:0:19636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788843825.122005:0:19636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843825.122114:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:1.0:1788843825.125761:0:21327:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9bd1207f3a80 - data ffff9bd131ab21b0/ffff9bd136c3b400 00000020:01000000:1.0:1788843825.126052:0:21327:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9bd1207f3960 - data ffff9bd131858af8/ffff9bd124dcf400 00100000:10000000:0.0:1788843825.136760:0:21327:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1788843825.153491:0:21327:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa762dfcbd58d242c 00000020:00000080:2.0:1788843825.153508:0:21327:0:(genops.c:885:class_export_put()) final put ffff9bd0013ba000/lustre-OST0001-osd_UUID 00000020:01000004:2.0:1788843825.153527:0:21327:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9bd007392000 from lustre-OST0001, refs=2 00000020:01000004:2.0:1788843825.153532:0:21327:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9bd007392000 2 00000020:01000004:2.0:1788843825.153536:0:21327:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9bd007392000 from lustre-OST0001 00000020:00000080:2.0:1788843825.153565:0:21327:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788843825.153578:0:21327:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:2.0:1788843825.153581:0:21327:0:(genops.c:885:class_export_put()) final put ffff9bd008710000/lustre-OST0001_UUID 00000020:00000080:2.0:1788843825.153585:0:21327:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd008710000/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:2.0:1788843825.153593:0:21327:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:2.0:1788843825.154018:0:21327:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 20b96c6c-8494-483a-b913-89dfc06b1440->MGS 00010000:00010000:2.0:1788843825.154037:0:21327:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.133@tcp lock: ffff9bd007947200/0xa762dfcbd58d223b lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xa762dfcbd58d2242 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788843825.154051:0:21327:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.133@tcp lock: ffff9bd007947200/0xa762dfcbd58d223b lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xa762dfcbd58d2242 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788843825.154057:0:21327:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:2.0:1788843825.154060:0:21327:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:2.0:1788843825.154064:0:21327:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:2.0:1788843825.154080:0:21327:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9bd008551800 00010000:00010000:2.0:1788843825.154084:0:21327:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.133@tcp lock: ffff9bd007947200/0xa762dfcbd58d223b lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xa762dfcbd58d2242 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843825.154101:0:21327:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.133@tcp lock: ffff9bd007947e00/0xa762dfcbd58d212a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xa762dfcbd58d2131 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788843825.154109:0:21327:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.133@tcp lock: ffff9bd007947e00/0xa762dfcbd58d212a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xa762dfcbd58d2131 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788843825.154115:0:21327:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788843825.154117:0:21327:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:2.0:1788843825.154118:0:21327:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:2.0:1788843825.154126:0:21327:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9bd008551800 00010000:00010000:2.0:1788843825.154129:0:21327:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.133@tcp lock: ffff9bd007947e00/0xa762dfcbd58d212a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xa762dfcbd58d2131 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788843825.154172:0:21327:0:(import.c:65:import_set_state_nolock()) ffff9bd008551800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:2.0:1788843825.154177:0:21327:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1788843825.154180:0:21327:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1788843825.154182:0:21327:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1788843825.154187:0:21327:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1788843825.154205:0:21327:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9bd10f8d2d80 x1875738134551424/t0(0) o250->MGC192.168.203.133@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1788843829 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1788843825.154235:0:21327:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1788843825.154238:0:21327:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 5s for inflight to error out 00000100:00100000:3.0:1788843825.154276:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f8d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:20b96c6c-8494-483a-b913-89dfc06b1440:3629:1875738134551424:0@lo:250:kworker.0 00000020:00000080:1.0:1788843825.154307:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd0013ba000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 10000000:01000000:2.0:1788843825.154528:0:21327:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1788843825.154536:0:21327:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa762dfcbd58d2115 00000020:00000080:2.0:1788843825.154542:0:21327:0:(genops.c:885:class_export_put()) final put ffff9bd13fac4000/20b96c6c-8494-483a-b913-89dfc06b1440 00000020:01000000:2.0:1788843825.154560:0:21327:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.203.133@tcp (flags='') 00000020:00000080:2.0:1788843825.154566:0:21327:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788843825.154573:0:21327:0:(obd_config.c:956:class_cleanup()) MGC192.168.203.133@tcp: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1788843825.154577:0:21327:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff9bd10fbb0000) has no exports 10000000:01000000:3.0:1788843825.154825:0:17147:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 00000020:00000080:1.0:1788843825.154834:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd13fac4000/20b96c6c-8494-483a-b913-89dfc06b1440 for MGC192.168.203.133@tcp 10000000:01000000:2.0:1788843825.154874:0:21327:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.203.133@tcp: client import never connected 00000100:00080000:2.0:1788843825.154878:0:21327:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:2.0:1788843825.154880:0:21327:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1788843825.154883:0:21327:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:2.0:1788843825.154885:0:21327:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1788843825.155089:0:21327:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788843825.155096:0:21327:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.203.133@tcp (uuid 20b96c6c-8494-483a-b913-89dfc06b1440) 00000020:01000000:2.0:1788843825.155104:0:21327:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:2.0:1788843825.155107:0:21327:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788843825.155111:0:21327:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788843825.155116:0:21327:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff9bd006524000 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788843825.155122:0:21327:0:(genops.c:1553:class_disconnect_exports()) OBD device 27 (ffff9bd13df34d28) has exports, disconnecting them 00000020:00080000:2.0:1788843825.155127:0:21327:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff9bd006524000), last request at 1788843751 00000020:00000080:2.0:1788843825.155131:0:21327:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa762dfcbd58d2456 00000020:00080000:2.0:1788843825.155157:0:21327:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9bd006524000): rc 0 00000020:00000080:2.0:1788843825.155161:0:21327:0:(genops.c:885:class_export_put()) final put ffff9bd006524000/lustre-MDT0000-lwp-OST0001 00000020:00000080:1.0:1788843825.155197:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9bd008551800 for MGC192.168.203.133@tcp 00000020:00000080:1.0:1788843825.155216:0:38:0:(genops.c:885:class_export_put()) final put ffff9bd008551000/20b96c6c-8494-483a-b913-89dfc06b1440 00000020:00000080:1.0:1788843825.155219:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd008551000/20b96c6c-8494-483a-b913-89dfc06b1440 for MGC192.168.203.133@tcp 00000020:01000000:1.0:1788843825.155224:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.203.133@tcp (20b96c6c-8494-483a-b913-89dfc06b1440) 00000020:00000080:1.0:1788843825.156435:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd006524000/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:3.0:1788843825.157220:0:21327:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:3.0:1788843825.157227:0:21327:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788843825.157233:0:21327:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:3.0:1788843825.157241:0:21327:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788843825.157347:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9bd006524800 for lustre-MDT0000-lwp-OST0001 00000020:00000080:3.0:1788843825.157469:0:21327:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788843825.157479:0:21327:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:3.0:1788843825.157501:0:21327:0:(genops.c:885:class_export_put()) final put ffff9bd006527000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:3.0:1788843825.157506:0:21327:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd006527000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:3.0:1788843825.157525:0:21327:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000000:3.0:1788843825.157612:0:21327:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0001 (flags='F') 00000020:00000080:3.0:1788843825.157617:0:21327:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788843825.157623:0:21327:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1788843825.157631:0:21327:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0001: ACTIVE ffff9bd006631800 lustre-MDT0001-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788843825.157639:0:21327:0:(genops.c:1553:class_disconnect_exports()) OBD device 28 (ffff9bd13df33370) has exports, disconnecting them 00000020:00080000:3.0:1788843825.157644:0:21327:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0001: disconnecting export at 0@lo (ffff9bd006631800), last request at 1788843751 00000020:00000080:3.0:1788843825.157650:0:21327:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa762dfcbd58d246b 00000020:00080000:3.0:1788843825.157677:0:21327:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9bd006631800): rc 0 00000020:00000080:3.0:1788843825.157686:0:21327:0:(genops.c:885:class_export_put()) final put ffff9bd006631800/lustre-MDT0001-lwp-OST0001 00000020:00000080:1.0:1788843825.161298:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd006631800/lustre-MDT0001-lwp-OST0001 for lustre-MDT0001-lwp-OST0001 00010000:01000000:1.0:1788843825.167534:0:21327:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0001: client import never connected 00000100:00080000:1.0:1788843825.167548:0:21327:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1788843825.167554:0:21327:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:1.0:1788843825.167565:0:21327:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788843825.167634:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9bd006525000 for lustre-MDT0001-lwp-OST0001 00010000:00010000:0.0:1788843825.168738:0:17138:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:1.0:1788843825.194215:0:19636:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:0.0:1788843825.195589:0:17139:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:0.0:1788843825.196461:0:17133:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff9bd007a59400:17133] 0 exiting: rc = 1 00000100:00100000:1.0:1788843825.197254:0:17134:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff9bd1330f0600:17134] 1 exiting: rc = 0 00000100:00100000:1.0:1788843825.197364:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843825.201444:0:17137:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff9bd007753e00:17137] 2 exiting: rc = 0 00000100:00100000:1.0:1788843825.201638:0:17136:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff9bd1012e6000:17136] 1 exiting: rc = 0 00000100:00100000:1.0:1788843825.205482:0:17135:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff9bd103012a00:17135] 0 exiting: rc = 1 00000100:00100000:1.0:1788843825.205759:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843825.205768:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843825.205775:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843825.205782:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843825.205788:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843825.205795:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843825.205803:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843825.205809:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843825.205814:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843825.205819:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843825.205829:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843825.205835:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843825.205842:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843825.205847:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843825.205852:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843825.205858:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843825.205863:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843825.205869:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843825.205874:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843825.205879:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843825.205885:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843825.205890:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843825.205896:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843825.205901:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843825.205908:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843825.205913:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843825.205918:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843825.206073:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843825.206079:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843825.206084:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843825.206090:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843825.206095:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843825.206100:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843825.206105:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843825.206111:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843825.206115:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843825.206120:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843825.206125:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843825.206130:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843825.206134:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843825.206167:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843825.206174:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843825.206179:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843825.206185:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843825.206191:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843825.206197:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843825.206204:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843825.206210:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843825.206215:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843825.206221:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843825.206227:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843825.206232:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843825.206236:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843825.206241:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843825.206246:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843825.206251:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843825.206256:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843825.206261:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843825.206269:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843825.206275:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843825.206280:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843825.206286:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843825.206300:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843825.206305:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1788843825.209442:0:21327:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788843825.209461:0:21327:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000020:00000080:1.0:1788843825.209470:0:21327:0:(genops.c:885:class_export_put()) final put ffff9bd008460000/lustre-MDT0001-lwp-OST0001_UUID 00000020:00000080:1.0:1788843825.209487:0:21327:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd008460000/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001-lwp-OST0001 00000020:01000000:1.0:1788843825.209494:0:21327:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0001 (lustre-MDT0001-lwp-OST0001_UUID) 00000020:01000004:1.0:1788843825.209556:0:21327:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9bd007392000 1 00000020:00000080:1.0:1788843825.209564:0:21327:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa762dfcbd58d2410 00000020:00000080:1.0:1788843825.209571:0:21327:0:(genops.c:885:class_export_put()) final put ffff9bd132a9b000/lustre-OST0001-osd_UUID 00000020:01000000:1.0:1788843825.209586:0:21327:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:1.0:1788843825.209598:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd132a9b000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:1.0:1788843825.209612:0:21327:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788843825.209618:0:21327:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788843825.209623:0:21327:0:(genops.c:1558:class_disconnect_exports()) OBD device 25 (ffff9bd005b60000) has no exports 00000020:00000080:2.0:1788843825.313790:0:21327:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788843825.313813:0:21327:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:2.0:1788843825.313820:0:21327:0:(genops.c:885:class_export_put()) final put ffff9bd007390000/lustre-OST0001-osd_UUID 00000020:00000080:2.0:1788843825.313826:0:21327:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd007390000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:2.0:1788843825.313853:0:21327:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:2.0:1788843825.315764:0:21327:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9bd007394800 00000020:01000000:2.0:1788843825.315803:0:21327:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:2.0:1788843825.315815:0:21327:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788843825.315822:0:21327:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788843825.315827:0:21327:0:(genops.c:1558:class_disconnect_exports()) OBD device 21 (ffff9bd1203f4d28) has no exports 00000020:00000080:2.0:1788843825.315857:0:21327:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788843825.315867:0:21327:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:2.0:1788843825.315872:0:21327:0:(genops.c:885:class_export_put()) final put ffff9bd132a98800/OSS_uuid 00000020:00000080:2.0:1788843825.315877:0:21327:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd132a98800/OSS_uuid for OSS 00000020:01000000:2.0:1788843825.315883:0:21327:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00080000:3.0:1788843825.315985:0:17146:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:0.0:1788843825.316323:0:19632:0:(service.c:3183:ptlrpc_main()) ll_ost00_004: service thread [ffff9bd124ca5400:19632] 4 exiting: rc = 0 00000100:00100000:2.0:1788843825.316383:0:18655:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff9bd111696400:18655] 1 exiting: rc = 0 00000100:00100000:2.0:1788843825.316661:0:18654:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff9bd10f99e600:18654] 0 exiting: rc = 1 00000100:00100000:2.0:1788843825.316722:0:19631:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff9bd124ca4000:19631] 3 exiting: rc = 0 00000100:00100000:2.0:1788843825.322183:0:18656:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff9bd0059e5a00:18656] 2 exiting: rc = 0 00000100:00100000:3.0:1788843825.324213:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843825.324229:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843825.324235:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843825.324241:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843825.324250:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843825.324257:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843825.324262:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843825.324267:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843825.324272:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843825.324278:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843825.324283:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843825.324288:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843825.324294:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843825.324300:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843825.324305:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843825.324311:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843825.324317:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843825.324323:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843825.324350:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843825.324356:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843825.324362:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843825.324368:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843825.324373:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843825.324378:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843825.324384:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843825.324391:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843825.324396:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843825.324402:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843825.324408:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843825.324413:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843825.324418:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843825.324424:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843825.324429:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843825.324435:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843825.324439:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843825.324445:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843825.324451:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843825.324457:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843825.324468:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843825.324473:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843825.324479:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843825.324485:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843825.324491:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843825.324496:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843825.324502:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843825.324508:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843825.324514:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843825.324520:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843825.324525:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843825.324531:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843825.324536:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843825.324541:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843825.324546:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843825.324560:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843825.324566:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843825.324571:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843825.324576:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843825.324582:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843825.324588:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843825.324594:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843825.324600:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843825.324605:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843825.324611:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843825.324617:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843825.326123:0:18659:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff9bd13faf5800:18659] 1 exiting: rc = 0 00000100:00100000:1.0:1788843825.326514:0:18657:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff9bd1052e9a00:18657] 0 exiting: rc = 1 00000100:00100000:2.0:1788843825.330465:0:19943:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_002: service thread [ffff9bd006411400:19943] 2 exiting: rc = 0 00000100:00100000:3.0:1788843825.330723:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843825.330733:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843825.330739:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843825.330745:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843825.330751:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843825.330756:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843825.330762:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843825.330768:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843825.330773:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843825.330778:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843825.330783:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843825.330789:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843825.330794:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843825.330799:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843825.330805:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843825.330810:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843825.330817:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843825.330823:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843825.330828:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843825.330834:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843825.330838:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843825.330845:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843825.330850:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843825.330856:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843825.330878:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843825.330884:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843825.330890:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843825.330896:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843825.330901:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843825.330906:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843825.330911:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843825.330916:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843825.330922:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843825.330927:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843825.330933:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843825.330938:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843825.330943:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843825.330948:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843825.330952:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843825.330958:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843825.330964:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843825.330970:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843825.330980:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843825.330986:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843825.330991:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843825.330996:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843825.331002:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843825.331007:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843825.331013:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843825.331018:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843825.331024:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843825.331029:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843825.331035:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843825.331041:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843825.331047:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843825.331053:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843825.331059:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843825.331065:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843825.331071:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843825.331084:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843825.331091:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843825.331096:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843825.331102:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843825.331108:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843825.332416:0:20291:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_003: service thread [ffff9bd00710b800:20291] 3 exiting: rc = 0 00000100:00100000:3.0:1788843825.333451:0:18661:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff9bd13f9ea600:18661] 1 exiting: rc = 0 00000100:00100000:0.0:1788843825.333704:0:18660:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff9bd13f9eb200:18660] 0 exiting: rc = 1 00000100:00100000:3.0:1788843825.335506:0:18662:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff9bd13f9ea200:18662] 2 exiting: rc = 0 00000100:00100000:0.0:1788843825.335706:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843825.335717:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843825.335724:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843825.335732:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843825.335739:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843825.335747:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843825.335755:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843825.335762:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843825.335768:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843825.335776:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843825.335803:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843825.335811:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843825.335817:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843825.335824:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843825.335829:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843825.335836:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843825.335842:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843825.335849:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843825.335857:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843825.335865:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843825.335872:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843825.335879:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843825.335885:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843825.335891:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843825.335899:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843825.335905:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843825.335913:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843825.335936:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843825.335945:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843825.335952:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843825.335962:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843825.335969:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843825.335976:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843825.335982:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843825.335989:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843825.335996:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843825.336003:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843825.336009:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843825.336016:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843825.336022:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843825.336029:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843825.336037:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843825.336044:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843825.336051:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843825.336058:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843825.336073:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843825.336079:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843825.336084:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843825.336091:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843825.336099:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843825.336106:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843825.336113:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843825.336132:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843825.336223:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843825.336239:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843825.336247:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843825.336263:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843825.336270:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843825.336277:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843825.336284:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843825.336290:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843825.336296:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843825.336302:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843825.336316:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843825.345222:0:18663:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff9bd007847000:18663] 0 exiting: rc = 1 00000100:00100000:3.0:1788843825.347592:0:18664:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff9bd1116ea800:18664] 1 exiting: rc = 0 00000100:00100000:0.0:1788843825.351290:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843825.351302:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843825.351308:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843825.351313:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843825.351319:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843825.351325:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843825.351331:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843825.351336:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843825.351342:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843825.351348:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843825.351354:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843825.351359:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843825.351365:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843825.351371:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843825.351377:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843825.351384:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843825.351409:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843825.351415:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843825.351421:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843825.351426:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843825.351432:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843825.351438:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843825.351444:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843825.351449:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843825.351456:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843825.351462:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843825.351468:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843825.351474:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843825.351480:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843825.351485:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843825.351492:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843825.351499:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843825.351505:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843825.351511:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843825.351517:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843825.351523:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843825.351528:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843825.351534:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843825.351540:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843825.351545:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843825.351551:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843825.351556:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843825.351562:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843825.351567:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843825.351574:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843825.351580:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843825.351587:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843825.351594:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843825.351600:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843825.351607:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843825.351613:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843825.351626:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843825.351631:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843825.351638:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843825.351644:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843825.351662:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843825.351669:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843825.351676:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843825.351682:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843825.351688:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843825.351695:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843825.351701:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843825.351707:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843825.351713:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843825.354124:0:18665:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff9bd007353e00:18665] 0 exiting: rc = 1 00000100:00100000:0.0:1788843825.354665:0:18666:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff9bd007352600:18666] 1 exiting: rc = 0 00000100:00100000:3.0:1788843825.354816:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843825.354826:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843825.354832:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843825.354838:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843825.354846:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843825.354852:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843825.354858:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843825.354865:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843825.354871:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843825.354878:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843825.354884:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843825.354891:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843825.354911:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843825.354919:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843825.354926:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843825.354933:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843825.354942:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843825.354951:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843825.354958:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843825.354966:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843825.354973:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843825.354980:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843825.354986:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843825.354993:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843825.355029:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843825.355036:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843825.355042:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843825.355050:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843825.355056:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843825.355061:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843825.355067:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843825.355074:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843825.355080:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843825.355086:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843825.355092:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843825.355099:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843825.355119:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843825.355127:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843825.355133:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843825.355170:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843825.355178:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843825.355185:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843825.355192:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843825.355199:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843825.355205:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843825.355211:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843825.355217:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843825.355224:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843825.355246:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843825.355254:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843825.355261:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843825.355268:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843825.355276:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843825.355282:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843825.355288:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843825.355295:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843825.355304:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843825.355313:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843825.355321:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843825.355336:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843825.355357:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843825.355366:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843825.355373:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843825.355381:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:2.0:1788843825.379600:0:21327:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:1.0:1788843846.433487:0:22091:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg333-server.virtnet: executing load_modules_local 00000020:01000004:0.0:1788843856.281440:0:22690:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1788843856.281459:0:22690:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:0.0:1788843856.281460:0:22690:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:0.0:1788843856.281591:0:22690:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9bd127b94800 00000020:01000004:0.0:1788843856.281610:0:22690:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:0.0:1788843856.281619:0:22690:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1788843856.281636:0:22690:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff9bd13e918000) 00000020:00000080:0.0:1788843856.281653:0:22690:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1788843856.374420:0:22690:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1788843856.377624:0:22690:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:2.0:1788843856.382269:0:22690:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:2.0:1788843856.382820:0:22690:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:2.0:1788843856.385644:0:22690:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:2.0:1788843856.387096:0:22690:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:2.0:1788843856.388425:0:22690:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:2.0:1788843856.389223:0:22690:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:2.0:1788843856.390330:0:22690:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:2.0:1788843856.390726:0:22690:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:2.0:1788843856.391527:0:22690:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:2.0:1788843856.392080:0:22690:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:2.0:1788843856.394491:0:22690:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:2.0:1788843856.394944:0:22690:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:2.0:1788843856.395217:0:22690:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:2.0:1788843856.395699:0:22690:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:2.0:1788843856.396070:0:22690:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:2.0:1788843856.396513:0:22690:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:2.0:1788843856.396820:0:22690:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:2.0:1788843856.397234:0:22690:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:2.0:1788843856.397511:0:22690:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:2.0:1788843856.397727:0:22690:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:2.0:1788843856.397978:0:22690:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:2.0:1788843856.398299:0:22690:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:2.0:1788843856.398518:0:22690:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:2.0:1788843856.398724:0:22690:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:2.0:1788843856.399013:0:22690:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:2.0:1788843856.399358:0:22690:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:2.0:1788843856.400016:0:22690:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:2.0:1788843856.400525:0:22690:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:2.0:1788843856.401737:0:22690:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:2.0:1788843856.403576:0:22690:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:2.0:1788843856.404586:0:22690:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:2.0:1788843856.405339:0:22690:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:2.0:1788843856.405806:0:22690:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:2.0:1788843856.408420:0:22690:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:2.0:1788843856.408746:0:22690:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:2.0:1788843856.409137:0:22690:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:2.0:1788843856.413007:0:22690:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:2.0:1788843856.413643:0:22690:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1788843856.413864:0:22690:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1788843856.414358:0:22690:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:2.0:1788843856.414590:0:22690:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:2.0:1788843856.414921:0:22690:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:2.0:1788843856.417915:0:22690:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:2.0:1788843856.419621:0:22690:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1788843856.420655:0:22690:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:3.0:1788843856.434322:0:22690:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:3.0:1788843856.434829:0:22690:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:3.0:1788843856.435079:0:22690:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:3.0:1788843856.435701:0:22690:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:3.0:1788843856.435954:0:22690:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:3.0:1788843856.436190:0:22690:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00080000:01000000:3.0:1788843856.439641:0:22690:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1788843856.439964:0:22690:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1788843856.439974:0:22690:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788843856.439991:0:22690:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa762dfcbd58d2988 00000020:01000004:3.0:1788843856.440002:0:22690:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:3.0:1788843856.440007:0:22690:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1788843856.440013:0:22690:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9bd127b94800 from MGS 00000020:01000004:3.0:1788843856.440017:0:22690:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1788843856.440030:0:22690:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff9bd005b619b8) 00000020:00000080:3.0:1788843856.440043:0:22690:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1788843856.440131:0:22690:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9bd127b94800 from MGS, refs=2 00080000:01000000:3.0:1788843856.440137:0:22690:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788843856.440183:0:22690:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa762dfcbd58d2996 00000100:00100000:3.0:1788843856.440305:0:22690:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1788843856.440490:0:22690:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1788843856.440496:0:22690:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:3.0:1788843856.442566:0:22690:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:3.0:1788843856.442582:0:22690:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1788843856.446815:0:22690:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788843856.447404:0:22690:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1788843856.447413:0:22690:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:1.0:1788843856.448531:0:22690:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:1.0:1788843856.448544:0:22690:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:1.0:1788843856.449037:0:22690:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:1.0:1788843856.449047:0:22690:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:2.0:1788843856.450641:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788843856.450647:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788843856.450649:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788843856.451042:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788843856.451045:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788843856.451047:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843856.461568:0:22690:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:2.0:1788843856.470869:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:0.0:1788843856.479282:0:22690:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:2.0:1788843856.485999:0:22702:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:0.0:1788843856.486038:0:22690:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:0.0:1788843856.486356:0:22690:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788843856.493594:0:22690:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:0.0:1788843856.494378:0:22690:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788843856.494694:0:22690:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:0.0:1788843856.494701:0:22690:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1788843856.495956:0:22690:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1788843856.495971:0:22690:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:2.0:1788843856.496379:0:22690:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:2.0:1788843856.496385:0:22690:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:3.0:1788843856.499988:0:22690:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1788843856.500023:0:22690:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.203.133@tcp' 00000020:01000004:3.0:1788843856.500026:0:22690:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:3.0:1788843856.500067:0:22690:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.203.133@tcp (typ=mgc) 00000020:00000080:3.0:1788843856.500087:0:22690:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.133@tcp (ffff9bd005b60000) 00000020:00000080:3.0:1788843856.500107:0:22690:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:3.0:1788843856.500488:0:22690:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9bd13fbc0000@MGC192.168.203.133@tcp: add connection 192.168.203.133@tcp at head 00000100:00080000:1.0:1788843856.500536:0:22707:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00010000:00010000:3.0:1788843856.500975:0:22690:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.133@tcp-0 is initialized 00000040:01000000:3.0:1788843856.500985:0:22690:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.133@tcp ctxt 1 is initialized 10000000:01000000:1.0:1788843856.501914:0:22708:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:2.0:1788843856.502030:0:22690:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.133@tcp (uuid 0ce589ba-8334-438e-8f48-13932fcba8b1) 00000020:00000080:2.0:1788843856.502058:0:22690:0:(genops.c:1385:class_connect()) connect: client 0ce589ba-8334-438e-8f48-13932fcba8b1, cookie 0xa762dfcbd58d29a4 00000100:00080000:2.0:1788843856.502073:0:22690:0:(import.c:510:import_select_connection()) MGC192.168.203.133@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788843856.502080:0:22690:0:(import.c:624:import_select_connection()) MGC192.168.203.133@tcp: import ffff9bd13fbc0000 using connection 192.168.203.133@tcp/0@lo 00000100:00100000:2.0:1788843856.502121:0:22690:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bd10f8d1180 x1875738134552192/t0(0) o250->MGC192.168.203.133@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788843856.502207:0:22690:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 0ce589ba-8334-438e-8f48-13932fcba8b1->MGS 00000020:01000004:2.0:1788843856.502233:0:22690:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1788843856.502248:0:22690:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:2.0:1788843856.502265:0:22690:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff9bd1203f4d28) 00000020:00000080:2.0:1788843856.502278:0:22690:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:3.0:1788843856.509313:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f8d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0ce589ba-8334-438e-8f48-13932fcba8b1:3629:1875738134552192:0@lo:250:mount.lustre.0 00000100:00100000:3.0:1788843856.509658:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843856.511562:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134552192 00000100:00100000:3.0:1788843856.511583:0:22704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134552192 00000100:00100000:3.0:1788843856.511651:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788843856.511661:0:22704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0059e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3629:x1875738134552192:12345-0@lo:250:mount.lustre.0 00010000:00080000:3.0:1788843856.511696:0:22704:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 0ce589ba-8334-438e-8f48-13932fcba8b1@0@lo t0 exp 0000000000000000 cur 634 last 0 00000020:00000080:3.0:1788843856.511733:0:22704:0:(genops.c:1385:class_connect()) connect: client 0ce589ba-8334-438e-8f48-13932fcba8b1, cookie 0xa762dfcbd58d29b2 00000100:00080000:3.0:1788843856.511920:0:22704:0:(import.c:65:import_set_state_nolock()) ffff9bd13fbc6800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788843856.512033:0:22704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0059e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ce589ba-8334-438e-8f48-13932fcba8b1+5:3629:x1875738134552192:12345-0@lo:250:mount.lustre.0 Request processed in 371us (2374us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843856.512043:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788843856.512073:0:3629:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.203.133@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1788843856.512085:0:3629:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.203.133@tcp: connect to target with instance 0 00000100:00080000:0.0:1788843856.512094:0:3629:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.203.133@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1788843856.512100:0:3629:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1788843856.512104:0:3629:0:(import.c:65:import_set_state_nolock()) ffff9bd13fbc0000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1788843856.512126:0:3629:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1788843856.512138:0:3629:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1788843856.512165:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f8d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0ce589ba-8334-438e-8f48-13932fcba8b1:3629:1875738134552192:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1788843856.524040:0:22690:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788843856.524382:0:22690:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:1.0:1788843856.524389:0:22690:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:1.0:1788843856.531426:0:22690:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:1.0:1788843856.531455:0:22690:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:3.0:1788843856.539597:0:22690:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:3.0:1788843856.539615:0:22690:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:1.0:1788843856.540829:0:22690:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788843856.541065:0:22690:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:1.0:1788843856.541078:0:22690:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:3.0:1788843856.548369:0:22690:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:3.0:1788843856.548400:0:22690:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1788843856.625619:0:22690:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788843856.626064:0:22690:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1788843856.626071:0:22690:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:3.0:1788843856.627332:0:22690:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:3.0:1788843856.627344:0:22690:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:2.0:1788843856.628100:0:22690:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788843856.628476:0:22690:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788843856.628483:0:22690:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:2.0:1788843856.641406:0:22690:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788843856.641422:0:22690:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:3.0:1788843856.649634:0:22690:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788843856.649892:0:22690:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788843856.649900:0:22690:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1788843856.652366:0:22690:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788843856.652386:0:22690:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:3.0:1788843856.653288:0:22690:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788843856.653527:0:22690:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788843856.653533:0:22690:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1788843856.654674:0:22690:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788843856.654683:0:22690:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:3.0:1788843856.698189:0:22690:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788843856.698436:0:22690:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1788843856.698456:0:22690:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:2.0:1788843856.706549:0:22690:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1788843856.706664:0:22690:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1788843856.709561:0:22690:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1788843856.709578:0:22690:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:1.0:1788843856.721920:0:22690:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:1.0:1788843856.721956:0:22690:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:1.0:1788843856.721964:0:22690:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.133@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:1.0:1788843856.722090:0:22690:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.133@tcp ctxt 0 is initialized 00000020:01000004:1.0:1788843856.722188:0:22690:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.133@tcp, index=0000, flags=0x20005 00000020:01000004:1.0:1788843856.722194:0:22690:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1788843856.722195:0:22690:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788843856.722197:0:22690:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788843856.722198:0:22690:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788843856.722200:0:22690:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788843856.722201:0:22690:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788843856.722202:0:22690:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788843856.722204:0:22690:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788843856.722206:0:22690:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788843856.722208:0:22690:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788843856.722210:0:22690:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:1.0:1788843856.722213:0:22690:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788843856.722214:0:22690:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788843856.722215:0:22690:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788843856.722216:0:22690:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788843856.722218:0:22690:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788843856.722218:0:22690:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788843856.722220:0:22690:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788843856.722221:0:22690:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788843856.722222:0:22690:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788843856.722223:0:22690:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788843856.722252:0:22690:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1788843856.722273:0:22690:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f963100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ce589ba-8334-438e-8f48-13932fcba8b1:22690:1875738134552320:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788843856.722366:0:22690:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843856.722424:0:22690:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd102fed000 going to sleep for 11 seconds 00000100:00100000:3.0:1788843856.722483:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134552320 00000100:00100000:3.0:1788843856.722492:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134552320 00000100:00100000:3.0:1788843856.722543:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788843856.722553:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0059e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ce589ba-8334-438e-8f48-13932fcba8b1+5:22690:x1875738134552320:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788843856.722606:0:22706:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788843856.722609:0:22706:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1788843856.722612:0:22706:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:0.0:1788843856.724196:0:22727:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:3.0:1788843856.727108:0:22706:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 10 20000000:01000000:3.0:1788843856.730041:0:22728:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:3.0:1788843856.730050:0:22728:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:3.0:1788843856.730054:0:22728:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:3.0:1788843856.730057:0:22728:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:3.0:1788843856.730332:0:22728:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:2.0:1788843856.730544:0:22706:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1788843856.730554:0:22706:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:2.0:1788843856.732588:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0059e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ce589ba-8334-438e-8f48-13932fcba8b1+5:22690:x1875738134552320:12345-0@lo:253:mount.lustre.0 Request processed in 10027us (10213us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843856.732609:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788843856.732674:0:22690:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f963100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ce589ba-8334-438e-8f48-13932fcba8b1:22690:1875738134552320:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788843856.732699:0:22690:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1788843856.732702:0:22690:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788843856.732704:0:22690:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788843856.732716:0:22690:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788843856.732718:0:22690:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788843856.732719:0:22690:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788843856.732720:0:22690:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788843856.732722:0:22690:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788843856.732724:0:22690:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788843856.732725:0:22690:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788843856.732726:0:22690:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1788843856.732752:0:22690:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9bd127b94800 from lustre-MDT0000 10000000:01000000:1.0:1788843856.732796:0:22690:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:1.0:1788843856.732799:0:22690:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1788843856.732804:0:22690:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9bd005b60000 10000000:01000000:1.0:1788843856.732808:0:22690:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788843856.732818:0:22690:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9bd005b60000 from 1 10000000:01000000:1.0:1788843856.732823:0:22690:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788843856.732879:0:22690:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd007946400/0xa762dfcbd58d29b9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843856.732890:0:22690:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.133@tcp lock: ffff9bd007946400/0xa762dfcbd58d29b9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843856.732899:0:22690:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.133@tcp lock: ffff9bd007946400/0xa762dfcbd58d29b9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843856.732921:0:22690:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f963100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ce589ba-8334-438e-8f48-13932fcba8b1:22690:1875738134552448:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788843856.732983:0:22690:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843856.733047:0:22690:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd107659780 going to sleep for 11 seconds 00000100:00100000:2.0:1788843856.733179:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134552448 00000100:00100000:2.0:1788843856.733187:0:22704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134552448 00000100:00100000:2.0:1788843856.733252:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788843856.733262:0:22704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0059e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ce589ba-8334-438e-8f48-13932fcba8b1+5:22690:x1875738134552448:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788843856.733276:0:22704:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788843856.733296:0:22704:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd1153e6000/0xa762dfcbd58d29c0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa762dfcbd58d29b9 expref: -99 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843856.733327:0:22704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd1153e6000/0xa762dfcbd58d29c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa762dfcbd58d29b9 expref: 6 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843856.733353:0:22704:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd1153e6000/0xa762dfcbd58d29c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa762dfcbd58d29b9 expref: 6 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843856.733364:0:22704:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd1153e6000, rc 0) 00000100:00100000:2.0:1788843856.733403:0:22704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0059e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ce589ba-8334-438e-8f48-13932fcba8b1+6:22690:x1875738134552448:12345-0@lo:101:mount.lustre.0 Request processed in 142us (419us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843856.733410:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788843856.733619:0:22690:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f963100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ce589ba-8334-438e-8f48-13932fcba8b1:22690:1875738134552448:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788843856.733635:0:22690:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.133@tcp lock: ffff9bd007946400/0xa762dfcbd58d29b9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d29c0 expref: -99 pid: 22690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843856.733645:0:22690:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.133@tcp lock: ffff9bd007946400/0xa762dfcbd58d29b9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa762dfcbd58d29c0 expref: -99 pid: 22690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843856.733725:0:22690:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f956a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ce589ba-8334-438e-8f48-13932fcba8b1:22690:1875738134552576:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788843856.733756:0:22690:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843856.733787:0:22690:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd00749bcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788843856.733925:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134552576 00000100:00100000:1.0:1788843856.733930:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134552576 00000100:00100000:1.0:1788843856.733961:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788843856.733969:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007355450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ce589ba-8334-438e-8f48-13932fcba8b1+6:22690:x1875738134552576:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788843856.734118:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007355450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ce589ba-8334-438e-8f48-13932fcba8b1+6:22690:x1875738134552576:12345-0@lo:501:mount.lustre.0 Request processed in 150us (361us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788843856.734131:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788843856.738030:0:22690:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f956a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ce589ba-8334-438e-8f48-13932fcba8b1:22690:1875738134552576:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1788843856.740337:0:22690:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.133@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1788843856.740451:0:22690:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd007946400/0xa762dfcbd58d29b9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d29c0 expref: -99 pid: 22690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843856.740467:0:22690:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.133@tcp lock: ffff9bd007946400/0xa762dfcbd58d29b9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d29c0 expref: -99 pid: 22690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788843856.740477:0:22690:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9bd127b94800 10000000:01000000:1.0:1788843856.740489:0:22690:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788843856.740495:0:22690:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9bd127b94800 10000000:01000000:1.0:1788843856.740497:0:22690:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1788843856.740501:0:22690:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9bd127b94800 from 1 10000000:01000000:1.0:1788843856.740504:0:22690:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1788843856.740549:0:22690:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd007946a00/0xa762dfcbd58d29c7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843856.740558:0:22690:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.133@tcp lock: ffff9bd007946a00/0xa762dfcbd58d29c7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843856.740571:0:22690:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.133@tcp lock: ffff9bd007946a00/0xa762dfcbd58d29c7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843856.740601:0:22690:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f960e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ce589ba-8334-438e-8f48-13932fcba8b1:22690:1875738134552704:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788843856.740694:0:22690:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843856.741613:0:22690:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd107659480 going to sleep for 11 seconds 00000100:00100000:0.0:1788843856.743461:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134552704 00000100:00100000:0.0:1788843856.743478:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134552704 00000100:00100000:1.0:1788843856.743650:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788843856.743662:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007354c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ce589ba-8334-438e-8f48-13932fcba8b1+6:22690:x1875738134552704:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788843856.743703:0:22705:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788843856.743729:0:22705:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd007946600/0xa762dfcbd58d29ce lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa762dfcbd58d29c7 expref: -99 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843856.743761:0:22705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd007946600/0xa762dfcbd58d29ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa762dfcbd58d29c7 expref: 7 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843856.743773:0:22705:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd007946600/0xa762dfcbd58d29ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa762dfcbd58d29c7 expref: 7 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843856.743783:0:22705:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd007946600, rc 0) 00000100:00100000:1.0:1788843856.743890:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007354c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ce589ba-8334-438e-8f48-13932fcba8b1+7:22690:x1875738134552704:12345-0@lo:101:mount.lustre.0 Request processed in 229us (3196us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843856.743898:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788843856.743966:0:22690:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f960e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ce589ba-8334-438e-8f48-13932fcba8b1:22690:1875738134552704:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788843856.743996:0:22690:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.133@tcp lock: ffff9bd007946a00/0xa762dfcbd58d29c7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d29ce expref: -99 pid: 22690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843856.744008:0:22690:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.133@tcp lock: ffff9bd007946a00/0xa762dfcbd58d29c7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa762dfcbd58d29ce expref: -99 pid: 22690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788843856.744032:0:22690:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.133@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1788843856.744052:0:22690:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd007946a00/0xa762dfcbd58d29c7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d29ce expref: -99 pid: 22690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843856.744083:0:22690:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.133@tcp lock: ffff9bd007946a00/0xa762dfcbd58d29c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d29ce expref: -99 pid: 22690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788843856.744093:0:22690:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1788843856.744100:0:22690:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788843856.744108:0:22690:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9bd127b94800 10000000:01000000:3.0:1788843856.744110:0:22690:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1788843856.744115:0:22690:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1788843856.744118:0:22690:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1788843856.744193:0:22690:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd118f71400/0xa762dfcbd58d29d5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843856.744202:0:22690:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.133@tcp lock: ffff9bd118f71400/0xa762dfcbd58d29d5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843856.744212:0:22690:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.133@tcp lock: ffff9bd118f71400/0xa762dfcbd58d29d5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843856.744235:0:22690:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd1074fea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ce589ba-8334-438e-8f48-13932fcba8b1:22690:1875738134552832:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788843856.744294:0:22690:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843856.744334:0:22690:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd13dffc3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788843856.744380:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134552832 00000100:00100000:2.0:1788843856.744387:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134552832 00000100:00100000:2.0:1788843856.744424:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788843856.744432:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007356450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ce589ba-8334-438e-8f48-13932fcba8b1+7:22690:x1875738134552832:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788843856.744451:0:22706:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788843856.744463:0:22706:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd1153e7400/0xa762dfcbd58d29dc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa762dfcbd58d29d5 expref: -99 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843856.744480:0:22706:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd1153e7400/0xa762dfcbd58d29dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa762dfcbd58d29d5 expref: 8 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843856.744490:0:22706:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd1153e7400/0xa762dfcbd58d29dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa762dfcbd58d29d5 expref: 8 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843856.744498:0:22706:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd1153e7400, rc 0) 00000100:00100000:2.0:1788843856.744543:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007356450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ce589ba-8334-438e-8f48-13932fcba8b1+8:22690:x1875738134552832:12345-0@lo:101:mount.lustre.0 Request processed in 112us (249us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843856.744549:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788843856.744591:0:22690:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd1074fea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ce589ba-8334-438e-8f48-13932fcba8b1:22690:1875738134552832:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788843856.744606:0:22690:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.133@tcp lock: ffff9bd118f71400/0xa762dfcbd58d29d5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d29dc expref: -99 pid: 22690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843856.744616:0:22690:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.133@tcp lock: ffff9bd118f71400/0xa762dfcbd58d29d5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa762dfcbd58d29dc expref: -99 pid: 22690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843856.744689:0:22690:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd1074fea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ce589ba-8334-438e-8f48-13932fcba8b1:22690:1875738134552960:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788843856.744931:0:22690:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843856.744952:0:22690:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd13dffc3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788843856.744969:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134552960 00000100:00100000:1.0:1788843856.744976:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134552960 00000100:00100000:1.0:1788843856.745009:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788843856.745016:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007355c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ce589ba-8334-438e-8f48-13932fcba8b1+8:22690:x1875738134552960:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788843856.745309:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007355c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ce589ba-8334-438e-8f48-13932fcba8b1+9:22690:x1875738134552960:12345-0@lo:501:mount.lustre.0 Request processed in 292us (378us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843856.745350:0:22690:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd1074fea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ce589ba-8334-438e-8f48-13932fcba8b1:22690:1875738134552960:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788843856.745500:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788843856.745510:0:22690:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd1074fea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ce589ba-8334-438e-8f48-13932fcba8b1:22690:1875738134553088:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788843856.745564:0:22690:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843856.745594:0:22690:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd13dffc3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788843856.745610:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134553088 00000100:00100000:1.0:1788843856.745616:0:22704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134553088 00000100:00100000:1.0:1788843856.745690:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788843856.745698:0:22704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007356050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ce589ba-8334-438e-8f48-13932fcba8b1+9:22690:x1875738134553088:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788843856.746742:0:22704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007356050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ce589ba-8334-438e-8f48-13932fcba8b1+9:22690:x1875738134553088:12345-0@lo:503:mount.lustre.0 Request processed in 1037us (1170us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843856.746769:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788843856.746845:0:22690:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd1074fea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ce589ba-8334-438e-8f48-13932fcba8b1:22690:1875738134553088:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788843856.750905:0:22729:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f8d1500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0ce589ba-8334-438e-8f48-13932fcba8b1:22729:1875738134553216:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788843856.751042:0:22729:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843856.751646:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134553216 00000100:00100000:0.0:1788843856.751659:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134553216 00000100:00100000:0.0:1788843856.751721:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788843856.751732:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007354450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ce589ba-8334-438e-8f48-13932fcba8b1+9:22729:x1875738134553216:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788843856.751974:0:22729:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd13fa33180 going to sleep for 11 seconds 00000100:00100000:1.0:1788843856.757504:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007354450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ce589ba-8334-438e-8f48-13932fcba8b1+9:22729:x1875738134553216:12345-0@lo:502:llog_process_th.0 Request processed in 5757us (6445us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843856.757523:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788843856.758292:0:22729:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f8d1500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0ce589ba-8334-438e-8f48-13932fcba8b1:22729:1875738134553216:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788843856.758461:0:22729:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788843856.758478:0:22729:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788843856.758481:0:22729:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1788843856.758487:0:22729:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:2.0:1788843856.758491:0:22729:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788843856.758510:0:22729:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff9bd1203f19b8) 00000020:00000080:2.0:1788843856.758536:0:22729:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:2.0:1788843856.758541:0:22729:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1788843856.758675:0:22729:0:(osd_handler.c:8925:osd_obd_connect()) connect #2 00000020:00000080:2.0:1788843856.758684:0:22729:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa762dfcbd58d29ea 00000020:00000080:2.0:1788843856.759094:0:22729:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1788843856.759100:0:22729:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788843856.759104:0:22729:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788843856.759205:0:22729:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1788843856.759210:0:22729:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788843856.759215:0:22729:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788843856.759217:0:22729:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:2.0:1788843856.759220:0:22729:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788843856.759230:0:22729:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff9bd1203f3370) 00000020:00000080:2.0:1788843856.759244:0:22729:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:2.0:1788843856.759248:0:22729:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1788843856.759250:0:22729:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:2.0:1788843856.759254:0:22729:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:2.0:1788843856.759260:0:22729:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788843856.759481:0:22729:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9bd127b94800 from lustre-MDT0000, refs=3 00000020:00000080:2.0:1788843856.759499:0:22729:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff9bd1203f0000) 00000020:00000080:2.0:1788843856.759510:0:22729:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:2.0:1788843856.759575:0:22729:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1788843856.759583:0:22729:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa762dfcbd58d29ff 00000020:00000080:2.0:1788843856.759700:0:22729:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:2.0:1788843856.759719:0:22729:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1788843856.759726:0:22729:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xa762dfcbd58d2a06 00080000:01000000:2.0:1788843856.759732:0:22729:0:(osd_handler.c:8925:osd_obd_connect()) connect #3 00000020:00000080:2.0:1788843856.759738:0:22729:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa762dfcbd58d2a0d 00010000:00010000:3.0:1788843856.892843:0:22729:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:3.0:1788843856.894863:0:22729:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 8589934628 00000001:00080000:3.0:1788843856.897319:0:22729:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1788843856.897983:0:22729:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff9bd005b63370) 00000020:00000080:3.0:1788843856.898016:0:22729:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1788843856.906886:0:22729:0:(osd_handler.c:8925:osd_obd_connect()) connect #4 00000020:00000080:3.0:1788843856.906909:0:22729:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa762dfcbd58d2a1b 00000020:00000080:1.0:1788843856.908724:0:22729:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1788843856.916825:0:22729:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xa762dfcbd58d2a22 00000020:00000080:2.0:1788843856.918828:0:22729:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1788843856.918841:0:22729:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788843856.918852:0:22729:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788843856.918854:0:22729:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1788843856.918857:0:22729:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788843856.918860:0:22729:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #8 00000020:01000000:2.0:1788843856.918862:0:22729:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788843856.918864:0:22729:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788843856.918865:0:22729:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788843856.918868:0:22729:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788843856.918869:0:22729:0:(obd_config.c:1563:class_process_config()) marker 8 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788843856.918872:0:22729:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788843856.918876:0:22729:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788843856.918878:0:22729:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1788843856.918882:0:22729:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1788843856.918928:0:22729:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1788843856.918941:0:22729:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788843856.918945:0:22729:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788843856.918946:0:22729:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:2.0:1788843856.918948:0:22729:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788843856.918951:0:22729:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788843856.918953:0:22729:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:2.0:1788843856.918955:0:22729:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788843856.918961:0:22729:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.133@tcp to nid 0x20000c0a8cb85 (192.168.203.133@tcp) 00000020:00000080:2.0:1788843856.918989:0:22729:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788843856.919020:0:22729:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff9bd12d61b370) 00000020:00000080:2.0:1788843856.919036:0:22729:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:2.0:1788843856.919042:0:22729:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788843856.919100:0:22729:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:2.0:1788843856.919106:0:22729:0:(osd_handler.c:8925:osd_obd_connect()) connect #5 00000020:00000080:2.0:1788843856.919113:0:22729:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa762dfcbd58d2a30 00010000:00080000:2.0:1788843856.919163:0:22729:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9bd10f906000@lustre-MDT0001-osp-MDT0000: add connection 192.168.203.133@tcp at head 00010000:00010000:2.0:1788843856.921998:0:22729:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-1 is initialized 00000020:00000080:3.0:1788843856.923345:0:22729:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788843856.923870:0:22729:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:2.0:1788843856.923924:0:22729:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:2.0:1788843856.923948:0:22729:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa762dfcbd58d2a37 00000100:00080000:2.0:1788843856.923960:0:22729:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788843856.923967:0:22729:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9bd10f906000 using connection 192.168.203.133@tcp/0@lo 00000100:00100000:2.0:1788843856.924010:0:22729:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bd10f8d1500 x1875738134553344/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788843856.924043:0:22729:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:2.0:1788843856.924118:0:22729:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788843856.924122:0:22729:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788843856.924124:0:22729:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:2.0:1788843856.924127:0:22729:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788843856.924131:0:22729:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #19 00000020:01000000:2.0:1788843856.924132:0:22729:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788843856.924134:0:22729:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788843856.924136:0:22729:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788843856.924166:0:22729:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788843856.924169:0:22729:0:(obd_config.c:1563:class_process_config()) marker 19 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788843856.924172:0:22729:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788843856.924178:0:22729:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:2.0:1788843856.924182:0:22729:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788843856.924183:0:22729:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1788843856.924187:0:22729:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788843856.924190:0:22729:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.133@tcp to nid 0x20000c0a8cb85 (192.168.203.133@tcp) 00000020:01000000:2.0:1788843856.924215:0:22729:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1788843856.924218:0:22729:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788843856.924237:0:22729:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9bd12d6199b8) 00000020:00000080:2.0:1788843856.924250:0:22729:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:2.0:1788843856.924255:0:22729:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788843856.924305:0:22729:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1788843856.924312:0:22729:0:(osd_handler.c:8925:osd_obd_connect()) connect #6 00000020:00000080:2.0:1788843856.924317:0:22729:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa762dfcbd58d2a45 00010000:00080000:2.0:1788843856.924482:0:22729:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9bd10f7b9800@lustre-OST0000-osc-MDT0000: add connection 192.168.203.133@tcp at head 00010000:00010000:2.0:1788843856.924781:0:22729:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-2 is initialized 00000100:00100000:3.0:1788843856.925735:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f8d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3629:1875738134553344:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788843856.925810:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843856.925989:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134553344 00000100:00100000:1.0:1788843856.925997:0:22716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134553344 00000100:00100000:1.0:1788843856.926035:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788843856.926043:0:22716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1074fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3629:x1875738134553344:12345-0@lo:38:llog_process_th.0 00010000:00020000:1.0:1788843856.926061:0:22716:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000040:01000000:2.0:1788843856.926541:0:22729:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1788843856.928811:0:22729:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1788843856.932606:0:22729:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788843856.933573:0:22729:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].3, 64 off8384 00000040:00080000:3.0:1788843856.952532:0:22729:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].1, 64 off8256 00000040:00080000:0.0:1788843856.960577:0:22736:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:0.0:1788843856.960586:0:22736:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x10:0x0] at index 3 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1788843856.968667:0:22729:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788843856.969269:0:22729:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788843856.969326:0:22729:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1788843856.969348:0:22729:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa762dfcbd58d2a4c 00000100:00080000:3.0:1788843856.969361:0:22729:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788843856.969368:0:22729:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9bd10f7b9800 using connection 192.168.203.133@tcp/0@lo 00000100:00100000:3.0:1788843856.969417:0:22729:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bd1074fca80 x1875738134553472/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788843856.969807:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd1074fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3629:1875738134553472:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1788843856.969873:0:3629:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875738134553472 offset 0 length 520: 4 00000100:00080000:3.0:1788843856.969937:0:22729:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1788843856.970032:0:22729:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788843856.970038:0:22729:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788843856.970040:0:22729:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1788843856.970043:0:22729:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788843856.970046:0:22729:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #27 00000020:01000000:3.0:1788843856.970048:0:22729:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788843856.970049:0:22729:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788843856.970051:0:22729:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788843856.970053:0:22729:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788843856.970055:0:22729:0:(obd_config.c:1563:class_process_config()) marker 27 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788843856.970057:0:22729:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788843856.970062:0:22729:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1788843856.970065:0:22729:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788843856.970067:0:22729:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1788843856.970069:0:22729:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788843856.970072:0:22729:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.133@tcp to nid 0x20000c0a8cb85 (192.168.203.133@tcp) 00000020:01000000:3.0:1788843856.970093:0:22729:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1788843856.970096:0:22729:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788843856.970121:0:22729:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9bd005b64d28) 00000020:00000080:3.0:1788843856.970135:0:22729:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:3.0:1788843856.970160:0:22729:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788843856.970227:0:22729:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1788843856.970235:0:22729:0:(osd_handler.c:8925:osd_obd_connect()) connect #7 00000020:00000080:3.0:1788843856.970242:0:22729:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa762dfcbd58d2a5a 00010000:00080000:3.0:1788843856.970272:0:22729:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9bd0059c6000@lustre-OST0001-osc-MDT0000: add connection 192.168.203.133@tcp at head 00010000:00010000:3.0:1788843856.970549:0:22729:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-3 is initialized 00000040:01000000:3.0:1788843856.970630:0:22729:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1788843856.970645:0:22729:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000100:00080000:2.0:1788843856.972309:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788843856.972315:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788843856.972379:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788843856.972397:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f8d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0ce589ba-8334-438e-8f48-13932fcba8b1:3630:1875738134553600:0@lo:400:kworker.0 00000100:00100000:2.0:1788843856.972483:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843856.972669:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134553600 00000100:00100000:1.0:1788843856.972687:0:22704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134553600 00000100:00100000:1.0:1788843856.972736:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788843856.972745:0:22704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007356850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ce589ba-8334-438e-8f48-13932fcba8b1+9:3630:x1875738134553600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843856.972804:0:22704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007356850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ce589ba-8334-438e-8f48-13932fcba8b1+9:3630:x1875738134553600:12345-0@lo:400:kworker.0 Request processed in 60us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843856.972812:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788843856.972867:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f8d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0ce589ba-8334-438e-8f48-13932fcba8b1:3630:1875738134553600:0@lo:400:kworker.0 00000100:00100000:1.0:1788843856.975855:0:22716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1074fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3629:x1875738134553344:12345-0@lo:38:llog_process_th.0 Request processed in 49799us (50033us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788843856.975871:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1788843856.976307:0:3629:0:(import.c:65:import_set_state_nolock()) ffff9bd10f906000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788843856.976542:0:3629:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788843856.976547:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f8d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3629:1875738134553344:0@lo:38:llog_process_th.0 00000040:00080000:0.0:1788843856.981069:0:22729:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788843856.982266:0:22729:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].3, 64 off8384 00000040:00080000:0.0:1788843856.982464:0:22729:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x12:0x0].1, 64 off8256 00000040:00080000:3.0:1788843856.983046:0:22738:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:3.0:1788843856.983052:0:22738:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x12:0x0] at index 3 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1788843856.984038:0:22729:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788843856.984053:0:22729:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1788843856.984091:0:22729:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1788843856.984112:0:22729:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa762dfcbd58d2a61 00000100:00080000:0.0:1788843856.984126:0:22729:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788843856.984133:0:22729:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9bd0059c6000 using connection 192.168.203.133@tcp/0@lo 00000100:00100000:0.0:1788843856.984637:0:22729:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bd10f957480 x1875738134553728/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788843856.984758:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f957480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3629:1875738134553728:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1788843856.984818:0:3629:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875738134553728 offset 0 length 520: 4 00000100:00080000:0.0:1788843856.984880:0:22729:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:2.0:1788843856.984996:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788843856.985003:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000020:01000000:0.0:1788843856.985005:0:22729:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000100:00080000:2.0:1788843856.985007:0:38:0:(import.c:65:import_set_state_nolock()) ffff9bd10f906000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000020:00000080:0.0:1788843856.985013:0:22729:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000100:00080000:2.0:1788843856.985015:0:38:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 634 00000020:00000080:0.0:1788843856.985017:0:22729:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000100:00080000:2.0:1788843856.985023:0:38:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000020:01000000:0.0:1788843856.985023:0:22729:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788843856.985031:0:22729:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000100:00080000:2.0:1788843856.985034:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9bd10f906000 using connection 192.168.203.133@tcp/0@lo 00000020:00000080:0.0:1788843856.985035:0:22729:0:(obd_config.c:1563:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788843856.985042:0:22729:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788843856.985044:0:22729:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788843856.985046:0:22729:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788843856.985049:0:22729:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788843856.985051:0:22729:0:(obd_config.c:1563:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000020:01000000:0.0:1788843856.985053:0:22729:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788843856.985057:0:22729:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000100:00100000:2.0:1788843856.985061:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bd10f8d3b80 x1875738134553856/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000020:00000080:0.0:1788843856.985073:0:22729:0:(obd_config.c:1563:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1788843856.985078:0:22729:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1788843856.985102:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f8d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3629:1875738134553856:0@lo:38:kworker.0 00000100:00100000:3.0:1788843856.985182:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843856.985228:0:22717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134553856 00000100:00100000:3.0:1788843856.985236:0:22717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134553856 00000100:00100000:3.0:1788843856.985270:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788843856.985278:0:22717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1074fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3629:x1875738134553856:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788843856.985294:0:22717:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788843856.985341:0:22717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1074fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3629:x1875738134553856:12345-0@lo:38:kworker.0 Request processed in 63us (160us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788843856.985349:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:3.0:1788843856.985388:0:3629:0:(import.c:65:import_set_state_nolock()) ffff9bd10f906000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788843856.985393:0:3629:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788843856.985396:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f8d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3629:1875738134553856:0@lo:38:kworker.0 00000100:00100000:0.0:1788843856.985675:0:22729:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f955880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0ce589ba-8334-438e-8f48-13932fcba8b1:22729:1875738134553984:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788843856.985741:0:22729:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843856.985774:0:22729:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd104bb9480 going to sleep for 11 seconds 00000100:00100000:1.0:1788843856.991029:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134553984 00000100:00100000:1.0:1788843856.991046:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134553984 00000100:00100000:1.0:1788843856.991108:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788843856.991118:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007355850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ce589ba-8334-438e-8f48-13932fcba8b1+9:22729:x1875738134553984:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788843856.991502:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007355850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ce589ba-8334-438e-8f48-13932fcba8b1+9:22729:x1875738134553984:12345-0@lo:502:llog_process_th.0 Request processed in 237us (5612us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843856.991511:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788843856.994071:0:22729:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f955880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0ce589ba-8334-438e-8f48-13932fcba8b1:22729:1875738134553984:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788843856.994124:0:22729:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788843856.994136:0:22729:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788843856.994178:0:22729:0:(obd_config.c:1563:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1788843856.994184:0:22729:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:3.0:1788843856.994369:0:22690:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:3.0:1788843856.994394:0:22690:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.133@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1788843856.994419:0:22690:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd118f71400/0xa762dfcbd58d29d5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d29dc expref: -99 pid: 22690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843856.994445:0:22690:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.133@tcp lock: ffff9bd118f71400/0xa762dfcbd58d29d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d29dc expref: -99 pid: 22690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788843856.994454:0:22690:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9bd127b94800 from 1 10000000:01000000:3.0:1788843856.994467:0:22690:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788843856.994508:0:22690:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd118f71600/0xa762dfcbd58d2a68 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843856.994517:0:22690:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.133@tcp lock: ffff9bd118f71600/0xa762dfcbd58d2a68 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843856.994539:0:22690:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.133@tcp lock: ffff9bd118f71600/0xa762dfcbd58d2a68 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843856.994564:0:22690:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd1074fdf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ce589ba-8334-438e-8f48-13932fcba8b1:22690:1875738134554112:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788843856.994633:0:22690:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843856.994667:0:22690:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd10652b240 going to sleep for 11 seconds 00000100:00100000:1.0:1788843856.995021:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134554112 00000100:00100000:1.0:1788843856.995029:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134554112 00000100:00100000:1.0:1788843856.995083:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788843856.995094:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007355050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ce589ba-8334-438e-8f48-13932fcba8b1+9:22690:x1875738134554112:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788843856.995108:0:22706:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788843856.995123:0:22706:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd007946000/0xa762dfcbd58d2a6f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa762dfcbd58d2a68 expref: -99 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843856.995179:0:22706:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd007946000/0xa762dfcbd58d2a6f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa762dfcbd58d2a68 expref: 10 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843856.995191:0:22706:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd007946000/0xa762dfcbd58d2a6f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa762dfcbd58d2a68 expref: 10 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843856.995199:0:22706:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd007946000, rc 0) 00000100:00100000:1.0:1788843856.995593:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007355050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ce589ba-8334-438e-8f48-13932fcba8b1+10:22690:x1875738134554112:12345-0@lo:101:mount.lustre.0 Request processed in 500us (959us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843856.995601:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788843856.995809:0:22690:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd1074fdf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ce589ba-8334-438e-8f48-13932fcba8b1:22690:1875738134554112:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788843856.995825:0:22690:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.133@tcp lock: ffff9bd118f71600/0xa762dfcbd58d2a68 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d2a6f expref: -99 pid: 22690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843856.995835:0:22690:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.133@tcp lock: ffff9bd118f71600/0xa762dfcbd58d2a68 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa762dfcbd58d2a6f expref: -99 pid: 22690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843856.996411:0:22690:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd1074fdf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ce589ba-8334-438e-8f48-13932fcba8b1:22690:1875738134554240:0@lo:256:mount.lustre.0 00000100:00100000:3.0:1788843856.996484:0:22690:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843856.996512:0:22690:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd10652b240 going to sleep for 11 seconds 00000100:00100000:1.0:1788843856.996713:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134554240 00000100:00100000:1.0:1788843856.996721:0:22704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134554240 00000100:00100000:1.0:1788843856.996768:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788843856.996777:0:22704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007354050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ce589ba-8334-438e-8f48-13932fcba8b1+10:22690:x1875738134554240:12345-0@lo:256:mount.lustre.0 20000000:01000000:1.0:1788843856.996795:0:22704:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1788843856.996802:0:22704:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:1.0:1788843856.996879:0:22704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007354050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ce589ba-8334-438e-8f48-13932fcba8b1+10:22690:x1875738134554240:12345-0@lo:256:mount.lustre.0 Request processed in 103us (394us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843856.996893:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788843857.002292:0:22690:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd1074fdf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ce589ba-8334-438e-8f48-13932fcba8b1:22690:1875738134554240:0@lo:256:mount.lustre.0 10000000:01000000:3.0:1788843857.002892:0:22690:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.133@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788843857.002924:0:22690:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd118f71600/0xa762dfcbd58d2a68 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d2a6f expref: -99 pid: 22690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843857.002992:0:22690:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.133@tcp lock: ffff9bd118f71600/0xa762dfcbd58d2a68 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d2a6f expref: -99 pid: 22690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788843857.003001:0:22690:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9bd127b94800 from 1 10000000:01000000:3.0:1788843857.003004:0:22690:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788843857.003050:0:22690:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd118f70000/0xa762dfcbd58d2a76 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843857.003058:0:22690:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.133@tcp lock: ffff9bd118f70000/0xa762dfcbd58d2a76 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843857.003069:0:22690:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.133@tcp lock: ffff9bd118f70000/0xa762dfcbd58d2a76 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843857.003098:0:22690:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd1074fdf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ce589ba-8334-438e-8f48-13932fcba8b1:22690:1875738134554368:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788843857.003195:0:22690:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843857.003233:0:22690:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd10652b240 going to sleep for 11 seconds 00000100:00100000:1.0:1788843857.004198:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134554368 00000100:00100000:1.0:1788843857.004210:0:22704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134554368 00000100:00100000:1.0:1788843857.004282:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788843857.004294:0:22704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007357450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ce589ba-8334-438e-8f48-13932fcba8b1+10:22690:x1875738134554368:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788843857.004312:0:22704:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788843857.004335:0:22704:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd007947a00/0xa762dfcbd58d2a7d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa762dfcbd58d2a76 expref: -99 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843857.004365:0:22704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd007947a00/0xa762dfcbd58d2a7d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa762dfcbd58d2a76 expref: 11 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843857.004377:0:22704:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd007947a00/0xa762dfcbd58d2a7d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa762dfcbd58d2a76 expref: 11 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843857.004386:0:22704:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd007947a00, rc 0) 00000100:00100000:1.0:1788843857.004479:0:22704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007357450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ce589ba-8334-438e-8f48-13932fcba8b1+11:22690:x1875738134554368:12345-0@lo:101:mount.lustre.0 Request processed in 187us (1283us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843857.004487:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788843857.005917:0:22690:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd1074fdf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ce589ba-8334-438e-8f48-13932fcba8b1:22690:1875738134554368:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788843857.005945:0:22690:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.133@tcp lock: ffff9bd118f70000/0xa762dfcbd58d2a76 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d2a7d expref: -99 pid: 22690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843857.005958:0:22690:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.133@tcp lock: ffff9bd118f70000/0xa762dfcbd58d2a76 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa762dfcbd58d2a7d expref: -99 pid: 22690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843857.006051:0:22690:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd1074fdf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ce589ba-8334-438e-8f48-13932fcba8b1:22690:1875738134554496:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788843857.006107:0:22690:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843857.006190:0:22690:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd10652b240 going to sleep for 11 seconds 00000100:00100000:1.0:1788843857.006284:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134554496 00000100:00100000:1.0:1788843857.006292:0:22704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134554496 00000100:00100000:2.0:1788843857.006360:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788843857.006373:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007354850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ce589ba-8334-438e-8f48-13932fcba8b1+11:22690:x1875738134554496:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788843857.006560:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007354850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ce589ba-8334-438e-8f48-13932fcba8b1+11:22690:x1875738134554496:12345-0@lo:501:mount.lustre.0 Request processed in 190us (452us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843857.006569:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788843857.006626:0:22690:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd1074fdf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ce589ba-8334-438e-8f48-13932fcba8b1:22690:1875738134554496:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788843857.006657:0:22690:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f955880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ce589ba-8334-438e-8f48-13932fcba8b1:22690:1875738134554624:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788843857.006750:0:22690:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843857.006778:0:22690:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd1331179c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788843857.006826:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134554624 00000100:00100000:1.0:1788843857.006831:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134554624 00000100:00100000:1.0:1788843857.006861:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788843857.006869:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007357050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ce589ba-8334-438e-8f48-13932fcba8b1+11:22690:x1875738134554624:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788843857.006961:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007357050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ce589ba-8334-438e-8f48-13932fcba8b1+11:22690:x1875738134554624:12345-0@lo:503:mount.lustre.0 Request processed in 92us (211us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843857.006969:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788843857.007058:0:22690:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f955880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ce589ba-8334-438e-8f48-13932fcba8b1:22690:1875738134554624:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788843857.007581:0:22740:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f955880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0ce589ba-8334-438e-8f48-13932fcba8b1:22740:1875738134554752:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788843857.007624:0:22740:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843857.007656:0:22740:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd133117540 going to sleep for 11 seconds 00000100:00100000:2.0:1788843857.008137:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134554752 00000100:00100000:2.0:1788843857.008177:0:22704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134554752 00000100:00100000:2.0:1788843857.008233:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788843857.008243:0:22704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007356c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ce589ba-8334-438e-8f48-13932fcba8b1+11:22740:x1875738134554752:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788843857.009101:0:22704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007356c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ce589ba-8334-438e-8f48-13932fcba8b1+11:22740:x1875738134554752:12345-0@lo:502:llog_process_th.0 Request processed in 856us (1472us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843857.009125:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788843857.009216:0:22740:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f955880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0ce589ba-8334-438e-8f48-13932fcba8b1:22740:1875738134554752:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788843857.009256:0:22740:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788843857.009268:0:22740:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788843857.009271:0:22740:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788843857.009277:0:22740:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9bd127b94800 00000020:00000080:0.0:1788843857.009280:0:22740:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788843857.009289:0:22740:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788843857.009291:0:22740:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788843857.009292:0:22740:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1788843857.009294:0:22740:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788843857.009296:0:22740:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788843857.009304:0:22740:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788843857.009309:0:22740:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9bd127b94800 00000020:00000080:0.0:1788843857.009311:0:22740:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788843857.010405:0:22740:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788843857.010428:0:22740:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788843857.010430:0:22740:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1788843857.010434:0:22740:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788843857.010445:0:22740:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788843857.010447:0:22740:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788843857.010452:0:22740:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9bd127b94800 00000020:00000080:0.0:1788843857.010454:0:22740:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788843857.016897:0:22740:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788843857.020967:0:22740:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788843857.020976:0:22740:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788843857.020990:0:22740:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788843857.020998:0:22740:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788843857.021000:0:22740:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1788843857.021006:0:22740:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9bd127b94800 00000020:00000080:2.0:1788843857.021009:0:22740:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788843857.021123:0:22740:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f8d0a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0ce589ba-8334-438e-8f48-13932fcba8b1:22740:1875738134554880:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788843857.021225:0:22740:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843857.021272:0:22740:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd111699000 going to sleep for 11 seconds 00000100:00100000:0.0:1788843857.024030:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134554880 00000100:00100000:0.0:1788843857.024043:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134554880 00000100:00100000:0.0:1788843857.024106:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788843857.024117:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007357c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ce589ba-8334-438e-8f48-13932fcba8b1+11:22740:x1875738134554880:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788843857.024325:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007357c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ce589ba-8334-438e-8f48-13932fcba8b1+11:22740:x1875738134554880:12345-0@lo:502:llog_process_th.0 Request processed in 209us (3098us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843857.024338:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788843857.025889:0:22740:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f8d0a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0ce589ba-8334-438e-8f48-13932fcba8b1:22740:1875738134554880:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788843857.026011:0:22740:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788843857.026020:0:22740:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788843857.026022:0:22740:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1788843857.026027:0:22740:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:3.0:1788843857.027214:0:22690:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:3.0:1788843857.027248:0:22690:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.133@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788843857.027277:0:22690:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd118f70000/0xa762dfcbd58d2a76 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d2a7d expref: -99 pid: 22690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843857.027291:0:22690:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.133@tcp lock: ffff9bd118f70000/0xa762dfcbd58d2a76 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d2a7d expref: -99 pid: 22690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788843857.027352:0:22690:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788843857.027356:0:22690:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9bd127b94800 10000000:01000000:3.0:1788843857.027359:0:22690:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9bd127b94800 10000000:01000000:3.0:1788843857.027363:0:22690:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788843857.027369:0:22690:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9bd127b94800 from 1 10000000:01000000:3.0:1788843857.027372:0:22690:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788843857.027410:0:22690:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd118f71e00/0xa762dfcbd58d2a84 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843857.027418:0:22690:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.133@tcp lock: ffff9bd118f71e00/0xa762dfcbd58d2a84 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843857.027428:0:22690:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.133@tcp lock: ffff9bd118f71e00/0xa762dfcbd58d2a84 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843857.027465:0:22690:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd1074ffb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ce589ba-8334-438e-8f48-13932fcba8b1:22690:1875738134555008:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788843857.027545:0:22690:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843857.027588:0:22690:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd132a2c300 going to sleep for 11 seconds 00000100:00100000:0.0:1788843857.029768:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134555008 00000100:00100000:0.0:1788843857.029784:0:22704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134555008 00000100:00100000:0.0:1788843857.029845:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788843857.029856:0:22704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007357850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ce589ba-8334-438e-8f48-13932fcba8b1+11:22690:x1875738134555008:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788843857.029874:0:22704:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788843857.029913:0:22704:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd10f7af800/0xa762dfcbd58d2a8b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa762dfcbd58d2a84 expref: -99 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843857.029944:0:22704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd10f7af800/0xa762dfcbd58d2a8b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa762dfcbd58d2a84 expref: 12 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843857.029952:0:22704:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd10f7af800/0xa762dfcbd58d2a8b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa762dfcbd58d2a84 expref: 12 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843857.029960:0:22704:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd10f7af800, rc 0) 00000100:00100000:0.0:1788843857.030023:0:22704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007357850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ce589ba-8334-438e-8f48-13932fcba8b1+12:22690:x1875738134555008:12345-0@lo:101:mount.lustre.0 Request processed in 172us (2480us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843857.030028:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788843857.030336:0:22690:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd1074ffb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ce589ba-8334-438e-8f48-13932fcba8b1:22690:1875738134555008:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788843857.030534:0:22690:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.133@tcp lock: ffff9bd118f71e00/0xa762dfcbd58d2a84 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d2a8b expref: -99 pid: 22690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843857.030555:0:22690:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.133@tcp lock: ffff9bd118f71e00/0xa762dfcbd58d2a84 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa762dfcbd58d2a8b expref: -99 pid: 22690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843857.030640:0:22690:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd1074ffb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ce589ba-8334-438e-8f48-13932fcba8b1:22690:1875738134555136:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788843857.030679:0:22690:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843857.030711:0:22690:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd132a2c300 going to sleep for 11 seconds 00000100:00100000:0.0:1788843857.030797:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134555136 00000100:00100000:0.0:1788843857.030802:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134555136 00000100:00100000:0.0:1788843857.030834:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788843857.030842:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0018b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ce589ba-8334-438e-8f48-13932fcba8b1+12:22690:x1875738134555136:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788843857.032213:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0018b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ce589ba-8334-438e-8f48-13932fcba8b1+12:22690:x1875738134555136:12345-0@lo:501:mount.lustre.0 Request processed in 1365us (1526us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843857.032224:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788843857.032349:0:22690:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd1074ffb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ce589ba-8334-438e-8f48-13932fcba8b1:22690:1875738134555136:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788843857.032656:0:22690:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd1074ffb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ce589ba-8334-438e-8f48-13932fcba8b1:22690:1875738134555264:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788843857.032709:0:22690:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843857.032742:0:22690:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd132a2c300 going to sleep for 11 seconds 00000100:00100000:0.0:1788843857.032816:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134555264 00000100:00100000:0.0:1788843857.032823:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134555264 00000100:00100000:0.0:1788843857.032865:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788843857.032874:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0018b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ce589ba-8334-438e-8f48-13932fcba8b1+12:22690:x1875738134555264:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788843857.032993:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0018b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ce589ba-8334-438e-8f48-13932fcba8b1+12:22690:x1875738134555264:12345-0@lo:503:mount.lustre.0 Request processed in 120us (283us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843857.033000:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788843857.033216:0:22690:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd1074ffb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ce589ba-8334-438e-8f48-13932fcba8b1:22690:1875738134555264:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788843857.035246:0:22743:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f955880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0ce589ba-8334-438e-8f48-13932fcba8b1:22743:1875738134555392:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788843857.035336:0:22743:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843857.035390:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134555392 00000100:00100000:0.0:1788843857.035397:0:22704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134555392 00000100:00100000:0.0:1788843857.035460:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788843857.035471:0:22704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0018b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ce589ba-8334-438e-8f48-13932fcba8b1+12:22743:x1875738134555392:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788843857.035593:0:22704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0018b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ce589ba-8334-438e-8f48-13932fcba8b1+12:22743:x1875738134555392:12345-0@lo:502:llog_process_th.0 Request processed in 123us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843857.035600:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788843857.035662:0:22743:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd133117600 going to sleep for 11 seconds 00000100:00100000:0.0:1788843857.035688:0:22743:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f955880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0ce589ba-8334-438e-8f48-13932fcba8b1:22743:1875738134555392:0@lo:502:llog_process_th.0 00000020:01000004:0.0:1788843857.035758:0:22743:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1788843857.035776:0:22743:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff9bd13e9199b8) 00000020:00000080:0.0:1788843857.035797:0:22743:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type lwp with refcount 2 00000020:01000004:0.0:1788843857.035867:0:22743:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9bd127b94800 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1788843857.035872:0:22743:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9bd127b94800 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1788843857.035875:0:22743:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9bd127b94800 4 00010000:00080000:0.0:1788843857.044572:0:22743:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9bd008463000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.133@tcp at head 00010000:00010000:1.0:1788843857.050950:0:22743:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-4 is initialized 00000020:00000080:1.0:1788843857.051223:0:22743:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:1.0:1788843857.051274:0:22743:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788843857.051289:0:22743:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xa762dfcbd58d2a99 00000100:00080000:1.0:1788843857.051301:0:22743:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788843857.051308:0:22743:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9bd008463000 using connection 192.168.203.133@tcp/0@lo 00000100:00100000:1.0:1788843857.051350:0:22743:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bd10f961500 x1875738134555520/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788843857.051389:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f961500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3629:1875738134555520:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788843857.051488:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788843857.051545:0:22743:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788843857.052011:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134555520 00000100:00100000:0.0:1788843857.052020:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134555520 00000100:00100000:0.0:1788843857.052053:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788843857.052063:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f961f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3629:x1875738134555520:12345-0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788843857.052133:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f961f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3629:x1875738134555520:12345-0@lo:38:llog_process_th.0 Request processed in 70us (644us total) trans 0 rc -11/-11 00000100:00100000:0.0:1788843857.052158:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788843857.059083:0:3629:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788843857.059099:0:3629:0:(import.c:65:import_set_state_nolock()) ffff9bd008463000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788843857.059107:0:3629:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1788843857.059111:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f961500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3629:1875738134555520:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788843857.059293:0:22743:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f961500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0ce589ba-8334-438e-8f48-13932fcba8b1:22743:1875738134555648:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788843857.059375:0:22743:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843857.059418:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134555648 00000100:00100000:1.0:1788843857.059425:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134555648 00000100:00100000:1.0:1788843857.065331:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788843857.065348:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0018b2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ce589ba-8334-438e-8f48-13932fcba8b1+12:22743:x1875738134555648:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788843857.065541:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0018b2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ce589ba-8334-438e-8f48-13932fcba8b1+12:22743:x1875738134555648:12345-0@lo:502:llog_process_th.0 Request processed in 198us (6165us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843857.065550:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788843857.065606:0:22743:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd007893180 going to sleep for 11 seconds 00000100:00100000:1.0:1788843857.065633:0:22743:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f961500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0ce589ba-8334-438e-8f48-13932fcba8b1:22743:1875738134555648:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788843857.065707:0:22743:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f961500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0ce589ba-8334-438e-8f48-13932fcba8b1:22743:1875738134555776:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788843857.065751:0:22743:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843857.065782:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134555776 00000100:00100000:1.0:1788843857.065789:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134555776 00000100:00100000:1.0:1788843857.065818:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788843857.065825:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0018b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ce589ba-8334-438e-8f48-13932fcba8b1+12:22743:x1875738134555776:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788843857.065892:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0018b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ce589ba-8334-438e-8f48-13932fcba8b1+12:22743:x1875738134555776:12345-0@lo:502:llog_process_th.0 Request processed in 66us (141us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843857.065912:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788843857.065951:0:22743:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd007893180 going to sleep for 11 seconds 00000100:00100000:1.0:1788843857.065964:0:22743:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f961500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0ce589ba-8334-438e-8f48-13932fcba8b1:22743:1875738134555776:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1788843857.065983:0:22743:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:3.0:1788843857.066082:0:22690:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:3.0:1788843857.066108:0:22690:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.133@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788843857.066125:0:22690:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd118f71e00/0xa762dfcbd58d2a84 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d2a8b expref: -99 pid: 22690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843857.066135:0:22690:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.133@tcp lock: ffff9bd118f71e00/0xa762dfcbd58d2a84 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d2a8b expref: -99 pid: 22690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788843857.066202:0:22690:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788843857.066204:0:22690:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788843857.066206:0:22690:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788843857.066207:0:22690:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788843857.066208:0:22690:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788843857.066210:0:22690:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788843857.066211:0:22690:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788843857.066213:0:22690:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788843857.066220:0:22690:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788843857.066221:0:22690:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788843857.066224:0:22690:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:3.0:1788843857.066227:0:22690:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788843857.066228:0:22690:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788843857.066229:0:22690:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788843857.066230:0:22690:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788843857.066231:0:22690:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788843857.066232:0:22690:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788843857.066233:0:22690:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788843857.066234:0:22690:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788843857.066235:0:22690:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788843857.066235:0:22690:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788843857.066250:0:22690:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1788843857.066262:0:22690:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd1074ffb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ce589ba-8334-438e-8f48-13932fcba8b1:22690:1875738134555904:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788843857.066297:0:22690:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843857.066342:0:22690:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd132a2c540 going to sleep for 11 seconds 00000100:00100000:0.0:1788843857.066356:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134555904 00000100:00100000:0.0:1788843857.066363:0:22704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134555904 00000100:00100000:0.0:1788843857.066387:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788843857.066394:0:22704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0018b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ce589ba-8334-438e-8f48-13932fcba8b1+12:22690:x1875738134555904:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788843857.066419:0:22704:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1788843857.066432:0:22704:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1788843857.078335:0:22704:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788843857.078356:0:22704:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:2.0:1788843857.078510:0:22727:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788843857.078515:0:22727:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788843857.078537:0:22727:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9bd1153e6c00/0xa762dfcbd58d2aa0 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843857.078556:0:22727:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bd007946000/0xa762dfcbd58d2a6f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa762dfcbd58d2a68 expref: 12 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843857.078565:0:22727:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9bd1153e6c00/0xa762dfcbd58d2aa0 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843857.078614:0:22727:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bd007946000/0xa762dfcbd58d2a6f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa762dfcbd58d2a68 expref: 12 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843857.078629:0:22727:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9bd007946000/0xa762dfcbd58d2a6f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa762dfcbd58d2a68 expref: 12 pid: 22706 timeout: 735 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843857.078645:0:22727:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f8d3480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22727:1875738134556032:0@lo:104: 00000100:00100000:2.0:1788843857.078729:0:22727:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843857.078783:0:22727:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd111699000 going to sleep for 11 seconds 00000100:00100000:1.0:1788843857.079464:0:22694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134556032 00000100:00100000:1.0:1788843857.079474:0:22694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134556032 00000100:00100000:1.0:1788843857.079533:0:22694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788843857.079546:0:22694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f8d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0ce589ba-8334-438e-8f48-13932fcba8b1+3:22727:x1875738134556032:12345-0@lo:104: 00010000:00010000:1.0:1788843857.079562:0:22694:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.133@tcp lock: ffff9bd118f71600/0xa762dfcbd58d2a68 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa762dfcbd58d2a6f expref: -99 pid: 22690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843857.079632:0:22694:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788843857.079640:0:22694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f8d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0ce589ba-8334-438e-8f48-13932fcba8b1+3:22727:x1875738134556032:12345-0@lo:104: Request processed in 97us (911us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843857.079648:0:22694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788843857.079774:0:22704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0018b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ce589ba-8334-438e-8f48-13932fcba8b1+12:22690:x1875738134555904:12345-0@lo:253:mount.lustre.0 Request processed in 13378us (13474us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843857.079782:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788843857.079873:0:22690:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd1074ffb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ce589ba-8334-438e-8f48-13932fcba8b1:22690:1875738134555904:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788843857.079894:0:22690:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1788843857.079898:0:22690:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788843857.079911:0:22690:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788843857.079913:0:22690:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788843857.079914:0:22690:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788843857.079915:0:22690:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788843857.079917:0:22690:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788843857.079918:0:22690:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788843857.079920:0:22690:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788843857.079922:0:22690:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788843857.079923:0:22690:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788843857.079941:0:22690:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:2.0:1788843857.083856:0:22700:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788843857.083867:0:22700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.133@tcp lock: ffff9bd118f71600/0xa762dfcbd58d2a68 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa762dfcbd58d2a6f expref: -99 pid: 22690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843857.083880:0:22700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd118f71600 already unused, calling callback (ffffffffc12a7c20) 10000000:00010000:2.0:1788843857.083885:0:22700:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.133@tcp lock: ffff9bd118f71600/0xa762dfcbd58d2a68 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa762dfcbd58d2a6f expref: -99 pid: 22690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843857.083896:0:22700:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.133@tcp lock: ffff9bd118f71600/0xa762dfcbd58d2a68 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa762dfcbd58d2a6f expref: -99 pid: 22690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788843857.083918:0:22700:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.133@tcp lock: ffff9bd118f71600/0xa762dfcbd58d2a68 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa762dfcbd58d2a6f expref: -99 pid: 22690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788843857.083924:0:22700:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788843857.083985:0:22700:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.133@tcp lock: ffff9bd118f71600/0xa762dfcbd58d2a68 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa762dfcbd58d2a6f expref: -99 pid: 22690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843857.083993:0:22700:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788843857.084020:0:22700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.133@tcp lock: ffff9bd118f71600/0xa762dfcbd58d2a68 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa762dfcbd58d2a6f expref: -99 pid: 22690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843857.084035:0:22700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.133@tcp lock: ffff9bd118f71600/0xa762dfcbd58d2a68 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa762dfcbd58d2a6f expref: -99 pid: 22690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843857.084055:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788843857.084057:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788843857.084059:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788843857.084100:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f8d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0ce589ba-8334-438e-8f48-13932fcba8b1:3632:1875738134556160:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788843857.084202:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843857.084321:0:22727:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f8d3480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22727:1875738134556032:0@lo:104: 00010000:00010000:2.0:1788843857.084344:0:22727:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9bd1153e6c00/0xa762dfcbd58d2aa0 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843857.084504:0:22696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134556160 00000100:00100000:0.0:1788843857.084511:0:22696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134556160 00010000:00010000:0.0:1788843857.084539:0:22696:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bd007946000/0xa762dfcbd58d2a6f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa762dfcbd58d2a68 expref: 12 pid: 22706 timeout: 735 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843857.084580:0:22696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788843857.084591:0:22696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f8d1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0ce589ba-8334-438e-8f48-13932fcba8b1+12:3632:x1875738134556160:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788843857.084605:0:22696:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788843857.084611:0:22696:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bd007946000/0xa762dfcbd58d2a6f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa762dfcbd58d2a68 expref: 12 pid: 22706 timeout: 735 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843857.084622:0:22696:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bd007946000/0xa762dfcbd58d2a6f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa762dfcbd58d2a68 expref: 12 pid: 22706 timeout: 735 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843857.084638:0:22696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd007946000/0xa762dfcbd58d2a6f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa762dfcbd58d2a68 expref: 12 pid: 22706 timeout: 735 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843857.084652:0:22696:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9bd1153e6c00/0xa762dfcbd58d2aa0 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843857.084661:0:22696:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd1153e6c00/0xa762dfcbd58d2aa0 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788843857.084676:0:22696:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.006161668s 00010000:00010000:0.0:1788843857.084680:0:22696:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9bd1153e6c00/0xa762dfcbd58d2aa0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843857.084694:0:22696:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9bd1153e6c00/0xa762dfcbd58d2aa0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843857.084700:0:22696:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9bd1153e6c00/0xa762dfcbd58d2aa0 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843857.084705:0:22696:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9bd1153e6c00/0xa762dfcbd58d2aa0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843857.084710:0:22696:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd1153e6c00 already unused, calling callback (ffffffffc0cb1420) 00010000:00010000:0.0:1788843857.084714:0:22696:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9bd1153e6c00/0xa762dfcbd58d2aa0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843857.084722:0:22696:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9bd1153e6c00/0xa762dfcbd58d2aa0 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843857.084733:0:22696:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9bd1153e6c00/0xa762dfcbd58d2aa0 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843857.084742:0:22696:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788843857.084785:0:22696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f8d1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0ce589ba-8334-438e-8f48-13932fcba8b1+11:3632:x1875738134556160:12345-0@lo:103:ldlm_bl.0 Request processed in 196us (582us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843857.084794:0:22696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788843857.085101:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f8d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0ce589ba-8334-438e-8f48-13932fcba8b1:3632:1875738134556160:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788843857.085123:0:22727:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9bd1153e6c00/0xa762dfcbd58d2aa0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843857.085131:0:22727:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9bd1153e6c00/0xa762dfcbd58d2aa0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843857.085138:0:22727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd1153e6c00/0xa762dfcbd58d2aa0 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1788843857.099672:0:22690:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 4294967529 00000040:01000000:3.0:1788843857.106396:0:22690:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:0.0:1788843857.106522:0:22752:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 4294967529 00000020:00080000:0.0:1788843857.106527:0:22752:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967529 00000040:01000000:0.0:1788843857.106990:0:22753:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1788843857.107174:0:22690:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000040:00080000:0.0:1788843857.107523:0:22753:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788843857.109663:0:22753:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1788843857.109751:0:22753:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000100:00080000:1.0:1788843857.110128:0:22754:0:(client.c:1845:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff9bd10f961500 x1875738134556288/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788843857.110163:0:22754:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd13308b900 going to sleep for 0 seconds 00000040:01000000:3.0:1788843857.110933:0:22690:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1788843857.110975:0:22690:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1788843857.111919:0:22690:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1788843857.111931:0:22690:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1788843857.111984:0:22690:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788843857.112956:0:22690:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1788843857.113507:0:22690:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1788843857.113539:0:22690:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:3.0:1788843857.116824:0:22690:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0xa:0x7:0x0] first idx 1, last_idx 2 00080000:10000000:3.0:1788843857.118788:0:22690:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/32) registered 00000001:00000004:2.0:1788843857.121358:0:22690:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884901888 00000001:00080000:2.0:1788843857.133010:0:22690:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1788843857.133051:0:22690:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb2dcc1673988 00100000:10000000:2.0:1788843857.133061:0:22690:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:1.0:1788843857.133777:0:22690:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788843857.133794:0:22690:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.133@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788843857.133816:0:22690:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=46 00000080:00000004:1.0:1788843857.133844:0:22690:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:1.0:1788843857.134668:0:22690:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788843857.134866:0:22690:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788843857.498391:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788843857.514455:0:22708:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788843857.514464:0:22708:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9bd127b94800 from 11 10000000:01000000:0.0:1788843857.514470:0:22708:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788843857.514529:0:22708:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd10f7ae600/0xa762dfcbd58d2aa7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843857.514541:0:22708:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.133@tcp lock: ffff9bd10f7ae600/0xa762dfcbd58d2aa7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843857.514553:0:22708:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.133@tcp lock: ffff9bd10f7ae600/0xa762dfcbd58d2aa7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843857.514585:0:22708:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f955880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ce589ba-8334-438e-8f48-13932fcba8b1:22708:1875738134556416:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788843857.514666:0:22708:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843857.514726:0:22708:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd133117180 going to sleep for 11 seconds 00000100:00100000:1.0:1788843857.514739:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134556416 00000100:00100000:1.0:1788843857.514749:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134556416 00000100:00100000:1.0:1788843857.514858:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788843857.514868:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0018b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ce589ba-8334-438e-8f48-13932fcba8b1+11:22708:x1875738134556416:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788843857.514881:0:22705:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788843857.514895:0:22705:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd007946200/0xa762dfcbd58d2aae lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa762dfcbd58d2aa7 expref: -99 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843857.514927:0:22705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd007946200/0xa762dfcbd58d2aae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa762dfcbd58d2aa7 expref: 12 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843857.514937:0:22705:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd007946200/0xa762dfcbd58d2aae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa762dfcbd58d2aa7 expref: 12 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843857.514959:0:22705:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd007946200, rc 0) 00000100:00100000:1.0:1788843857.515011:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0018b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ce589ba-8334-438e-8f48-13932fcba8b1+12:22708:x1875738134556416:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 145us (345us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843857.515018:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788843857.515054:0:22708:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f955880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ce589ba-8334-438e-8f48-13932fcba8b1:22708:1875738134556416:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788843857.515071:0:22708:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.133@tcp lock: ffff9bd10f7ae600/0xa762dfcbd58d2aa7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d2aae expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843857.515080:0:22708:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.133@tcp lock: ffff9bd10f7ae600/0xa762dfcbd58d2aa7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa762dfcbd58d2aae expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843857.515133:0:22708:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f955880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ce589ba-8334-438e-8f48-13932fcba8b1:22708:1875738134556544:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788843857.515506:0:22708:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843857.515581:0:22708:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd133117180 going to sleep for 11 seconds 00000100:00100000:1.0:1788843857.515623:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134556544 00000100:00100000:1.0:1788843857.515629:0:22704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134556544 00000100:00100000:1.0:1788843857.515694:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788843857.515702:0:22704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0018b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ce589ba-8334-438e-8f48-13932fcba8b1+12:22708:x1875738134556544:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1788843857.515717:0:22704:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788843857.515732:0:22704:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788843857.515735:0:22704:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 11 00000100:00100000:1.0:1788843857.515820:0:22704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0018b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ce589ba-8334-438e-8f48-13932fcba8b1+12:22708:x1875738134556544:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 119us (314us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843857.515827:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788843857.515903:0:22708:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f955880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ce589ba-8334-438e-8f48-13932fcba8b1:22708:1875738134556544:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1788843857.516028:0:22708:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.133@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788843857.516036:0:22708:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd10f7ae600/0xa762dfcbd58d2aa7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d2aae expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843857.516047:0:22708:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.133@tcp lock: ffff9bd10f7ae600/0xa762dfcbd58d2aa7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d2aae expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788843858.076595:0:22748:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788843858.076605:0:22748:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788843858.086046:0:22748:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1788843858.086060:0:22748:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1788843858.141455:0:22754:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd13308b900 going to sleep for 0 seconds 00010000:00010000:0.0:1788843858.522344:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788843859.107371:0:22748:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788843859.107381:0:22748:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788843859.107525:0:22748:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 1 count 1 00000040:00080000:1.0:1788843859.107563:0:22748:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788843859.107732:0:22748:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 1 00000100:00100000:1.0:1788843859.166356:0:22754:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd13308b900 going to sleep for 0 seconds 00010000:00010000:2.0:1788843859.546893:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788843860.186281:0:22754:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd13308b900 going to sleep for 0 seconds 00010000:00010000:0.0:1788843860.572255:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788843861.216954:0:22754:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd13308b900 going to sleep for 0 seconds 00010000:00010000:2.0:1788843861.595552:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788843861.705867:0:22995:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg333-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:1.0:1788843862.236778:0:22754:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd13308b900 going to sleep for 0 seconds 00000100:00080000:2.0:1788843862.427183:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788843862.427191:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1788843862.427195:0:36:0:(import.c:65:import_set_state_nolock()) ffff9bd10f906000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788843862.427204:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 635 00000100:00080000:2.0:1788843862.427210:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1788843862.427217:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9bd10f906000 using connection 192.168.203.133@tcp/0@lo 00000100:00100000:2.0:1788843862.427243:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bd10f8d3480 x1875738134556800/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788843862.427480:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788843862.427485:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788843862.427488:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788843862.427491:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788843862.427494:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788843862.427497:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788843862.427506:0:36:0:(import.c:65:import_set_state_nolock()) ffff9bd008463000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788843862.427513:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9bd008463000 using connection 192.168.203.133@tcp/0@lo 00000100:00100000:2.0:1788843862.427529:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bd10f8d3100 x1875738134556928/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788843862.427563:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f8d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0ce589ba-8334-438e-8f48-13932fcba8b1:3633:1875738134556672:0@lo:400:kworker.0 00000100:00100000:2.0:1788843862.427634:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843862.428024:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f8d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3629:1875738134556800:0@lo:38:kworker.0 00000100:00100000:1.0:1788843862.428108:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843862.428176:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f8d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3629:1875738134556928:0@lo:38:kworker.0 00000100:00100000:1.0:1788843862.428205:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843862.428238:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134556672 00000100:00100000:2.0:1788843862.428247:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134556672 00000100:00100000:2.0:1788843862.428372:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788843862.428382:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0018b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ce589ba-8334-438e-8f48-13932fcba8b1+12:3633:x1875738134556672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788843862.428443:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0018b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ce589ba-8334-438e-8f48-13932fcba8b1+12:3633:x1875738134556672:12345-0@lo:400:kworker.0 Request processed in 62us (808us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843862.428451:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788843862.428498:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f8d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0ce589ba-8334-438e-8f48-13932fcba8b1:3633:1875738134556672:0@lo:400:kworker.0 00000100:00100000:2.0:1788843862.428680:0:22717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134556800 00000100:00100000:2.0:1788843862.428684:0:22717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134556800 00000100:00100000:1.0:1788843862.428965:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788843862.428972:0:22716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f960a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3629:x1875738134556800:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788843862.428991:0:22716:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788843862.429036:0:22716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f960a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3629:x1875738134556800:12345-0@lo:38:kworker.0 Request processed in 62us (926us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788843862.429043:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:1.0:1788843862.429083:0:3629:0:(import.c:65:import_set_state_nolock()) ffff9bd10f906000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788843862.429088:0:3629:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788843862.429092:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f8d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3629:1875738134556800:0@lo:38:kworker.0 00000100:00100000:2.0:1788843862.429241:0:22713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134556928 00000100:00100000:2.0:1788843862.429246:0:22713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134556928 00000100:00100000:2.0:1788843862.429446:0:22713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788843862.429451:0:22713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f960380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3629:x1875738134556928:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1788843862.429470:0:22713:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 640 last 0 00000020:00000080:2.0:1788843862.429510:0:22713:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xa762dfcbd58d2ab5 00000004:00100000:2.0:1788843862.429526:0:22713:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788843862.429648:0:22713:0:(import.c:65:import_set_state_nolock()) ffff9bd127b89000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788843862.429695:0:22713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f960380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3629:x1875738134556928:12345-0@lo:38:kworker.0 Request processed in 242us (1488us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843862.429714:0:22713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788843862.430632:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9bd10f8d3100 x1875738134556928/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788843872 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788843862.430650:0:3629:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 3 00000100:00080000:1.0:1788843862.430659:0:3629:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1788843862.430664:0:3629:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788843862.430668:0:3629:0:(import.c:65:import_set_state_nolock()) ffff9bd008463000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788843862.430674:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f8d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3629:1875738134556928:0@lo:38:kworker.0 00010000:00010000:2.0:1788843862.620294:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788843862.785722:0:23048:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788843862.785970:0:23048:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1788843863.258652:0:22754:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd13308b900 going to sleep for 0 seconds 00010000:00010000:2.0:1788843863.642653:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788843863.921217:0:23099:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788843863.921511:0:23099:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1788843864.282260:0:22754:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd13308b900 going to sleep for 0 seconds 00010000:00010000:2.0:1788843864.666396:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788843865.315719:0:22754:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd13308b900 going to sleep for 0 seconds 00010000:00010000:2.0:1788843865.690330:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788843866.333732:0:22754:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd13308b900 going to sleep for 0 seconds 00000100:00100000:1.0:1788843866.522247:0:3629:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788843856/real 1788843856] req@ffff9bd10f957480 x1875738134553728/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788843866 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788843866.522333:0:3629:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9bd10f957480 x1875738134553728/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788843866 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788843866.522358:0:3629:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788843856/real 1788843856] req@ffff9bd1074fca80 x1875738134553472/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788843866 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788843866.522382:0:3629:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9bd1074fca80 x1875738134553472/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788843866 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788843866.522404:0:3629:0:(import.c:65:import_set_state_nolock()) ffff9bd0059c6000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788843866.522440:0:3629:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788843866.522444:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f957480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3629:1875738134553728:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1788843866.522450:0:3629:0:(import.c:65:import_set_state_nolock()) ffff9bd10f7b9800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788843866.522561:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788843866.522569:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1788843866.522573:0:36:0:(import.c:65:import_set_state_nolock()) ffff9bd10f906000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788843866.522581:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 640 00000100:00080000:0.0:1788843866.522588:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1788843866.522598:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9bd10f906000 using connection 192.168.203.133@tcp/0@lo 00000100:00100000:0.0:1788843866.522628:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bd10f957b80 x1875738134557184/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788843866.522641:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788843866.522644:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1788843866.522646:0:36:0:(import.c:65:import_set_state_nolock()) ffff9bd10f7b9800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788843866.522649:0:36:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 635 00000100:00080000:0.0:1788843866.522652:0:36:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788843866.522656:0:36:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9bd10f7b9800 using connection 192.168.203.133@tcp/0@lo 00000100:00100000:0.0:1788843866.522667:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bd10f955c00 x1875738134557312/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788843866.522675:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788843866.522678:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788843866.522680:0:36:0:(import.c:65:import_set_state_nolock()) ffff9bd0059c6000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788843866.522684:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 635 00000100:00080000:0.0:1788843866.522687:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788843866.522691:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9bd0059c6000 using connection 192.168.203.133@tcp/0@lo 00000100:00100000:0.0:1788843866.522715:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bd10f956d80 x1875738134557440/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788843866.525283:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f954000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0ce589ba-8334-438e-8f48-13932fcba8b1:3630:1875738134557056:0@lo:400:kworker.0 00000100:00100000:2.0:1788843866.525367:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843866.525465:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788843866.525474:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f954700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3630:1875738134557568:0@lo:400:kworker.0 00000100:00100000:2.0:1788843866.525512:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843866.525723:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134557568 00000100:00100000:0.0:1788843866.525739:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134557568 00000100:00100000:0.0:1788843866.525819:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788843866.525831:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f8d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3630:x1875738134557568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788843866.525942:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f8d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3630:x1875738134557568:12345-0@lo:400:kworker.0 Request processed in 113us (429us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843866.525953:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1788843866.529721:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9bd10f954700 x1875738134557568/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843882 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788843866.529742:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f954700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3630:1875738134557568:0@lo:400:kworker.0 00000100:00080000:1.0:1788843866.529939:0:3629:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788843866.529946:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd1074fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3629:1875738134553472:0@lo:8:llog_process_th.0 00000100:00100000:1.0:1788843866.530035:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134557056 00000100:00100000:1.0:1788843866.530043:0:22704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134557056 00000100:00100000:1.0:1788843866.530101:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788843866.530112:0:22704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0018b3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ce589ba-8334-438e-8f48-13932fcba8b1+12:3630:x1875738134557056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843866.530243:0:22704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0018b3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ce589ba-8334-438e-8f48-13932fcba8b1+12:3630:x1875738134557056:12345-0@lo:400:kworker.0 Request processed in 132us (4875us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843866.530251:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788843866.530301:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f957b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3629:1875738134557184:0@lo:38:kworker.0 00000100:00100000:1.0:1788843866.530343:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843866.530382:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134557184 00000100:00100000:1.0:1788843866.530386:0:22716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134557184 00000100:00100000:1.0:1788843866.530409:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788843866.530415:0:22716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f960700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3629:x1875738134557184:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788843866.530449:0:22716:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788843866.530485:0:22716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f960700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3629:x1875738134557184:12345-0@lo:38:kworker.0 Request processed in 70us (142us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788843866.530492:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:1.0:1788843866.530521:0:3629:0:(import.c:65:import_set_state_nolock()) ffff9bd10f906000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788843866.530526:0:3629:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788843866.530530:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f957b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3629:1875738134557184:0@lo:38:kworker.0 00000100:00100000:1.0:1788843866.530537:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f955c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3629:1875738134557312:0@lo:8:kworker.0 00000400:00000100:1.0:1788843866.530575:0:3629:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875738134557312 offset 0 length 520: 4 00000100:00100000:1.0:1788843866.530599:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f956d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3629:1875738134557440:0@lo:8:kworker.0 00000400:00000100:1.0:1788843866.530618:0:3629:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875738134557440 offset 0 length 520: 4 00000100:00100000:2.0:1788843866.534916:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f954000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0ce589ba-8334-438e-8f48-13932fcba8b1:3630:1875738134557056:0@lo:400:kworker.0 00010000:00010000:1.0:1788843866.717072:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788843867.364992:0:22754:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd13308b900 going to sleep for 0 seconds 00010000:00010000:2.0:1788843867.748218:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788843868.378274:0:22754:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd13308b900 going to sleep for 0 seconds 00010000:00010000:1.0:1788843868.762312:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788843869.338751:0:22748:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788843869.402315:0:22754:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd13308b900 going to sleep for 0 seconds 00010000:00010000:2.0:1788843869.787952:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788843870.427268:0:22754:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd13308b900 going to sleep for 0 seconds 00010000:00010000:1.0:1788843870.813244:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788843871.253045:0:23445:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788843871.253049:0:23445:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:3.0:1788843871.253056:0:23445:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:3.0:1788843871.253375:0:23445:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9bd007394000 00000020:01000004:3.0:1788843871.253393:0:23445:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200001, mountfl=0 00000020:01000004:3.0:1788843871.253405:0:23445:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1788843871.253430:0:23445:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (ffff9bd1330f8000) 00000020:00000080:3.0:1788843871.253449:0:23445:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1788843871.330191:0:23445:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:1.0:1788843871.330764:0:23445:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xd:0x0] (16/1) registered 00100000:10000000:1.0:1788843871.333130:0:23445:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:1.0:1788843871.333772:0:23445:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:1.0:1788843871.333978:0:23445:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:1.0:1788843871.334504:0:23445:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:1.0:1788843871.335754:0:23445:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:1.0:1788843871.336162:0:23445:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:1.0:1788843871.336436:0:23445:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00100000:10000000:1.0:1788843871.336623:0:23445:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00100000:10000000:1.0:1788843871.336900:0:23445:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:1.0:1788843871.337355:0:23445:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:1.0:1788843871.337590:0:23445:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00100000:10000000:1.0:1788843871.337837:0:23445:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:1.0:1788843871.340535:0:23445:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:1.0:1788843871.340812:0:23445:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:1.0:1788843871.341934:0:23445:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:1.0:1788843871.342434:0:23445:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:1.0:1788843871.342665:0:23445:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:1.0:1788843871.342959:0:23445:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:1.0:1788843871.343305:0:23445:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:1.0:1788843871.343554:0:23445:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x11:0x0] (16/1) registered 00100000:10000000:1.0:1788843871.343935:0:23445:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x21:0x0] (24/16) registered 00100000:10000000:1.0:1788843871.345228:0:23445:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:1.0:1788843871.345632:0:23445:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:1.0:1788843871.346134:0:23445:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xf:0x0] (16/1) registered 00100000:10000000:1.0:1788843871.346536:0:23445:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x22:0x0] (24/16) registered 00100000:10000000:1.0:1788843871.346832:0:23445:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:1.0:1788843871.347162:0:23445:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:1.0:1788843871.347543:0:23445:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:1.0:1788843871.347814:0:23445:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x20:0x0] (24/16) registered 00100000:10000000:1.0:1788843871.348125:0:23445:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:2.0:1788843871.349171:0:23445:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:2.0:1788843871.349485:0:23445:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:2.0:1788843871.349692:0:23445:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x12:0x0] (16/1) registered 00100000:10000000:2.0:1788843871.349888:0:23445:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:2.0:1788843871.350076:0:23445:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:2.0:1788843871.350348:0:23445:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:2.0:1788843871.350540:0:23445:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x10:0x0] (16/1) registered 00100000:10000000:2.0:1788843871.352780:0:23445:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:2.0:1788843871.353476:0:23445:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xe:0x0] (16/1) registered 00100000:10000000:2.0:1788843871.353733:0:23445:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x23:0x0] (24/16) registered 00100000:10000000:2.0:1788843871.353924:0:23445:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1f:0x0] (24/16) registered 00100000:10000000:2.0:1788843871.354447:0:23445:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:2.0:1788843871.354718:0:23445:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x24:0x0] (24/16) registered 00100000:10000000:2.0:1788843871.354912:0:23445:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2e:0x0] (24/16) registered 00080000:01000000:2.0:1788843871.357791:0:23445:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1788843871.358053:0:23445:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:2.0:1788843871.358066:0:23445:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788843871.358078:0:23445:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xa762dfcbd58d2ac3 00000020:01000004:2.0:1788843871.358088:0:23445:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:2.0:1788843871.358108:0:23445:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.133@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788843871.358112:0:23445:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.133@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788843871.358119:0:23445:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:2.0:1788843871.358172:0:23445:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:2.0:1788843871.358176:0:23445:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.133@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:3.0:1788843871.366944:0:23445:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.133@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788843871.366989:0:23445:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.203.133@tcp, index=0001, flags=0x20001 00000020:01000004:3.0:1788843871.366994:0:23445:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788843871.366996:0:23445:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1788843871.366998:0:23445:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788843871.366998:0:23445:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788843871.366999:0:23445:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788843871.367001:0:23445:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788843871.367002:0:23445:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788843871.367004:0:23445:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788843871.367005:0:23445:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788843871.367777:0:23445:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020001 00000020:01000004:3.0:1788843871.367781:0:23445:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788843871.367783:0:23445:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1788843871.367784:0:23445:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788843871.367785:0:23445:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788843871.367787:0:23445:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788843871.367788:0:23445:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788843871.367789:0:23445:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788843871.367790:0:23445:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788843871.367791:0:23445:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788843871.367824:0:23445:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:3.0:1788843871.367850:0:23445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd1074fc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ce589ba-8334-438e-8f48-13932fcba8b1:23445:1875738134557696:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788843871.367943:0:23445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843871.368061:0:23445:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd110dec180 going to sleep for 11 seconds 00000100:00100000:1.0:1788843871.368534:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134557696 00000100:00100000:1.0:1788843871.368542:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134557696 00000100:00100000:1.0:1788843871.368654:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788843871.368665:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0018b2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ce589ba-8334-438e-8f48-13932fcba8b1+12:23445:x1875738134557696:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788843871.368785:0:22705:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1788843871.368794:0:22705:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0001 is running on 0@lo 20000000:01000000:1.0:1788843871.368801:0:22705:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:1.0:1788843871.369246:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0018b2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ce589ba-8334-438e-8f48-13932fcba8b1+12:23445:x1875738134557696:12345-0@lo:253:mount.lustre.0 Request processed in 581us (1300us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843871.369254:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788843871.369502:0:23445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd1074fc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ce589ba-8334-438e-8f48-13932fcba8b1:23445:1875738134557696:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788843871.369514:0:23445:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:3.0:1788843871.369517:0:23445:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788843871.369519:0:23445:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1788843871.369526:0:23445:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788843871.369528:0:23445:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788843871.369529:0:23445:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788843871.369530:0:23445:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788843871.369532:0:23445:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788843871.369534:0:23445:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788843871.369535:0:23445:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788843871.369555:0:23445:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9bd007394000 from lustre-MDT0001 10000000:01000000:3.0:1788843871.369581:0:23445:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:3.0:1788843871.369583:0:23445:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:3.0:1788843871.369590:0:23445:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9bd005b60000 local copy 00010000:00010000:3.0:1788843871.369601:0:23445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd007946400/0xa762dfcbd58d29b9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d29c0 expref: -99 pid: 22690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843871.369754:0:23445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd1074fc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ce589ba-8334-438e-8f48-13932fcba8b1:23445:1875738134557824:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788843871.369787:0:23445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843871.369853:0:23445:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd110dec840 going to sleep for 11 seconds 00000100:00100000:2.0:1788843871.369884:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134557824 00000100:00100000:2.0:1788843871.369889:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134557824 00000100:00100000:2.0:1788843871.369955:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788843871.369963:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0018b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ce589ba-8334-438e-8f48-13932fcba8b1+12:23445:x1875738134557824:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788843871.370035:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0018b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ce589ba-8334-438e-8f48-13932fcba8b1+12:23445:x1875738134557824:12345-0@lo:501:mount.lustre.0 Request processed in 73us (247us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788843871.370042:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788843871.370090:0:23445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd1074fc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ce589ba-8334-438e-8f48-13932fcba8b1:23445:1875738134557824:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1788843871.370102:0:23445:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.133@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1788843871.370116:0:23445:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.133@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1788843871.370122:0:23445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd007946400/0xa762dfcbd58d29b9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d29c0 expref: -99 pid: 22690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843871.370132:0:23445:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.133@tcp lock: ffff9bd007946400/0xa762dfcbd58d29b9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d29c0 expref: -99 pid: 22690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788843871.370186:0:23445:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9bd007394000 10000000:01000000:3.0:1788843871.370191:0:23445:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788843871.370206:0:23445:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9bd005b60000 10000000:01000000:3.0:1788843871.370209:0:23445:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:3.0:1788843871.370212:0:23445:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9bd005b60000 from 1 10000000:01000000:3.0:1788843871.370220:0:23445:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1788843871.370243:0:23445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd118f70200/0xa762dfcbd58d2aca lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843871.370252:0:23445:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.133@tcp lock: ffff9bd118f70200/0xa762dfcbd58d2aca lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843871.370261:0:23445:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.133@tcp lock: ffff9bd118f70200/0xa762dfcbd58d2aca lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843871.370272:0:23445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd1074fc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ce589ba-8334-438e-8f48-13932fcba8b1:23445:1875738134557952:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788843871.370293:0:23445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843871.372549:0:23445:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd110dec840 going to sleep for 11 seconds 00000100:00100000:1.0:1788843871.372877:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134557952 00000100:00100000:1.0:1788843871.372887:0:22704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134557952 00000100:00100000:1.0:1788843871.372940:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788843871.372949:0:22704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0018b3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ce589ba-8334-438e-8f48-13932fcba8b1+12:23445:x1875738134557952:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788843871.372965:0:22704:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788843871.372985:0:22704:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd007946000/0xa762dfcbd58d2ad1 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa762dfcbd58d2aca expref: -99 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843871.373025:0:22704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd007946000/0xa762dfcbd58d2ad1 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa762dfcbd58d2aca expref: 13 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843871.373036:0:22704:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd007946000/0xa762dfcbd58d2ad1 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa762dfcbd58d2aca expref: 13 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843871.373046:0:22704:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd007946000, rc 0) 00000100:00100000:1.0:1788843871.373106:0:22704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0018b3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ce589ba-8334-438e-8f48-13932fcba8b1+13:23445:x1875738134557952:12345-0@lo:101:mount.lustre.0 Request processed in 158us (2810us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843871.373112:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788843871.373468:0:23445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd1074fc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ce589ba-8334-438e-8f48-13932fcba8b1:23445:1875738134557952:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788843871.373485:0:23445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.133@tcp lock: ffff9bd118f70200/0xa762dfcbd58d2aca lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d2ad1 expref: -99 pid: 23445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843871.373494:0:23445:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.133@tcp lock: ffff9bd118f70200/0xa762dfcbd58d2aca lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa762dfcbd58d2ad1 expref: -99 pid: 23445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788843871.373514:0:23445:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.133@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1788843871.373525:0:23445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd118f70200/0xa762dfcbd58d2aca lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d2ad1 expref: -99 pid: 23445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843871.373533:0:23445:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.133@tcp lock: ffff9bd118f70200/0xa762dfcbd58d2aca lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d2ad1 expref: -99 pid: 23445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788843871.373543:0:23445:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9bd007394000 10000000:01000000:3.0:1788843871.373547:0:23445:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1788843871.373566:0:23445:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9bd007394000 from 1 10000000:01000000:3.0:1788843871.373568:0:23445:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1788843871.373591:0:23445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd118f71600/0xa762dfcbd58d2ad8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843871.373598:0:23445:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.133@tcp lock: ffff9bd118f71600/0xa762dfcbd58d2ad8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843871.373607:0:23445:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.133@tcp lock: ffff9bd118f71600/0xa762dfcbd58d2ad8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843871.373624:0:23445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd1074fc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ce589ba-8334-438e-8f48-13932fcba8b1:23445:1875738134558080:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788843871.373656:0:23445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843871.373677:0:23445:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd110dec840 going to sleep for 11 seconds 00000100:00100000:1.0:1788843871.373861:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134558080 00000100:00100000:1.0:1788843871.373866:0:22704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134558080 00000100:00100000:1.0:1788843871.373888:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788843871.373893:0:22704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0018b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ce589ba-8334-438e-8f48-13932fcba8b1+13:23445:x1875738134558080:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788843871.373901:0:22704:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788843871.373913:0:22704:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd007947e00/0xa762dfcbd58d2adf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa762dfcbd58d2ad8 expref: -99 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843871.373933:0:22704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd007947e00/0xa762dfcbd58d2adf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa762dfcbd58d2ad8 expref: 14 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843871.373942:0:22704:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd007947e00/0xa762dfcbd58d2adf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa762dfcbd58d2ad8 expref: 14 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843871.373949:0:22704:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd007947e00, rc 0) 00000100:00100000:1.0:1788843871.373985:0:22704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0018b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ce589ba-8334-438e-8f48-13932fcba8b1+14:23445:x1875738134558080:12345-0@lo:101:mount.lustre.0 Request processed in 91us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843871.373991:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788843871.374096:0:23445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd1074fc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ce589ba-8334-438e-8f48-13932fcba8b1:23445:1875738134558080:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788843871.374106:0:23445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.133@tcp lock: ffff9bd118f71600/0xa762dfcbd58d2ad8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d2adf expref: -99 pid: 23445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843871.374114:0:23445:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.133@tcp lock: ffff9bd118f71600/0xa762dfcbd58d2ad8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa762dfcbd58d2adf expref: -99 pid: 23445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788843871.374124:0:23445:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.133@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1788843871.374137:0:23445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd118f71600/0xa762dfcbd58d2ad8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d2adf expref: -99 pid: 23445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843871.374162:0:23445:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.133@tcp lock: ffff9bd118f71600/0xa762dfcbd58d2ad8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d2adf expref: -99 pid: 23445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788843871.374168:0:23445:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:3.0:1788843871.374175:0:23445:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788843871.374180:0:23445:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9bd007394000 10000000:01000000:3.0:1788843871.374183:0:23445:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1788843871.374186:0:23445:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:3.0:1788843871.374188:0:23445:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:3.0:1788843871.374213:0:23445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd118f71c00/0xa762dfcbd58d2ae6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843871.374221:0:23445:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.133@tcp lock: ffff9bd118f71c00/0xa762dfcbd58d2ae6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843871.374228:0:23445:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.133@tcp lock: ffff9bd118f71c00/0xa762dfcbd58d2ae6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843871.374239:0:23445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd1074fc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ce589ba-8334-438e-8f48-13932fcba8b1:23445:1875738134558208:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788843871.374262:0:23445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843871.374276:0:23445:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd110dec840 going to sleep for 11 seconds 00000100:00100000:1.0:1788843871.374509:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134558208 00000100:00100000:1.0:1788843871.374513:0:22704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134558208 00000100:00100000:1.0:1788843871.374530:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788843871.374535:0:22704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0018b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ce589ba-8334-438e-8f48-13932fcba8b1+14:23445:x1875738134558208:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788843871.374542:0:22704:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788843871.374550:0:22704:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd007947600/0xa762dfcbd58d2aed lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xa762dfcbd58d2ae6 expref: -99 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843871.374563:0:22704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd007947600/0xa762dfcbd58d2aed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa762dfcbd58d2ae6 expref: 15 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843871.374571:0:22704:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd007947600/0xa762dfcbd58d2aed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa762dfcbd58d2ae6 expref: 15 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843871.374578:0:22704:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd007947600, rc 0) 00000100:00100000:1.0:1788843871.374610:0:22704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0018b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ce589ba-8334-438e-8f48-13932fcba8b1+15:23445:x1875738134558208:12345-0@lo:101:mount.lustre.0 Request processed in 74us (348us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843871.374616:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788843871.374684:0:23445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd1074fc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ce589ba-8334-438e-8f48-13932fcba8b1:23445:1875738134558208:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788843871.374703:0:23445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.133@tcp lock: ffff9bd118f71c00/0xa762dfcbd58d2ae6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d2aed expref: -99 pid: 23445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843871.374712:0:23445:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.133@tcp lock: ffff9bd118f71c00/0xa762dfcbd58d2ae6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xa762dfcbd58d2aed expref: -99 pid: 23445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788843871.376451:0:23445:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 46 count 46 00000040:00080000:3.0:1788843871.379544:0:23445:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788843871.385989:0:23445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:3.0:1788843871.387993:0:23445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 136 off8552 00000040:00080000:3.0:1788843871.388124:0:23445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 176 off8728 00000040:00080000:3.0:1788843871.388265:0:23445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8952 00000040:00080000:3.0:1788843871.388300:0:23445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 224 off9176 00000040:00080000:3.0:1788843871.388388:0:23445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 120 off9296 00000040:00080000:3.0:1788843871.388403:0:23445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 112 off9408 00000040:00080000:3.0:1788843871.388416:0:23445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 160 off9568 00000040:00080000:3.0:1788843871.388429:0:23445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9792 00000040:00080000:3.0:1788843871.388442:0:23445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10016 00000040:00080000:3.0:1788843871.388457:0:23445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 88 off10104 00000040:00080000:3.0:1788843871.388472:0:23445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 144 off10248 00000040:00080000:3.0:1788843871.388483:0:23445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].13, 152 off10400 00000040:00080000:3.0:1788843871.388496:0:23445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].14, 168 off10568 00000040:00080000:3.0:1788843871.388511:0:23445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].15, 224 off10792 00000040:00080000:3.0:1788843871.388526:0:23445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].16, 224 off11016 00000040:00080000:3.0:1788843871.388545:0:23445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].17, 80 off11096 00000040:00080000:3.0:1788843871.388562:0:23445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].18, 224 off11320 00000040:00080000:3.0:1788843871.388577:0:23445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].19, 224 off11544 00000040:00080000:3.0:1788843871.388591:0:23445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].20, 160 off11704 00000040:00080000:3.0:1788843871.388606:0:23445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].21, 224 off11928 00000040:00080000:3.0:1788843871.388620:0:23445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].22, 224 off12152 00000040:00080000:3.0:1788843871.388637:0:23445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].23, 80 off12232 00000040:00080000:3.0:1788843871.388654:0:23445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].24, 224 off12456 00000040:00080000:3.0:1788843871.388669:0:23445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].25, 224 off12680 00000040:00080000:3.0:1788843871.388683:0:23445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].26, 88 off12768 00000040:00080000:3.0:1788843871.388699:0:23445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].27, 144 off12912 00000040:00080000:3.0:1788843871.388716:0:23445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].28, 152 off13064 00000040:00080000:3.0:1788843871.388733:0:23445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].29, 136 off13200 00000040:00080000:3.0:1788843871.388748:0:23445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].30, 224 off13424 00000040:00080000:3.0:1788843871.388765:0:23445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].31, 224 off13648 00000040:00080000:3.0:1788843871.388781:0:23445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].32, 80 off13728 00000040:00080000:3.0:1788843871.388796:0:23445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].33, 224 off13952 00000040:00080000:3.0:1788843871.388813:0:23445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].34, 224 off14176 00000040:00080000:3.0:1788843871.388829:0:23445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].35, 88 off14264 00000040:00080000:3.0:1788843871.388845:0:23445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].36, 144 off14408 00000040:00080000:3.0:1788843871.388857:0:23445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].37, 152 off14560 00000040:00080000:3.0:1788843871.388884:0:23445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].38, 136 off14696 00000040:00080000:3.0:1788843871.388899:0:23445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].39, 224 off14920 00000040:00080000:3.0:1788843871.388912:0:23445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].40, 224 off15144 00000040:00080000:3.0:1788843871.388925:0:23445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].41, 80 off15224 00000040:00080000:3.0:1788843871.388939:0:23445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].42, 224 off15448 00000040:00080000:3.0:1788843871.388953:0:23445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].43, 224 off15672 00000040:00080000:3.0:1788843871.388965:0:23445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].44, 120 off15792 00000040:00080000:3.0:1788843871.388995:0:23445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].45, 224 off16016 00000040:00080000:3.0:1788843871.389001:0:23445:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 45 count 46 00000100:00100000:3.0:1788843871.389473:0:23445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd1074fc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ce589ba-8334-438e-8f48-13932fcba8b1:23445:1875738134558336:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788843871.389544:0:23445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843871.389648:0:23445:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd110decf00 going to sleep for 11 seconds 00000100:00100000:1.0:1788843871.389697:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134558336 00000100:00100000:1.0:1788843871.389705:0:22704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134558336 00000100:00100000:1.0:1788843871.389809:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788843871.389821:0:22704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0018b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ce589ba-8334-438e-8f48-13932fcba8b1+15:23445:x1875738134558336:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788843871.389987:0:22704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0018b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ce589ba-8334-438e-8f48-13932fcba8b1+15:23445:x1875738134558336:12345-0@lo:501:mount.lustre.0 Request processed in 168us (443us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843871.389996:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788843871.390087:0:23445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd1074fc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ce589ba-8334-438e-8f48-13932fcba8b1:23445:1875738134558336:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788843871.390123:0:23445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd1074fc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ce589ba-8334-438e-8f48-13932fcba8b1:23445:1875738134558464:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788843871.390226:0:23445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843871.392472:0:23445:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd110decf00 going to sleep for 11 seconds 00000100:00100000:2.0:1788843871.392647:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134558464 00000100:00100000:2.0:1788843871.392670:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134558464 00000100:00100000:2.0:1788843871.392718:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788843871.392727:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd00702f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ce589ba-8334-438e-8f48-13932fcba8b1+15:23445:x1875738134558464:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788843871.393546:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd00702f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ce589ba-8334-438e-8f48-13932fcba8b1+15:23445:x1875738134558464:12345-0@lo:503:mount.lustre.0 Request processed in 817us (3316us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843871.393556:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788843871.393729:0:23445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd1074fc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ce589ba-8334-438e-8f48-13932fcba8b1:23445:1875738134558464:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788843871.395904:0:23445:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788843871.396299:0:23445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd1074fc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ce589ba-8334-438e-8f48-13932fcba8b1:23445:1875738134558592:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788843871.396497:0:23445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843871.396536:0:23445:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd110dec840 going to sleep for 11 seconds 00000100:00100000:1.0:1788843871.396703:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134558592 00000100:00100000:1.0:1788843871.396712:0:22704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134558592 00000100:00100000:1.0:1788843871.396760:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788843871.396769:0:22704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd00702c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ce589ba-8334-438e-8f48-13932fcba8b1+15:23445:x1875738134558592:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788843871.398892:0:22704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd00702c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ce589ba-8334-438e-8f48-13932fcba8b1+15:23445:x1875738134558592:12345-0@lo:502:mount.lustre.0 Request processed in 2115us (2387us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843871.398906:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788843871.399233:0:23445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd1074fc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ce589ba-8334-438e-8f48-13932fcba8b1:23445:1875738134558592:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788843871.399499:0:23445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:3.0:1788843871.399533:0:23445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 136 off8552 00000040:00080000:3.0:1788843871.399549:0:23445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 176 off8728 00000040:00080000:3.0:1788843871.399565:0:23445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8952 00000040:00080000:3.0:1788843871.399579:0:23445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 224 off9176 00000040:00080000:3.0:1788843871.399605:0:23445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 120 off9296 00000040:00080000:3.0:1788843871.399621:0:23445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 112 off9408 00000040:00080000:3.0:1788843871.399636:0:23445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 160 off9568 00000040:00080000:3.0:1788843871.399652:0:23445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9792 00000040:00080000:3.0:1788843871.399665:0:23445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10016 00000040:00080000:3.0:1788843871.399679:0:23445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 88 off10104 00000040:00080000:3.0:1788843871.399693:0:23445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 144 off10248 00000040:00080000:3.0:1788843871.399708:0:23445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].13, 152 off10400 00000040:00080000:3.0:1788843871.399727:0:23445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].14, 168 off10568 00000040:00080000:3.0:1788843871.399744:0:23445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].15, 224 off10792 00000040:00080000:3.0:1788843871.399758:0:23445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].16, 224 off11016 00000040:00080000:3.0:1788843871.399771:0:23445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].17, 80 off11096 00000040:00080000:3.0:1788843871.399785:0:23445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].18, 224 off11320 00000040:00080000:3.0:1788843871.399799:0:23445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].19, 224 off11544 00000040:00080000:3.0:1788843871.399812:0:23445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].20, 160 off11704 00000040:00080000:3.0:1788843871.399825:0:23445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].21, 224 off11928 00000040:00080000:3.0:1788843871.399839:0:23445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].22, 224 off12152 00000040:00080000:3.0:1788843871.399852:0:23445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].23, 80 off12232 00000040:00080000:3.0:1788843871.399866:0:23445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].24, 224 off12456 00000040:00080000:3.0:1788843871.399880:0:23445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].25, 224 off12680 00000040:00080000:3.0:1788843871.399894:0:23445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].26, 88 off12768 00000040:00080000:3.0:1788843871.399906:0:23445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].27, 144 off12912 00000040:00080000:3.0:1788843871.399918:0:23445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].28, 152 off13064 00000040:00080000:3.0:1788843871.399931:0:23445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].29, 136 off13200 00000040:00080000:3.0:1788843871.399945:0:23445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].30, 224 off13424 00000040:00080000:3.0:1788843871.399961:0:23445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].31, 224 off13648 00000040:00080000:3.0:1788843871.399976:0:23445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].32, 80 off13728 00000040:00080000:3.0:1788843871.399990:0:23445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].33, 224 off13952 00000040:00080000:3.0:1788843871.400003:0:23445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].34, 224 off14176 00000040:00080000:3.0:1788843871.400039:0:23445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].35, 88 off14264 00000040:00080000:3.0:1788843871.400054:0:23445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].36, 144 off14408 00000040:00080000:3.0:1788843871.400068:0:23445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].37, 152 off14560 00000040:00080000:3.0:1788843871.400082:0:23445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].38, 136 off14696 00000040:00080000:3.0:1788843871.400109:0:23445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].39, 224 off14920 00000040:00080000:3.0:1788843871.400123:0:23445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].40, 224 off15144 00000040:00080000:3.0:1788843871.400135:0:23445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].41, 80 off15224 00000040:00080000:3.0:1788843871.400181:0:23445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].42, 224 off15448 00000040:00080000:3.0:1788843871.400197:0:23445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].43, 224 off15672 00000040:00080000:3.0:1788843871.400210:0:23445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].44, 120 off15792 00000100:00100000:3.0:1788843871.400252:0:23445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd1074fc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ce589ba-8334-438e-8f48-13932fcba8b1:23445:1875738134558720:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788843871.400313:0:23445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843871.400358:0:23445:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd110dec840 going to sleep for 11 seconds 00000100:00100000:2.0:1788843871.400743:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134558720 00000100:00100000:2.0:1788843871.400751:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134558720 00000100:00100000:2.0:1788843871.400793:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788843871.400804:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd00702f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ce589ba-8334-438e-8f48-13932fcba8b1+15:23445:x1875738134558720:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788843871.400935:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd00702f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ce589ba-8334-438e-8f48-13932fcba8b1+15:23445:x1875738134558720:12345-0@lo:502:mount.lustre.0 Request processed in 132us (621us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843871.400943:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788843871.401404:0:23445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd1074fc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ce589ba-8334-438e-8f48-13932fcba8b1:23445:1875738134558720:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788843871.401464:0:23445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].45, 224 off16016 00000040:00080000:3.0:1788843871.401474:0:23445:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 45 count 46 00000020:01000000:2.0:1788843871.402550:0:23449:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788843871.402563:0:23449:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788843871.402566:0:23449:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:2.0:1788843871.402571:0:23449:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:2.0:1788843871.402574:0:23449:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788843871.402588:0:23449:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (ffff9bd12d61cd28) 00000020:00000080:2.0:1788843871.402609:0:23449:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type lod with refcount 2 00000020:00000080:2.0:1788843871.402615:0:23449:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1788843871.402692:0:23449:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788843871.402700:0:23449:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xa762dfcbd58d2afb 00000020:00000080:2.0:1788843871.402902:0:23449:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:2.0:1788843871.402907:0:23449:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788843871.402911:0:23449:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788843871.402912:0:23449:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:2.0:1788843871.402915:0:23449:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788843871.402918:0:23449:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788843871.402925:0:23449:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:2.0:1788843871.402930:0:23449:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788843871.402937:0:23449:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (ffff9bd12d618000) 00000020:00000080:2.0:1788843871.402948:0:23449:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdt with refcount 2 00000020:00000080:2.0:1788843871.402953:0:23449:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1788843871.402955:0:23449:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:2.0:1788843871.402958:0:23449:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:2.0:1788843871.402964:0:23449:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788843871.404985:0:23449:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9bd007394000 from lustre-MDT0001, refs=2 00000020:00000080:2.0:1788843871.405094:0:23449:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (ffff9bd10e8c99b8) 00000020:00000080:2.0:1788843871.405115:0:23449:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type mdd with refcount 2 00000004:01000000:2.0:1788843871.405516:0:23449:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1788843871.405524:0:23449:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xa762dfcbd58d2b10 00000020:00000080:2.0:1788843871.405664:0:23449:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:2.0:1788843871.405671:0:23449:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1788843871.405676:0:23449:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0xa762dfcbd58d2b17 00080000:01000000:2.0:1788843871.405683:0:23449:0:(osd_handler.c:8925:osd_obd_connect()) connect #2 00000020:00000080:2.0:1788843871.405687:0:23449:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xa762dfcbd58d2b1e 00000100:00100000:3.0:1788843871.450424:0:22754:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd13308b900 going to sleep for 0 seconds 00010000:00010000:0.0:1788843871.485050:0:23449:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:00000004:0.0:1788843871.485583:0:23449:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 8589934595 00000001:00080000:0.0:1788843871.485901:0:23449:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:0.0:1788843871.486847:0:23449:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:0.0:1788843871.486859:0:23449:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788843871.486864:0:23449:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788843871.486866:0:23449:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:0.0:1788843871.486869:0:23449:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788843871.486874:0:23449:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788843871.486876:0:23449:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:0.0:1788843871.486879:0:23449:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788843871.486885:0:23449:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.133@tcp to nid 0x20000c0a8cb85 (192.168.203.133@tcp) 00000020:00000080:0.0:1788843871.486913:0:23449:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788843871.486935:0:23449:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (ffff9bd13e91cd28) 00000020:00000080:0.0:1788843871.486960:0:23449:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osp with refcount 2 00000020:00000080:0.0:1788843871.486965:0:23449:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788843871.487101:0:23449:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:0.0:1788843871.487109:0:23449:0:(osd_handler.c:8925:osd_obd_connect()) connect #3 00000020:00000080:0.0:1788843871.487115:0:23449:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xa762dfcbd58d2b2c 00010000:00080000:0.0:1788843871.487215:0:23449:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9bd13fabf800@lustre-MDT0000-osp-MDT0001: add connection 192.168.203.133@tcp at head 00010000:00010000:2.0:1788843871.489905:0:23449:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-5 is initialized 00000020:00000080:0.0:1788843871.494307:0:23449:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788843871.494321:0:23449:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:0.0:1788843871.494373:0:23449:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:0.0:1788843871.494394:0:23449:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xa762dfcbd58d2b33 00000100:00080000:0.0:1788843871.494405:0:23449:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788843871.494410:0:23449:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9bd13fabf800 using connection 192.168.203.133@tcp/0@lo 00000100:00100000:0.0:1788843871.494446:0:23449:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bd10f957100 x1875738134558848/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788843871.494469:0:23449:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000020:01000000:0.0:1788843871.494517:0:23449:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788843871.494520:0:23449:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788843871.494522:0:23449:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:0.0:1788843871.494525:0:23449:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1788843871.494527:0:23449:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:0.0:1788843871.494529:0:23449:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788843871.494530:0:23449:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788843871.494532:0:23449:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1788843871.494534:0:23449:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788843871.494536:0:23449:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:0.0:1788843871.494538:0:23449:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788843871.494542:0:23449:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788843871.494543:0:23449:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:0.0:1788843871.494546:0:23449:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1788843871.494579:0:23449:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1788843871.494592:0:23449:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788843871.494595:0:23449:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788843871.494596:0:23449:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:0.0:1788843871.494599:0:23449:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1788843871.494601:0:23449:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #18 00000020:01000000:0.0:1788843871.494603:0:23449:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788843871.494604:0:23449:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788843871.494606:0:23449:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1788843871.494614:0:23449:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788843871.494616:0:23449:0:(obd_config.c:1563:class_process_config()) marker 18 (0x6) lustre sys.timeout 00000020:01000000:0.0:1788843871.494620:0:23449:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000100:00080000:2.0:1788843871.494623:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000020:01000004:0.0:1788843871.494623:0:23449:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:0.0:1788843871.494628:0:23449:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000100:00080000:2.0:1788843871.494632:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000020:00000080:0.0:1788843871.494632:0:23449:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1788843871.494637:0:23449:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788843871.494642:0:23449:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.133@tcp to nid 0x20000c0a8cb85 (192.168.203.133@tcp) 00000020:01000000:0.0:1788843871.494664:0:23449:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:0.0:1788843871.494666:0:23449:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788843871.494679:0:23449:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff9bd13e91b370) 00000020:00000080:0.0:1788843871.494690:0:23449:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000100:00080000:2.0:1788843871.494695:0:8:0:(import.c:65:import_set_state_nolock()) ffff9bd10f906000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788843871.494703:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 644 00000020:00000080:0.0:1788843871.494705:0:23449:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000100:00080000:2.0:1788843871.494707:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788843871.494714:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9bd10f906000 using connection 192.168.203.133@tcp/0@lo 00000100:00100000:2.0:1788843871.494735:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bd10f8d1180 x1875738134558976/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788843871.494746:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788843871.494749:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788843871.494751:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788843871.494761:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000004:00080000:0.0:1788843871.494780:0:23449:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:0.0:1788843871.494787:0:23449:0:(osd_handler.c:8925:osd_obd_connect()) connect #4 00000020:00000080:0.0:1788843871.494793:0:23449:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xa762dfcbd58d2b41 00000100:00100000:2.0:1788843871.494807:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f8d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3632:1875738134559104:0@lo:400:kworker.0 00010000:00080000:0.0:1788843871.494826:0:23449:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9bd13fabb000@lustre-OST0000-osc-MDT0001: add connection 192.168.203.133@tcp at head 00000100:00100000:2.0:1788843871.494877:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788843871.495019:0:23449:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-6 is initialized 00000100:00100000:1.0:1788843871.495306:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f957100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3629:1875738134558848:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788843871.495358:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843871.495387:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f8d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3629:1875738134558976:0@lo:38:kworker.0 00000100:00100000:1.0:1788843871.495410:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843871.495459:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134559104 00000100:00100000:1.0:1788843871.495465:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134559104 00000100:00100000:1.0:1788843871.495505:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788843871.495514:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f8d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3632:x1875738134559104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843871.495577:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f8d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3632:x1875738134559104:12345-0@lo:400:kworker.0 Request processed in 63us (701us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843871.495584:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788843871.495626:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9bd10f8d2300 x1875738134559104/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843887 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788843871.495646:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f8d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3632:1875738134559104:0@lo:400:kworker.0 00000100:00100000:2.0:1788843871.495710:0:22717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134558848 00000100:00100000:2.0:1788843871.495714:0:22717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134558848 00000100:00100000:2.0:1788843871.495727:0:22717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134558976 00000100:00100000:2.0:1788843871.495729:0:22717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134558976 00000100:00100000:2.0:1788843871.495739:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788843871.495743:0:22717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f960000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3629:x1875738134558848:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1788843871.495763:0:22717:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 649 last 0 00000020:00000080:2.0:1788843871.495789:0:22717:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xa762dfcbd58d2b48 00000004:00100000:2.0:1788843871.495803:0:22717:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:2.0:1788843871.495809:0:22717:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884901888 00000040:01000000:1.0:1788843871.498418:0:23449:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1788843871.498672:0:23449:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:1.0:1788843871.500513:0:23449:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00080000:2.0:1788843871.500977:0:22717:0:(import.c:65:import_set_state_nolock()) ffff9bd007225000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788843871.501085:0:22717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f960000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3629:x1875738134558848:12345-0@lo:38:llog_process_th.0 Request processed in 5338us (5725us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843871.501107:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788843871.501138:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788843871.501175:0:22717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f963b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3629:x1875738134558976:12345-0@lo:38:kworker.0 00000100:00100000:2.0:1788843871.501220:0:22717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f963b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3629:x1875738134558976:12345-0@lo:38:kworker.0 Request processed in 45us (5809us total) trans 0 rc -11/-11 00000100:00100000:2.0:1788843871.501226:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000040:00080000:0.0:1788843871.501436:0:23449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].3, 64 off8384 00000100:00100000:1.0:1788843871.501473:0:3629:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788843871.501484:0:3629:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 3 00000100:00080000:1.0:1788843871.501494:0:3629:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:1.0:1788843871.501499:0:3629:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788843871.501502:0:3629:0:(import.c:65:import_set_state_nolock()) ffff9bd13fabf800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788843871.501521:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f957100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3629:1875738134558848:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788843871.501534:0:3629:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788843871.501538:0:3629:0:(import.c:65:import_set_state_nolock()) ffff9bd10f906000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788843871.501541:0:3629:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1788843871.501544:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f8d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3629:1875738134558976:0@lo:38:kworker.0 00000040:00080000:0.0:1788843871.501593:0:23449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000100:00100000:1.0:1788843871.501744:0:3632:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788843871.501760:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f8d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1875738134559232:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788843871.501804:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843871.501909:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134559232 00000100:00100000:2.0:1788843871.501916:0:22716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134559232 00000100:00100000:2.0:1788843871.501961:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788843871.501969:0:22716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f963480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3632:x1875738134559232:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788843871.502073:0:22716:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1788843871.502203:0:22716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f963480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3632:x1875738134559232:12345-0@lo:41:osp-pre-0-1.0 Request processed in 235us (399us total) trans 0 rc 0/0 00000040:00080000:0.0:1788843871.502203:0:23454:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:0.0:1788843871.502208:0:23454:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 3 of catalog [0x1:0x2:0x0] 00000100:00100000:2.0:1788843871.502210:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788843871.502289:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f8d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1875738134559232:0@lo:41:osp-pre-0-1.0 00000020:00000080:0.0:1788843871.502863:0:23449:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788843871.502873:0:23449:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1788843871.502908:0:23449:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1788843871.502927:0:23449:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xa762dfcbd58d2b4f 00000100:00080000:0.0:1788843871.502935:0:23449:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788843871.502941:0:23449:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9bd13fabb000 using connection 192.168.203.133@tcp/0@lo 00000100:00100000:0.0:1788843871.502967:0:23449:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bd10f956300 x1875738134559360/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788843871.503004:0:23449:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1788843871.503059:0:23449:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788843871.503063:0:23449:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788843871.503066:0:23449:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1788843871.503069:0:23449:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1788843871.503071:0:23449:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #26 00000020:01000000:0.0:1788843871.503073:0:23449:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788843871.503074:0:23449:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788843871.503076:0:23449:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1788843871.503078:0:23449:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788843871.503079:0:23449:0:(obd_config.c:1563:class_process_config()) marker 26 (0x6) lustre sys.timeout 00000020:01000000:0.0:1788843871.503082:0:23449:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788843871.503085:0:23449:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000100:00080000:2.0:1788843871.503089:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000020:00000080:0.0:1788843871.503089:0:23449:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788843871.503090:0:23449:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1788843871.503093:0:23449:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000100:00080000:2.0:1788843871.503094:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000020:00000080:0.0:1788843871.503097:0:23449:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.133@tcp to nid 0x20000c0a8cb85 (192.168.203.133@tcp) 00000020:01000000:0.0:1788843871.503118:0:23449:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:0.0:1788843871.503121:0:23449:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788843871.503133:0:23449:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff9bd0078b8000) 00000020:00000080:0.0:1788843871.503168:0:23449:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type osp with refcount 2 00000020:00000080:0.0:1788843871.503176:0:23449:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788843871.503248:0:23449:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:0.0:1788843871.503255:0:23449:0:(osd_handler.c:8925:osd_obd_connect()) connect #5 00000020:00000080:0.0:1788843871.503262:0:23449:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xa762dfcbd58d2b5d 00010000:00080000:0.0:1788843871.503292:0:23449:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9bd112389800@lustre-OST0001-osc-MDT0001: add connection 192.168.203.133@tcp at head 00010000:00010000:0.0:1788843871.503497:0:23449:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-7 is initialized 00000040:01000000:0.0:1788843871.503558:0:23449:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1788843871.503572:0:23449:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000100:00100000:1.0:1788843871.504007:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f956300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3629:1875738134559360:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1788843871.504051:0:3629:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875738134559360 offset 0 length 520: 4 00000100:00080000:2.0:1788843871.505008:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788843871.505015:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:0.0:1788843871.506134:0:23449:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788843871.506604:0:23449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].3, 64 off8384 00000040:00080000:2.0:1788843871.506718:0:23449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 64 off8256 00000040:00080000:0.0:1788843871.507061:0:23456:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:0.0:1788843871.507071:0:23456:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 3 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1788843871.507669:0:23449:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1788843871.507682:0:23449:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788843871.507722:0:23449:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1788843871.507745:0:23449:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xa762dfcbd58d2b64 00000100:00080000:2.0:1788843871.507757:0:23449:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788843871.507763:0:23449:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9bd112389800 using connection 192.168.203.133@tcp/0@lo 00000100:00100000:2.0:1788843871.507795:0:23449:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bd10f8d2680 x1875738134559488/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788843871.507816:0:23449:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:1.0:1788843871.507855:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f8d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3629:1875738134559488:0@lo:8:llog_process_th.0 00000020:01000000:2.0:1788843871.507867:0:23449:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788843871.507872:0:23449:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788843871.507873:0:23449:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1788843871.507876:0:23449:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788843871.507880:0:23449:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788843871.507881:0:23449:0:(obd_config.c:1563:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788843871.507884:0:23449:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788843871.507885:0:23449:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788843871.507892:0:23449:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788843871.507894:0:23449:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788843871.507896:0:23449:0:(obd_config.c:1563:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000020:01000000:2.0:1788843871.507897:0:23449:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788843871.507899:0:23449:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788843871.507900:0:23449:0:(obd_config.c:1563:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788843871.507903:0:23449:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000400:00000100:1.0:1788843871.507917:0:3629:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875738134559488 offset 0 length 520: 4 00000020:01000000:2.0:1788843871.507922:0:23449:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788843871.507925:0:23449:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788843871.507926:0:23449:0:(obd_config.c:1563:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788843871.507929:0:23449:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 46 count 46 00000020:01000000:3.0:1788843871.508093:0:23445:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-45 (rc=0) 10000000:01000000:3.0:1788843871.508234:0:23445:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.133@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00000100:00080000:0.0:1788843871.508237:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788843871.508244:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788843871.508247:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788843871.508251:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:3.0:1788843871.508252:0:23445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd118f71c00/0xa762dfcbd58d2ae6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d2aed expref: -99 pid: 23445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843871.508263:0:23445:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.133@tcp lock: ffff9bd118f71c00/0xa762dfcbd58d2ae6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d2aed expref: -99 pid: 23445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788843871.508272:0:23445:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9bd007394000 from 1 10000000:01000000:3.0:1788843871.508275:0:23445:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788843871.508301:0:23445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd118f71000/0xa762dfcbd58d2b6b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843871.508310:0:23445:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.133@tcp lock: ffff9bd118f71000/0xa762dfcbd58d2b6b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843871.508333:0:23445:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.133@tcp lock: ffff9bd118f71000/0xa762dfcbd58d2b6b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843871.508365:0:23445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd1074fc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ce589ba-8334-438e-8f48-13932fcba8b1:23445:1875738134559616:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788843871.508403:0:23445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843871.508431:0:23445:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd110dec840 going to sleep for 11 seconds 00000100:00100000:2.0:1788843871.508535:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134559616 00000100:00100000:2.0:1788843871.508541:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134559616 00000100:00100000:2.0:1788843871.508627:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788843871.508638:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd00702ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ce589ba-8334-438e-8f48-13932fcba8b1+15:23445:x1875738134559616:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788843871.508654:0:22706:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788843871.508673:0:22706:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd1153e7800/0xa762dfcbd58d2b72 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa762dfcbd58d2b6b expref: -99 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843871.508697:0:22706:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd1153e7800/0xa762dfcbd58d2b72 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa762dfcbd58d2b6b expref: 16 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843871.508713:0:22706:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd1153e7800/0xa762dfcbd58d2b72 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa762dfcbd58d2b6b expref: 16 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843871.508722:0:22706:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd1153e7800, rc 0) 00000100:00100000:2.0:1788843871.508765:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd00702ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ce589ba-8334-438e-8f48-13932fcba8b1+16:23445:x1875738134559616:12345-0@lo:101:mount.lustre.0 Request processed in 128us (361us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843871.508772:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788843871.508803:0:23445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd1074fc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ce589ba-8334-438e-8f48-13932fcba8b1:23445:1875738134559616:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788843871.508817:0:23445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.133@tcp lock: ffff9bd118f71000/0xa762dfcbd58d2b6b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d2b72 expref: -99 pid: 23445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843871.508827:0:23445:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.133@tcp lock: ffff9bd118f71000/0xa762dfcbd58d2b6b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa762dfcbd58d2b72 expref: -99 pid: 23445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843871.509411:0:23445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd1074fc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ce589ba-8334-438e-8f48-13932fcba8b1:23445:1875738134559744:0@lo:256:mount.lustre.0 00000100:00100000:3.0:1788843871.509447:0:23445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843871.509478:0:23445:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd110dec840 going to sleep for 11 seconds 00000100:00100000:0.0:1788843871.509564:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134559744 00000100:00100000:0.0:1788843871.509569:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134559744 00000100:00100000:0.0:1788843871.509600:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788843871.509606:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd00702fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ce589ba-8334-438e-8f48-13932fcba8b1+16:23445:x1875738134559744:12345-0@lo:256:mount.lustre.0 20000000:01000000:0.0:1788843871.509620:0:22705:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1788843871.509642:0:22705:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1788843871.509648:0:22705:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 11 00000100:00100000:0.0:1788843871.509733:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd00702fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ce589ba-8334-438e-8f48-13932fcba8b1+16:23445:x1875738134559744:12345-0@lo:256:mount.lustre.0 Request processed in 126us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843871.509741:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788843871.509751:0:23445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd1074fc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ce589ba-8334-438e-8f48-13932fcba8b1:23445:1875738134559744:0@lo:256:mount.lustre.0 10000000:01000000:3.0:1788843871.510475:0:23445:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.133@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788843871.510498:0:23445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd118f71000/0xa762dfcbd58d2b6b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d2b72 expref: -99 pid: 23445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843871.510508:0:23445:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.133@tcp lock: ffff9bd118f71000/0xa762dfcbd58d2b6b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d2b72 expref: -99 pid: 23445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788843871.510516:0:23445:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9bd007394000 from 1 10000000:01000000:3.0:1788843871.510519:0:23445:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788843871.510551:0:23445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd118f70600/0xa762dfcbd58d2b79 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843871.510558:0:23445:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.133@tcp lock: ffff9bd118f70600/0xa762dfcbd58d2b79 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843871.510566:0:23445:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.133@tcp lock: ffff9bd118f70600/0xa762dfcbd58d2b79 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843871.510580:0:23445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd1074fc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ce589ba-8334-438e-8f48-13932fcba8b1:23445:1875738134559872:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788843871.510615:0:23445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843871.510645:0:23445:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd110dec840 going to sleep for 11 seconds 00000100:00100000:2.0:1788843871.510723:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134559872 00000100:00100000:2.0:1788843871.510730:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134559872 00000100:00100000:2.0:1788843871.510776:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788843871.510784:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd00702f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ce589ba-8334-438e-8f48-13932fcba8b1+16:23445:x1875738134559872:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788843871.510794:0:22706:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788843871.510805:0:22706:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd1153e6200/0xa762dfcbd58d2b80 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa762dfcbd58d2b79 expref: -99 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843871.510831:0:22706:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd1153e6200/0xa762dfcbd58d2b80 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa762dfcbd58d2b79 expref: 17 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843871.510841:0:22706:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd1153e6200/0xa762dfcbd58d2b80 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa762dfcbd58d2b79 expref: 17 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843871.510849:0:22706:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd1153e6200, rc 0) 00000100:00100000:2.0:1788843871.510889:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd00702f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ce589ba-8334-438e-8f48-13932fcba8b1+17:23445:x1875738134559872:12345-0@lo:101:mount.lustre.0 Request processed in 106us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843871.510895:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788843871.510961:0:23445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd1074fc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ce589ba-8334-438e-8f48-13932fcba8b1:23445:1875738134559872:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788843871.510974:0:23445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.133@tcp lock: ffff9bd118f70600/0xa762dfcbd58d2b79 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d2b80 expref: -99 pid: 23445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843871.510982:0:23445:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.133@tcp lock: ffff9bd118f70600/0xa762dfcbd58d2b79 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa762dfcbd58d2b80 expref: -99 pid: 23445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788843871.512009:0:23445:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 13 count 13 00000040:00080000:3.0:1788843871.512429:0:23445:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788843871.512580:0:23445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:3.0:1788843871.512604:0:23445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 112 off8528 00000040:00080000:3.0:1788843871.512616:0:23445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 224 off8752 00000040:00080000:3.0:1788843871.512628:0:23445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8976 00000040:00080000:3.0:1788843871.512642:0:23445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 112 off9088 00000040:00080000:3.0:1788843871.512655:0:23445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 224 off9312 00000040:00080000:3.0:1788843871.512667:0:23445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 224 off9536 00000040:00080000:3.0:1788843871.512678:0:23445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 128 off9664 00000040:00080000:3.0:1788843871.512691:0:23445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:3.0:1788843871.512702:0:23445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 224 off10112 00000040:00080000:3.0:1788843871.512722:0:23445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 128 off10240 00000040:00080000:3.0:1788843871.512738:0:23445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10464 00000040:00080000:3.0:1788843871.512743:0:23445:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 12 count 13 00000100:00100000:3.0:1788843871.512805:0:23445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd1074fc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ce589ba-8334-438e-8f48-13932fcba8b1:23445:1875738134560000:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788843871.512855:0:23445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843871.512892:0:23445:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd110decf00 going to sleep for 11 seconds 00000100:00100000:1.0:1788843871.512923:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134560000 00000100:00100000:1.0:1788843871.512931:0:22704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134560000 00000100:00100000:1.0:1788843871.512971:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788843871.512988:0:22704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd00702d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ce589ba-8334-438e-8f48-13932fcba8b1+17:23445:x1875738134560000:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788843871.513111:0:22704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd00702d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ce589ba-8334-438e-8f48-13932fcba8b1+17:23445:x1875738134560000:12345-0@lo:501:mount.lustre.0 Request processed in 125us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843871.513119:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788843871.513272:0:23445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd1074fc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ce589ba-8334-438e-8f48-13932fcba8b1:23445:1875738134560000:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788843871.513301:0:23445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd1074fc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ce589ba-8334-438e-8f48-13932fcba8b1:23445:1875738134560128:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788843871.513334:0:23445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843871.513372:0:23445:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd110decf00 going to sleep for 11 seconds 00000100:00100000:0.0:1788843871.513527:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134560128 00000100:00100000:0.0:1788843871.513532:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134560128 00000100:00100000:0.0:1788843871.513564:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788843871.513571:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd00702cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ce589ba-8334-438e-8f48-13932fcba8b1+17:23445:x1875738134560128:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788843871.513663:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd00702cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ce589ba-8334-438e-8f48-13932fcba8b1+17:23445:x1875738134560128:12345-0@lo:503:mount.lustre.0 Request processed in 92us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843871.513670:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788843871.513741:0:23445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd1074fc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ce589ba-8334-438e-8f48-13932fcba8b1:23445:1875738134560128:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788843871.514051:0:23445:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788843871.514104:0:23445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd1074fc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ce589ba-8334-438e-8f48-13932fcba8b1:23445:1875738134560256:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788843871.514225:0:23445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843871.514244:0:23445:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd110dec840 going to sleep for 11 seconds 00000100:00100000:1.0:1788843871.514300:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134560256 00000100:00100000:1.0:1788843871.514305:0:22704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134560256 00000100:00100000:1.0:1788843871.514351:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788843871.514358:0:22704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd00702e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ce589ba-8334-438e-8f48-13932fcba8b1+17:23445:x1875738134560256:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788843871.514442:0:22704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd00702e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ce589ba-8334-438e-8f48-13932fcba8b1+17:23445:x1875738134560256:12345-0@lo:502:mount.lustre.0 Request processed in 84us (217us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843871.514450:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788843871.514465:0:23445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd1074fc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ce589ba-8334-438e-8f48-13932fcba8b1:23445:1875738134560256:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788843871.514617:0:23445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:3.0:1788843871.514641:0:23445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 112 off8528 00000040:00080000:3.0:1788843871.514654:0:23445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 224 off8752 00000040:00080000:3.0:1788843871.514666:0:23445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8976 00000040:00080000:3.0:1788843871.514677:0:23445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 112 off9088 00000040:00080000:3.0:1788843871.514689:0:23445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 224 off9312 00000040:00080000:3.0:1788843871.514700:0:23445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 224 off9536 00000040:00080000:3.0:1788843871.514711:0:23445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 128 off9664 00000040:00080000:3.0:1788843871.514725:0:23445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:3.0:1788843871.514737:0:23445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 224 off10112 00000040:00080000:3.0:1788843871.514749:0:23445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 128 off10240 00000100:00100000:3.0:1788843871.514775:0:23445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd1074fc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ce589ba-8334-438e-8f48-13932fcba8b1:23445:1875738134560384:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788843871.514805:0:23445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843871.514822:0:23445:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd110dec840 going to sleep for 11 seconds 00000100:00100000:2.0:1788843871.514841:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134560384 00000100:00100000:2.0:1788843871.514846:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134560384 00000100:00100000:2.0:1788843871.514875:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788843871.514881:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd00702dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ce589ba-8334-438e-8f48-13932fcba8b1+17:23445:x1875738134560384:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788843871.514975:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd00702dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ce589ba-8334-438e-8f48-13932fcba8b1+17:23445:x1875738134560384:12345-0@lo:502:mount.lustre.0 Request processed in 93us (169us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843871.514982:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788843871.515036:0:23445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd1074fc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ce589ba-8334-438e-8f48-13932fcba8b1:23445:1875738134560384:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788843871.515070:0:23445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10464 00000040:00080000:3.0:1788843871.515077:0:23445:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:3.0:1788843871.515694:0:23458:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788843871.515703:0:23458:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788843871.515706:0:23458:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788843871.515713:0:23458:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9bd007394000 00000020:00000080:3.0:1788843871.515715:0:23458:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788843871.515721:0:23458:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788843871.515723:0:23458:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788843871.515725:0:23458:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1788843871.515727:0:23458:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788843871.515729:0:23458:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788843871.515730:0:23458:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788843871.515733:0:23458:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9bd007394000 00000020:00000080:3.0:1788843871.515734:0:23458:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788843871.515788:0:23458:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788843871.515792:0:23458:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788843871.515793:0:23458:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1788843871.515796:0:23458:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788843871.515798:0:23458:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788843871.515800:0:23458:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788843871.515804:0:23458:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9bd007394000 00000020:00000080:3.0:1788843871.515807:0:23458:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788843871.515825:0:23458:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788843871.515828:0:23458:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788843871.515829:0:23458:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788843871.515832:0:23458:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788843871.515840:0:23458:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788843871.515841:0:23458:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1788843871.515845:0:23458:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9bd007394000 00000020:00000080:3.0:1788843871.515847:0:23458:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788843871.515869:0:23458:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788843871.515872:0:23458:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788843871.515874:0:23458:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1788843871.515877:0:23458:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 13 count 13 00000020:01000000:0.0:1788843871.516011:0:23445:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:0.0:1788843871.516034:0:23445:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.133@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788843871.516056:0:23445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd118f70600/0xa762dfcbd58d2b79 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d2b80 expref: -99 pid: 23445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843871.516078:0:23445:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.133@tcp lock: ffff9bd118f70600/0xa762dfcbd58d2b79 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d2b80 expref: -99 pid: 23445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788843871.516124:0:23445:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788843871.516127:0:23445:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9bd007394000 10000000:01000000:0.0:1788843871.516130:0:23445:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9bd007394000 10000000:01000000:0.0:1788843871.516134:0:23445:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788843871.516390:0:23445:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9bd007394000 from 1 10000000:01000000:3.0:1788843871.516394:0:23445:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788843871.516428:0:23445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd118f70400/0xa762dfcbd58d2b87 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843871.516437:0:23445:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.133@tcp lock: ffff9bd118f70400/0xa762dfcbd58d2b87 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843871.516448:0:23445:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.133@tcp lock: ffff9bd118f70400/0xa762dfcbd58d2b87 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843871.516467:0:23445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd1074fc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ce589ba-8334-438e-8f48-13932fcba8b1:23445:1875738134560512:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788843871.516515:0:23445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843871.516584:0:23445:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd110decf00 going to sleep for 11 seconds 00000100:00100000:2.0:1788843871.516619:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134560512 00000100:00100000:2.0:1788843871.516626:0:22704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134560512 00000100:00100000:2.0:1788843871.516699:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788843871.516709:0:22704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd00702e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ce589ba-8334-438e-8f48-13932fcba8b1+17:23445:x1875738134560512:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788843871.516721:0:22704:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788843871.516742:0:22704:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd1153e6e00/0xa762dfcbd58d2b8e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xa762dfcbd58d2b87 expref: -99 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843871.516767:0:22704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd1153e6e00/0xa762dfcbd58d2b8e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa762dfcbd58d2b87 expref: 18 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843871.516778:0:22704:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd1153e6e00/0xa762dfcbd58d2b8e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa762dfcbd58d2b87 expref: 18 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843871.516786:0:22704:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd1153e6e00, rc 0) 00000100:00100000:2.0:1788843871.516829:0:22704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd00702e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ce589ba-8334-438e-8f48-13932fcba8b1+18:23445:x1875738134560512:12345-0@lo:101:mount.lustre.0 Request processed in 122us (314us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843871.516836:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788843871.516906:0:23445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd1074fc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ce589ba-8334-438e-8f48-13932fcba8b1:23445:1875738134560512:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788843871.516919:0:23445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.133@tcp lock: ffff9bd118f70400/0xa762dfcbd58d2b87 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d2b8e expref: -99 pid: 23445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843871.516927:0:23445:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.133@tcp lock: ffff9bd118f70400/0xa762dfcbd58d2b87 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xa762dfcbd58d2b8e expref: -99 pid: 23445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788843871.523440:0:23445:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 52 count 51 00000040:00080000:3.0:1788843871.523745:0:23445:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788843871.523988:0:23445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].1, 224 off8416 00000040:00080000:3.0:1788843871.524030:0:23445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].2, 120 off8536 00000040:00080000:3.0:1788843871.524059:0:23445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].3, 168 off8704 00000040:00080000:3.0:1788843871.524081:0:23445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].4, 224 off8928 00000040:00080000:3.0:1788843871.524100:0:23445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].5, 224 off9152 00000040:00080000:3.0:1788843871.524123:0:23445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].6, 120 off9272 00000040:00080000:3.0:1788843871.524168:0:23445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].7, 168 off9440 00000040:00080000:3.0:1788843871.524192:0:23445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].8, 224 off9664 00000040:00080000:3.0:1788843871.524469:0:23445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].9, 224 off9888 00000040:00080000:3.0:1788843871.524491:0:23445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].10, 120 off10008 00000040:00080000:3.0:1788843871.524511:0:23445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].11, 224 off10232 00000040:00080000:3.0:1788843871.524529:0:23445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].12, 224 off10456 00000040:00080000:3.0:1788843871.524548:0:23445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].13, 88 off10544 00000040:00080000:3.0:1788843871.524567:0:23445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].14, 128 off10672 00000040:00080000:3.0:1788843871.524585:0:23445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].15, 144 off10816 00000040:00080000:3.0:1788843871.524602:0:23445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].16, 160 off10976 00000040:00080000:3.0:1788843871.524622:0:23445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].17, 224 off11200 00000040:00080000:3.0:1788843871.524641:0:23445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].18, 224 off11424 00000040:00080000:3.0:1788843871.524659:0:23445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].19, 80 off11504 00000040:00080000:3.0:1788843871.524675:0:23445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].20, 224 off11728 00000040:00080000:3.0:1788843871.524690:0:23445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].21, 224 off11952 00000040:00080000:3.0:1788843871.524705:0:23445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].22, 88 off12040 00000040:00080000:3.0:1788843871.524722:0:23445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].23, 128 off12168 00000040:00080000:3.0:1788843871.524740:0:23445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].24, 144 off12312 00000040:00080000:3.0:1788843871.524760:0:23445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].25, 160 off12472 00000040:00080000:3.0:1788843871.524775:0:23445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].26, 224 off12696 00000040:00080000:3.0:1788843871.524788:0:23445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].27, 224 off12920 00000040:00080000:3.0:1788843871.524857:0:23445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].28, 80 off13000 00000040:00080000:3.0:1788843871.524881:0:23445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].29, 224 off13224 00000040:00080000:3.0:1788843871.524897:0:23445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].30, 224 off13448 00000040:00080000:3.0:1788843871.524912:0:23445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].31, 88 off13536 00000040:00080000:3.0:1788843871.524928:0:23445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].32, 128 off13664 00000040:00080000:3.0:1788843871.524953:0:23445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].33, 144 off13808 00000040:00080000:3.0:1788843871.524967:0:23445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].34, 128 off13936 00000040:00080000:3.0:1788843871.524981:0:23445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].35, 224 off14160 00000040:00080000:3.0:1788843871.524995:0:23445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].36, 224 off14384 00000040:00080000:3.0:1788843871.525066:0:23445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].37, 80 off14464 00000040:00080000:3.0:1788843871.525086:0:23445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].38, 224 off14688 00000040:00080000:3.0:1788843871.525103:0:23445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].39, 224 off14912 00000040:00080000:3.0:1788843871.525119:0:23445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].40, 88 off15000 00000040:00080000:3.0:1788843871.525135:0:23445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].41, 128 off15128 00000040:00080000:3.0:1788843871.525182:0:23445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].42, 144 off15272 00000040:00080000:3.0:1788843871.525197:0:23445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].43, 128 off15400 00000040:00080000:3.0:1788843871.525277:0:23445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].44, 224 off15624 00000040:00080000:3.0:1788843871.525799:0:23445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].45, 224 off15848 00000040:00080000:3.0:1788843871.525891:0:23445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].46, 80 off15928 00000040:00080000:3.0:1788843871.525907:0:23445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].47, 224 off16152 00000040:00080000:3.0:1788843871.525924:0:23445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].48, 232 off16384 00000040:00080000:3.0:1788843871.526137:0:23445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].49, 224 off16608 00000040:00080000:3.0:1788843871.526189:0:23445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].50, 120 off16728 00000040:00080000:3.0:1788843871.526304:0:23445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].51, 224 off16952 00000040:00080000:3.0:1788843871.526311:0:23445:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 51 count 51 00000100:00100000:3.0:1788843871.526436:0:23445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd1074fc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ce589ba-8334-438e-8f48-13932fcba8b1:23445:1875738134560640:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788843871.526507:0:23445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843871.526546:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134560640 00000100:00100000:2.0:1788843871.526555:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134560640 00000100:00100000:3.0:1788843871.526559:0:23445:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd110dec600 going to sleep for 11 seconds 00000100:00100000:2.0:1788843871.526614:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788843871.526626:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd00702c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ce589ba-8334-438e-8f48-13932fcba8b1+18:23445:x1875738134560640:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788843871.527624:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd00702c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ce589ba-8334-438e-8f48-13932fcba8b1+18:23445:x1875738134560640:12345-0@lo:501:mount.lustre.0 Request processed in 996us (1113us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843871.527634:0:23445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd1074fc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ce589ba-8334-438e-8f48-13932fcba8b1:23445:1875738134560640:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788843871.527636:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788843871.527680:0:23445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd1074fc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ce589ba-8334-438e-8f48-13932fcba8b1:23445:1875738134560768:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788843871.527721:0:23445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843871.527751:0:23445:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd110dec600 going to sleep for 11 seconds 00000100:00100000:2.0:1788843871.528465:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134560768 00000100:00100000:2.0:1788843871.528473:0:22704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134560768 00000100:00100000:2.0:1788843871.528522:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788843871.528533:0:22704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd00702e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ce589ba-8334-438e-8f48-13932fcba8b1+18:23445:x1875738134560768:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788843871.528648:0:22704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd00702e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ce589ba-8334-438e-8f48-13932fcba8b1+18:23445:x1875738134560768:12345-0@lo:503:mount.lustre.0 Request processed in 117us (925us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843871.528657:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788843871.528660:0:23445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd1074fc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ce589ba-8334-438e-8f48-13932fcba8b1:23445:1875738134560768:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788843871.529321:0:23445:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788843871.529406:0:23445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd1074fc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ce589ba-8334-438e-8f48-13932fcba8b1:23445:1875738134560896:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788843871.529443:0:23445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843871.529468:0:23445:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd110decf00 going to sleep for 11 seconds 00000100:00100000:2.0:1788843871.530442:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134560896 00000100:00100000:2.0:1788843871.530459:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134560896 00000100:00100000:2.0:1788843871.530551:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788843871.530563:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd00702d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ce589ba-8334-438e-8f48-13932fcba8b1+18:23445:x1875738134560896:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788843871.530693:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd00702d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ce589ba-8334-438e-8f48-13932fcba8b1+18:23445:x1875738134560896:12345-0@lo:502:mount.lustre.0 Request processed in 131us (1248us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843871.530702:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788843871.530711:0:23445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd1074fc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ce589ba-8334-438e-8f48-13932fcba8b1:23445:1875738134560896:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788843871.531130:0:23445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].1, 224 off8416 00000040:00080000:3.0:1788843871.531184:0:23445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].2, 120 off8536 00000040:00080000:3.0:1788843871.531265:0:23445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].3, 168 off8704 00000040:00080000:3.0:1788843871.531284:0:23445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].4, 224 off8928 00000040:00080000:3.0:1788843871.531297:0:23445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].5, 224 off9152 00000040:00080000:3.0:1788843871.531309:0:23445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].6, 120 off9272 00000040:00080000:3.0:1788843871.531321:0:23445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].7, 168 off9440 00000040:00080000:3.0:1788843871.531333:0:23445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].8, 224 off9664 00000040:00080000:3.0:1788843871.531356:0:23445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].9, 224 off9888 00000040:00080000:3.0:1788843871.531370:0:23445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].10, 120 off10008 00000040:00080000:3.0:1788843871.531383:0:23445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].11, 224 off10232 00000040:00080000:3.0:1788843871.531396:0:23445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].12, 224 off10456 00000040:00080000:3.0:1788843871.531411:0:23445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].13, 88 off10544 00000040:00080000:3.0:1788843871.531425:0:23445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].14, 128 off10672 00000040:00080000:3.0:1788843871.531455:0:23445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].15, 144 off10816 00000040:00080000:3.0:1788843871.531468:0:23445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].16, 160 off10976 00000040:00080000:3.0:1788843871.531480:0:23445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].17, 224 off11200 00000040:00080000:3.0:1788843871.531492:0:23445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].18, 224 off11424 00000040:00080000:3.0:1788843871.531503:0:23445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].19, 80 off11504 00000040:00080000:3.0:1788843871.531515:0:23445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].20, 224 off11728 00000040:00080000:3.0:1788843871.531526:0:23445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].21, 224 off11952 00000040:00080000:3.0:1788843871.531538:0:23445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].22, 88 off12040 00000040:00080000:3.0:1788843871.531549:0:23445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].23, 128 off12168 00000040:00080000:3.0:1788843871.531562:0:23445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].24, 144 off12312 00000040:00080000:3.0:1788843871.531573:0:23445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].25, 160 off12472 00000040:00080000:3.0:1788843871.531585:0:23445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].26, 224 off12696 00000040:00080000:3.0:1788843871.531596:0:23445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].27, 224 off12920 00000040:00080000:3.0:1788843871.531617:0:23445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].28, 80 off13000 00000040:00080000:3.0:1788843871.531628:0:23445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].29, 224 off13224 00000040:00080000:3.0:1788843871.531640:0:23445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].30, 224 off13448 00000040:00080000:3.0:1788843871.531661:0:23445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].31, 88 off13536 00000040:00080000:3.0:1788843871.531673:0:23445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].32, 128 off13664 00000040:00080000:3.0:1788843871.531686:0:23445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].33, 144 off13808 00000040:00080000:3.0:1788843871.531697:0:23445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].34, 128 off13936 00000040:00080000:3.0:1788843871.531709:0:23445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].35, 224 off14160 00000040:00080000:3.0:1788843871.531721:0:23445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].36, 224 off14384 00000040:00080000:3.0:1788843871.531733:0:23445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].37, 80 off14464 00000040:00080000:3.0:1788843871.531745:0:23445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].38, 224 off14688 00000040:00080000:3.0:1788843871.531757:0:23445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].39, 224 off14912 00000040:00080000:3.0:1788843871.531770:0:23445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].40, 88 off15000 00000040:00080000:3.0:1788843871.531783:0:23445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].41, 128 off15128 00000040:00080000:3.0:1788843871.531795:0:23445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].42, 144 off15272 00000040:00080000:3.0:1788843871.531806:0:23445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].43, 128 off15400 00000040:00080000:3.0:1788843871.531821:0:23445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].44, 224 off15624 00000040:00080000:3.0:1788843871.531837:0:23445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].45, 224 off15848 00000040:00080000:3.0:1788843871.531853:0:23445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].46, 80 off15928 00000040:00080000:3.0:1788843871.531882:0:23445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].47, 224 off16152 00000040:00080000:3.0:1788843871.531901:0:23445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].48, 232 off16384 00000100:00100000:3.0:1788843871.531949:0:23445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd1074fc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ce589ba-8334-438e-8f48-13932fcba8b1:23445:1875738134561024:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788843871.532003:0:23445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843871.535095:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134561024 00000100:00100000:0.0:1788843871.535109:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134561024 00000100:00100000:0.0:1788843871.535172:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788843871.535184:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd00702d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ce589ba-8334-438e-8f48-13932fcba8b1+18:23445:x1875738134561024:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788843871.535300:0:23445:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd110decf00 going to sleep for 11 seconds 00000100:00100000:1.0:1788843871.535445:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd00702d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ce589ba-8334-438e-8f48-13932fcba8b1+18:23445:x1875738134561024:12345-0@lo:502:mount.lustre.0 Request processed in 263us (3441us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843871.535454:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788843871.535535:0:23445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd1074fc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ce589ba-8334-438e-8f48-13932fcba8b1:23445:1875738134561024:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788843871.535782:0:23445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].49, 224 off16608 00000040:00080000:0.0:1788843871.535809:0:23445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].50, 120 off16728 00000100:00100000:0.0:1788843871.535846:0:23445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f955180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ce589ba-8334-438e-8f48-13932fcba8b1:23445:1875738134561152:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788843871.535889:0:23445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843871.535946:0:23445:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd13331c3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788843871.535984:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134561152 00000100:00100000:1.0:1788843871.535988:0:22704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134561152 00000100:00100000:1.0:1788843871.536052:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788843871.536061:0:22704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd00702c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ce589ba-8334-438e-8f48-13932fcba8b1+18:23445:x1875738134561152:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788843871.536161:0:22704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd00702c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ce589ba-8334-438e-8f48-13932fcba8b1+18:23445:x1875738134561152:12345-0@lo:502:mount.lustre.0 Request processed in 80us (250us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843871.536169:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788843871.536240:0:23445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f955180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ce589ba-8334-438e-8f48-13932fcba8b1:23445:1875738134561152:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788843871.536280:0:23445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].51, 224 off16952 00000040:00080000:0.0:1788843871.536289:0:23445:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:0.0:1788843871.537330:0:23464:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:0.0:1788843871.537361:0:23464:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (ffff9bd0078bb370) 00000020:00000080:0.0:1788843871.537385:0:23464:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:0.0:1788843871.537468:0:23464:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9bd007394000 from lustre-MDT0001, refs=3 00000020:01000004:0.0:1788843871.537473:0:23464:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9bd007394000 from lustre-MDT0001, refs=3 00000020:01000004:0.0:1788843871.537475:0:23464:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9bd007394000 3 00010000:00080000:0.0:1788843871.537517:0:23464:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9bd137ae9800@lustre-MDT0000-lwp-MDT0001: add connection 192.168.203.133@tcp at head 00010000:00010000:0.0:1788843871.539135:0:23464:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-8 is initialized 00000020:00000080:0.0:1788843871.539373:0:23464:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:0.0:1788843871.539412:0:23464:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788843871.539424:0:23464:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0xa762dfcbd58d2b9c 00000100:00080000:0.0:1788843871.539434:0:23464:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788843871.539439:0:23464:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9bd137ae9800 using connection 192.168.203.133@tcp/0@lo 00000100:00100000:0.0:1788843871.539482:0:23464:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bd10f955180 x1875738134561280/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788843871.539501:0:23464:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1788843871.539534:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788843871.539539:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788843871.539541:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788843871.539544:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788843871.541196:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f955180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3629:1875738134561280:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788843871.541279:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843871.541366:0:22713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134561280 00000100:00100000:1.0:1788843871.541374:0:22713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134561280 00000100:00100000:1.0:1788843871.541407:0:22713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788843871.541423:0:22713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f961c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3629:x1875738134561280:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1788843871.541451:0:22713:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 649 last 0 00000020:00000080:1.0:1788843871.541488:0:22713:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0xa762dfcbd58d2ba3 00000004:00100000:1.0:1788843871.541504:0:22713:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788843871.541537:0:22713:0:(import.c:65:import_set_state_nolock()) ffff9bd00644e000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788843871.541593:0:22713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f961c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3629:x1875738134561280:12345-0@lo:38:llog_process_th.0 Request processed in 169us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843871.541601:0:22713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1788843871.541645:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9bd10f955180 x1875738134561280/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788843881 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788843871.541655:0:3629:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788843871.541664:0:3629:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 3 00000100:00080000:1.0:1788843871.541672:0:3629:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1788843871.541677:0:3629:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788843871.541680:0:3629:0:(import.c:65:import_set_state_nolock()) ffff9bd137ae9800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788843871.541687:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f955180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3629:1875738134561280:0@lo:38:llog_process_th.0 00000040:00080000:2.0:1788843871.542488:0:23464:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x12:0x0] index 52 count 51 00000020:01000000:0.0:1788843871.543514:0:23445:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1788843871.543548:0:23445:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.133@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788843871.543567:0:23445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd118f70400/0xa762dfcbd58d2b87 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d2b8e expref: -99 pid: 23445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843871.543578:0:23445:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.133@tcp lock: ffff9bd118f70400/0xa762dfcbd58d2b87 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d2b8e expref: -99 pid: 23445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788843871.543633:0:23445:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788843871.543635:0:23445:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1788843871.543637:0:23445:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788843871.543638:0:23445:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788843871.543639:0:23445:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788843871.543640:0:23445:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788843871.543645:0:23445:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788843871.543647:0:23445:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788843871.543648:0:23445:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788843871.543652:0:23445:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020001 00000020:01000004:0.0:1788843871.543654:0:23445:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788843871.543655:0:23445:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1788843871.543656:0:23445:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788843871.543657:0:23445:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788843871.543658:0:23445:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788843871.543659:0:23445:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788843871.543660:0:23445:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788843871.543661:0:23445:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788843871.543662:0:23445:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788843871.543684:0:23445:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:0.0:1788843871.543703:0:23445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f955180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ce589ba-8334-438e-8f48-13932fcba8b1:23445:1875738134561408:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788843871.543760:0:23445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843871.543794:0:23445:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd13331cf00 going to sleep for 11 seconds 00000100:00100000:1.0:1788843871.544960:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134561408 00000100:00100000:1.0:1788843871.544972:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134561408 00000100:00100000:1.0:1788843871.545033:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788843871.545045:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd102883c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ce589ba-8334-438e-8f48-13932fcba8b1+18:23445:x1875738134561408:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788843871.545078:0:22705:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1788843871.545104:0:22705:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000001:00100000:1.0:1788843871.549451:0:22691:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:0.0:1788843871.551216:0:22705:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788843871.551231:0:22705:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:0.0:1788843871.551924:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd102883c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ce589ba-8334-438e-8f48-13932fcba8b1+18:23445:x1875738134561408:12345-0@lo:253:mount.lustre.0 Request processed in 6876us (8157us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843871.551937:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788843871.552018:0:23445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f955180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ce589ba-8334-438e-8f48-13932fcba8b1:23445:1875738134561408:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788843871.552033:0:23445:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:0.0:1788843871.552036:0:23445:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788843871.552039:0:23445:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1788843871.552040:0:23445:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788843871.552041:0:23445:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788843871.552042:0:23445:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788843871.552044:0:23445:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788843871.552045:0:23445:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788843871.552047:0:23445:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788843871.552048:0:23445:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788843871.552062:0:23445:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:2.0:1788843871.556697:0:22727:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788843871.556708:0:22727:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788843871.556731:0:22727:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9bd1153e6400/0xa762dfcbd58d2baa lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843871.556750:0:22727:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bd007946200/0xa762dfcbd58d2aae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa762dfcbd58d2aa7 expref: 17 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843871.556758:0:22727:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bd1153e7800/0xa762dfcbd58d2b72 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa762dfcbd58d2b6b expref: 17 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843871.556765:0:22727:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9bd1153e6400/0xa762dfcbd58d2baa lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843871.556806:0:22727:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bd1153e7800/0xa762dfcbd58d2b72 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa762dfcbd58d2b6b expref: 17 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843871.556822:0:22727:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9bd1153e7800/0xa762dfcbd58d2b72 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa762dfcbd58d2b6b expref: 17 pid: 22706 timeout: 749 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843871.556837:0:22727:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f8d3800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22727:1875738134561536:0@lo:104: 00000100:00100000:2.0:1788843871.556903:0:22727:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788843871.556965:0:22727:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bd007946200/0xa762dfcbd58d2aae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa762dfcbd58d2aa7 expref: 17 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843871.556981:0:22727:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9bd007946200/0xa762dfcbd58d2aae lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa762dfcbd58d2aa7 expref: 17 pid: 22705 timeout: 749 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843871.556989:0:22727:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f8d1880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22727:1875738134561664:0@lo:104: 00000100:00100000:2.0:1788843871.557014:0:22727:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843871.557028:0:22727:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd13331c3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788843871.559416:0:22695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134561536 00000100:00100000:3.0:1788843871.559428:0:22695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134561536 00000100:00100000:3.0:1788843871.559517:0:22695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134561664 00000100:00100000:3.0:1788843871.559521:0:22695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134561664 00000100:00100000:3.0:1788843871.559542:0:22695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788843871.559553:0:22695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f8d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0ce589ba-8334-438e-8f48-13932fcba8b1+4:22727:x1875738134561536:12345-0@lo:104: 00010000:00010000:3.0:1788843871.559570:0:22695:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.133@tcp lock: ffff9bd118f71000/0xa762dfcbd58d2b6b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa762dfcbd58d2b72 expref: -99 pid: 23445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843871.559667:0:22695:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788843871.559673:0:22695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f8d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0ce589ba-8334-438e-8f48-13932fcba8b1+4:22727:x1875738134561536:12345-0@lo:104: Request processed in 123us (2771us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843871.559681:0:22695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788843871.559699:0:22695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788843871.559705:0:22695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f8d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0ce589ba-8334-438e-8f48-13932fcba8b1+3:22727:x1875738134561664:12345-0@lo:104: 00010000:00010000:3.0:1788843871.559713:0:22695:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.133@tcp lock: ffff9bd10f7ae600/0xa762dfcbd58d2aa7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa762dfcbd58d2aae expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843871.559774:0:22695:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788843871.559779:0:22695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f8d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0ce589ba-8334-438e-8f48-13932fcba8b1+3:22727:x1875738134561664:12345-0@lo:104: Request processed in 75us (2765us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843871.559786:0:22695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:1.0:1788843871.559792:0:22700:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788843871.559801:0:22700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.133@tcp lock: ffff9bd118f71000/0xa762dfcbd58d2b6b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa762dfcbd58d2b72 expref: -99 pid: 23445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843871.559821:0:22700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd118f71000 already unused, calling callback (ffffffffc12a7c20) 10000000:00010000:1.0:1788843871.559825:0:22700:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.133@tcp lock: ffff9bd118f71000/0xa762dfcbd58d2b6b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xa762dfcbd58d2b72 expref: -99 pid: 23445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843871.559835:0:22700:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.133@tcp lock: ffff9bd118f71000/0xa762dfcbd58d2b6b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xa762dfcbd58d2b72 expref: -99 pid: 23445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843871.559842:0:22727:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f8d3800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22727:1875738134561536:0@lo:104: 10000000:00010000:1.0:1788843871.559845:0:22700:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.133@tcp lock: ffff9bd118f71000/0xa762dfcbd58d2b6b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xa762dfcbd58d2b72 expref: -99 pid: 23445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788843871.559854:0:22700:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00000100:00100000:3.0:1788843871.559858:0:22727:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f8d1880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22727:1875738134561664:0@lo:104: 00010000:00010000:3.0:1788843871.559884:0:22727:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9bd1153e6400/0xa762dfcbd58d2baa lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843871.559892:0:22700:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.133@tcp lock: ffff9bd118f71000/0xa762dfcbd58d2b6b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa762dfcbd58d2b72 expref: -99 pid: 23445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843871.559900:0:22700:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788843871.559903:0:22699:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788843871.559921:0:22700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.133@tcp lock: ffff9bd118f71000/0xa762dfcbd58d2b6b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa762dfcbd58d2b72 expref: -99 pid: 23445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843871.559929:0:22700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.133@tcp lock: ffff9bd118f71000/0xa762dfcbd58d2b6b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa762dfcbd58d2b72 expref: -99 pid: 23445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843871.559942:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843871.559943:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843871.559945:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788843871.559964:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f961880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0ce589ba-8334-438e-8f48-13932fcba8b1:3630:1875738134561792:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788843871.560002:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843871.561346:0:22696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134561792 00000100:00100000:1.0:1788843871.561357:0:22696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134561792 00010000:00010000:1.0:1788843871.561391:0:22696:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bd1153e7800/0xa762dfcbd58d2b72 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa762dfcbd58d2b6b expref: 18 pid: 22706 timeout: 749 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843871.561431:0:22696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788843871.561438:0:22696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f962d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0ce589ba-8334-438e-8f48-13932fcba8b1+18:3630:x1875738134561792:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788843871.561450:0:22696:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788843871.561455:0:22696:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bd1153e7800/0xa762dfcbd58d2b72 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa762dfcbd58d2b6b expref: 18 pid: 22706 timeout: 749 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843871.561467:0:22696:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bd1153e7800/0xa762dfcbd58d2b72 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa762dfcbd58d2b6b expref: 18 pid: 22706 timeout: 749 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843871.561483:0:22696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd1153e7800/0xa762dfcbd58d2b72 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa762dfcbd58d2b6b expref: 18 pid: 22706 timeout: 749 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843871.561496:0:22696:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788843871.561543:0:22696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f962d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0ce589ba-8334-438e-8f48-13932fcba8b1+17:3630:x1875738134561792:12345-0@lo:103:ldlm_bl.0 Request processed in 105us (1541us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843871.561550:0:22696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788843871.561598:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f961880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0ce589ba-8334-438e-8f48-13932fcba8b1:3630:1875738134561792:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788843871.571446:0:23471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843871.571460:0:23471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843871.571463:0:23471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:0.0:1788843871.571829:0:23445:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000020:00080000:1.0:1788843871.571978:0:23470:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:1.0:1788843871.571983:0:23470:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:01000000:1.0:1788843871.572078:0:23472:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1788843871.572296:0:23445:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00010000:00010000:3.0:1788843871.572975:0:22699:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.133@tcp lock: ffff9bd10f7ae600/0xa762dfcbd58d2aa7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa762dfcbd58d2aae expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843871.572989:0:22699:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd10f7ae600 already unused, calling callback (ffffffffc12a7c20) 10000000:00010000:3.0:1788843871.572994:0:22699:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.133@tcp lock: ffff9bd10f7ae600/0xa762dfcbd58d2aa7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa762dfcbd58d2aae expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843871.573004:0:22699:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.133@tcp lock: ffff9bd10f7ae600/0xa762dfcbd58d2aa7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa762dfcbd58d2aae expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788843871.573018:0:22699:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.133@tcp lock: ffff9bd10f7ae600/0xa762dfcbd58d2aa7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa762dfcbd58d2aae expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788843871.573023:0:22699:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788843871.573076:0:22699:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.133@tcp lock: ffff9bd10f7ae600/0xa762dfcbd58d2aa7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa762dfcbd58d2aae expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843871.573083:0:22699:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788843871.573104:0:22699:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.133@tcp lock: ffff9bd10f7ae600/0xa762dfcbd58d2aa7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa762dfcbd58d2aae expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788843871.573104:0:23472:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00010000:00010000:3.0:1788843871.573113:0:22699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.133@tcp lock: ffff9bd10f7ae600/0xa762dfcbd58d2aa7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa762dfcbd58d2aae expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843871.573128:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788843871.573129:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788843871.573131:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788843871.573175:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd1074fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0ce589ba-8334-438e-8f48-13932fcba8b1:3631:1875738134561920:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788843871.573247:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843871.573317:0:22698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134561920 00000100:00100000:3.0:1788843871.573325:0:22698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134561920 00010000:00010000:3.0:1788843871.573361:0:22698:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bd007946200/0xa762dfcbd58d2aae lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa762dfcbd58d2aa7 expref: 17 pid: 22705 timeout: 749 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843871.573389:0:22698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788843871.573398:0:22698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1074fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0ce589ba-8334-438e-8f48-13932fcba8b1+17:3631:x1875738134561920:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788843871.573409:0:22698:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788843871.573414:0:22698:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bd007946200/0xa762dfcbd58d2aae lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa762dfcbd58d2aa7 expref: 17 pid: 22705 timeout: 749 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843871.573431:0:22698:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bd007946200/0xa762dfcbd58d2aae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa762dfcbd58d2aa7 expref: 17 pid: 22705 timeout: 749 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843871.573444:0:22698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd007946200/0xa762dfcbd58d2aae lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa762dfcbd58d2aa7 expref: 17 pid: 22705 timeout: 749 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843871.573462:0:22698:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9bd1153e6400/0xa762dfcbd58d2baa lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843871.573470:0:22698:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd1153e6400/0xa762dfcbd58d2baa lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788843871.573484:0:22698:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.016777481s 00010000:00010000:3.0:1788843871.573488:0:22698:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9bd1153e6400/0xa762dfcbd58d2baa lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843871.573494:0:22698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9bd1153e6400/0xa762dfcbd58d2baa lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843871.573501:0:22698:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9bd1153e6400/0xa762dfcbd58d2baa lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843871.573507:0:22698:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9bd1153e6400/0xa762dfcbd58d2baa lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843871.573512:0:22698:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd1153e6400 already unused, calling callback (ffffffffc0cb1420) 00010000:00010000:3.0:1788843871.573516:0:22698:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9bd1153e6400/0xa762dfcbd58d2baa lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843871.573533:0:22698:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9bd1153e6400/0xa762dfcbd58d2baa lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843871.573558:0:22698:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9bd1153e6400/0xa762dfcbd58d2baa lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843871.573569:0:22698:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788843871.573610:0:22698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1074fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0ce589ba-8334-438e-8f48-13932fcba8b1+16:3631:x1875738134561920:12345-0@lo:103:ldlm_bl.0 Request processed in 212us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843871.573618:0:22698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:3.0:1788843871.573650:0:22727:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9bd1153e6400/0xa762dfcbd58d2baa lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843871.573659:0:22727:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9bd1153e6400/0xa762dfcbd58d2baa lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843871.573666:0:22727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd1153e6400/0xa762dfcbd58d2baa lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843871.573701:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd1074fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0ce589ba-8334-438e-8f48-13932fcba8b1:3631:1875738134561920:0@lo:103:ldlm_bl.0 00000040:01000000:1.0:1788843871.575281:0:23445:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:1.0:1788843871.575335:0:23445:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:1.0:1788843871.575759:0:23445:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1788843871.575766:0:23445:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:1.0:1788843871.575801:0:23445:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788843871.576293:0:23473:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f8d0380 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23473:1875738134562048:0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1788843871.576379:0:23473:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843871.576414:0:23473:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd13331c540 going to sleep for 11 seconds 00000100:00100000:3.0:1788843871.576495:0:22717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134562048 00000100:00100000:3.0:1788843871.576505:0:22717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134562048 00000100:00100000:3.0:1788843871.576566:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788843871.576577:0:22717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f8d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:23473:x1875738134562048:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1788843871.576672:0:22717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f8d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:23473:x1875738134562048:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 97us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843871.576681:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788843871.576725:0:23473:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f8d0380 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23473:1875738134562048:0@lo:1000:lod0001_rec0000.0 00000040:01000000:3.0:1788843871.576769:0:23473:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:00080000:1.0:1788843871.576843:0:23445:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1788843871.577215:0:23472:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1788843871.577267:0:23472:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000100:00100000:3.0:1788843871.577271:0:23473:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd1074fd880 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23473:1875738134562176:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1788843871.577321:0:23473:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843871.577357:0:23473:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd110dec180 going to sleep for 11 seconds 00000100:00100000:2.0:1788843871.577406:0:22717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134562176 00000100:00100000:2.0:1788843871.577411:0:22717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134562176 00000100:00100000:2.0:1788843871.577443:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788843871.577451:0:22717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1074fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:23473:x1875738134562176:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1788843871.577568:0:22717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1074fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:23473:x1875738134562176:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 118us (245us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843871.577575:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788843871.577657:0:23473:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd1074fd880 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23473:1875738134562176:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1788843871.577710:0:23473:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd1074fd880 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:23473:1875738134562304:0@lo:900:lod0001_rec0000.0 00000100:00100000:3.0:1788843871.578082:0:23473:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843871.578108:0:23473:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd110dec600 going to sleep for 11 seconds 00000100:00100000:2.0:1788843871.578177:0:22722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134562304 00000100:00100000:2.0:1788843871.578182:0:22722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134562304 00000100:00100000:2.0:1788843871.578208:0:22722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788843871.578215:0:22722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1074fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23473:x1875738134562304:12345-0@lo:900:lod0001_rec0000.0 00000100:00100000:2.0:1788843871.578258:0:22722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1074fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23473:x1875738134562304:12345-0@lo:900:lod0001_rec0000.0 Request processed in 43us (177us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843871.578264:0:22722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788843871.578920:0:23473:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9bd1074fd880 x1875738134562304/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788843887 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788843871.578933:0:23473:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd1074fd880 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:23473:1875738134562304:0@lo:900:lod0001_rec0000.0 00000100:00100000:3.0:1788843871.578992:0:23473:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd1074fd880 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23473:1875738134562432:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1788843871.579027:0:23473:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843871.579055:0:23473:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd110dec180 going to sleep for 11 seconds 00000100:00100000:2.0:1788843871.579352:0:22717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134562432 00000100:00100000:2.0:1788843871.579358:0:22717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134562432 00000100:00100000:2.0:1788843871.579384:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788843871.579402:0:22717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1074fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:23473:x1875738134562432:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1788843871.579467:0:22717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1074fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:23473:x1875738134562432:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 66us (439us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843871.579474:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788843871.579617:0:23473:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd1074fd880 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23473:1875738134562432:0@lo:1000:lod0001_rec0000.0 00000040:00080000:3.0:1788843871.579663:0:23473:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788843871.580835:0:23445:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1788843871.580901:0:23445:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:1.0:1788843871.581301:0:23445:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:1.0:1788843871.582102:0:23445:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x30:0x0] (8/32) registered 00000001:00000004:1.0:1788843871.583957:0:23445:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 12884901888 00000040:00080000:3.0:1788843871.597401:0:23473:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1788843871.597498:0:23473:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1788843871.597504:0:23473:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00000001:00080000:1.0:1788843871.600319:0:23445:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1788843871.600374:0:23445:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffb2dcc1977988 00100000:10000000:1.0:1788843871.600384:0:23445:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:0.0:1788843871.602501:0:23445:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788843871.602625:0:23445:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.133@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788843871.602645:0:23445:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=48 00000080:00000004:0.0:1788843871.602672:0:23445:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:0.0:1788843871.605035:0:23445:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788843871.607824:0:23445:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788843871.835075:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788843872.474465:0:22754:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd13308b900 going to sleep for 0 seconds 00000040:00080000:1.0:1788843872.604107:0:23469:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788843872.858439:0:23471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788843873.499251:0:22754:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd13308b900 going to sleep for 0 seconds 10000000:01000000:1.0:1788843873.568305:0:22708:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788843873.568316:0:22708:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9bd007394000 from 12 10000000:01000000:1.0:1788843873.568323:0:22708:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788843873.568390:0:22708:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd007947c00/0xa762dfcbd58d2bb1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843873.568401:0:22708:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.133@tcp lock: ffff9bd007947c00/0xa762dfcbd58d2bb1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843873.568414:0:22708:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.133@tcp lock: ffff9bd007947c00/0xa762dfcbd58d2bb1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843873.568443:0:22708:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f961880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ce589ba-8334-438e-8f48-13932fcba8b1:22708:1875738134562560:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788843873.568527:0:22708:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843873.569787:0:22708:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd133094480 going to sleep for 11 seconds 00000100:00100000:3.0:1788843873.571126:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134562560 00000100:00100000:3.0:1788843873.571314:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134562560 00000100:00100000:3.0:1788843873.571393:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788843873.571404:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd102881450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ce589ba-8334-438e-8f48-13932fcba8b1+16:22708:x1875738134562560:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788843873.571421:0:22706:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788843873.571445:0:22706:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd1420e4400/0xa762dfcbd58d2bb8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa762dfcbd58d2bb1 expref: -99 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843873.571618:0:22706:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd1420e4400/0xa762dfcbd58d2bb8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa762dfcbd58d2bb1 expref: 17 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843873.571630:0:22706:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd1420e4400/0xa762dfcbd58d2bb8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa762dfcbd58d2bb1 expref: 17 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843873.571640:0:22706:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd1420e4400, rc 0) 00000100:00100000:3.0:1788843873.571732:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd102881450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ce589ba-8334-438e-8f48-13932fcba8b1+17:22708:x1875738134562560:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 330us (3205us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843873.571739:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788843873.571759:0:22708:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f961880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ce589ba-8334-438e-8f48-13932fcba8b1:22708:1875738134562560:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788843873.571782:0:22708:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.133@tcp lock: ffff9bd007947c00/0xa762dfcbd58d2bb1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d2bb8 expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843873.571792:0:22708:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.133@tcp lock: ffff9bd007947c00/0xa762dfcbd58d2bb1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa762dfcbd58d2bb8 expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843873.571870:0:22708:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f8d0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ce589ba-8334-438e-8f48-13932fcba8b1:22708:1875738134562688:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1788843873.571915:0:22708:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843873.572172:0:22708:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd0086e2780 going to sleep for 11 seconds 00000100:00100000:3.0:1788843873.575576:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134562688 00000100:00100000:3.0:1788843873.575595:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134562688 00000100:00100000:3.0:1788843873.575872:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788843873.575883:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd102883850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ce589ba-8334-438e-8f48-13932fcba8b1+17:22708:x1875738134562688:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788843873.575916:0:22705:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788843873.575944:0:22705:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788843873.575947:0:22705:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 12 00000100:00100000:3.0:1788843873.576116:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd102883850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ce589ba-8334-438e-8f48-13932fcba8b1+17:22708:x1875738134562688:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 234us (4199us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843873.576125:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788843873.576298:0:22708:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f8d0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ce589ba-8334-438e-8f48-13932fcba8b1:22708:1875738134562688:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1788843873.576383:0:22708:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.133@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788843873.576396:0:22708:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd007947c00/0xa762dfcbd58d2bb1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d2bb8 expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843873.576407:0:22708:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.133@tcp lock: ffff9bd007947c00/0xa762dfcbd58d2bb1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d2bb8 expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788843873.576419:0:22708:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788843873.576422:0:22708:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9bd127b94800 from 12 10000000:01000000:2.0:1788843873.576425:0:22708:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788843873.576462:0:22708:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd1153e7000/0xa762dfcbd58d2bbf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843873.576482:0:22708:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.133@tcp lock: ffff9bd1153e7000/0xa762dfcbd58d2bbf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843873.576492:0:22708:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.133@tcp lock: ffff9bd1153e7000/0xa762dfcbd58d2bbf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843873.576514:0:22708:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f8d0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ce589ba-8334-438e-8f48-13932fcba8b1:22708:1875738134562816:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788843873.576555:0:22708:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843873.576598:0:22708:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd0086e2780 going to sleep for 11 seconds 00000100:00100000:3.0:1788843873.576955:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134562816 00000100:00100000:3.0:1788843873.576962:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134562816 00000100:00100000:3.0:1788843873.577007:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788843873.577016:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd102883050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ce589ba-8334-438e-8f48-13932fcba8b1+17:22708:x1875738134562816:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788843873.577027:0:22706:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788843873.577044:0:22706:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd1420e4600/0xa762dfcbd58d2bc6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa762dfcbd58d2bbf expref: -99 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843873.577081:0:22706:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd1420e4600/0xa762dfcbd58d2bc6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa762dfcbd58d2bbf expref: 18 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843873.577093:0:22706:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd1420e4600/0xa762dfcbd58d2bc6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa762dfcbd58d2bbf expref: 18 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843873.577102:0:22706:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd1420e4600, rc 0) 00000100:00100000:3.0:1788843873.577163:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd102883050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ce589ba-8334-438e-8f48-13932fcba8b1+18:22708:x1875738134562816:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 125us (584us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843873.577169:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788843873.577597:0:22708:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f8d0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ce589ba-8334-438e-8f48-13932fcba8b1:22708:1875738134562816:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788843873.577690:0:22708:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.133@tcp lock: ffff9bd1153e7000/0xa762dfcbd58d2bbf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d2bc6 expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843873.577701:0:22708:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.133@tcp lock: ffff9bd1153e7000/0xa762dfcbd58d2bbf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa762dfcbd58d2bc6 expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843873.577757:0:22708:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f8d0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ce589ba-8334-438e-8f48-13932fcba8b1:22708:1875738134562944:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1788843873.577799:0:22708:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843873.577834:0:22708:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd0086e2780 going to sleep for 11 seconds 00000100:00100000:1.0:1788843873.578126:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134562944 00000100:00100000:1.0:1788843873.578209:0:22704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134562944 00000100:00100000:1.0:1788843873.578254:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788843873.578264:0:22704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd124fdb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ce589ba-8334-438e-8f48-13932fcba8b1+18:22708:x1875738134562944:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1788843873.578283:0:22704:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788843873.578300:0:22704:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788843873.578302:0:22704:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 12 00000100:00100000:1.0:1788843873.578404:0:22704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd124fdb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ce589ba-8334-438e-8f48-13932fcba8b1+18:22708:x1875738134562944:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 142us (604us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843873.578416:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788843873.579343:0:22708:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f8d0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ce589ba-8334-438e-8f48-13932fcba8b1:22708:1875738134562944:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1788843873.579410:0:22708:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.133@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788843873.579422:0:22708:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd1153e7000/0xa762dfcbd58d2bbf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d2bc6 expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843873.579433:0:22708:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.133@tcp lock: ffff9bd1153e7000/0xa762dfcbd58d2bbf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d2bc6 expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788843873.640045:0:23469:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788843873.882562:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788843874.522202:0:22754:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd13308b900 going to sleep for 0 seconds 00010000:00010000:2.0:1788843874.918831:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788843875.546206:0:22754:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd13308b900 going to sleep for 0 seconds 00010000:00010000:0.0:1788843875.931575:0:23471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788843876.222334:0:23716:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg333-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:0.0:1788843876.578783:0:22754:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd13308b900 going to sleep for 0 seconds 00000100:00080000:1.0:1788843876.763480:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788843876.763488:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1788843876.763493:0:38:0:(import.c:65:import_set_state_nolock()) ffff9bd10f906000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788843876.763507:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9bd10f906000 using connection 192.168.203.133@tcp/0@lo 00000100:00100000:1.0:1788843876.763534:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bd10f962680 x1875738134563200/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788843876.763549:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788843876.763553:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788843876.763556:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788843876.763559:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788843876.763591:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788843876.763595:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788843876.763597:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788843876.763600:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788843876.763607:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f961880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3633:1875738134563328:0@lo:400:kworker.0 00000100:00100000:0.0:1788843876.763685:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843876.763694:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f962300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0ce589ba-8334-438e-8f48-13932fcba8b1:3632:1875738134563072:0@lo:400:kworker.0 00000100:00100000:0.0:1788843876.763752:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134563328 00000100:00100000:0.0:1788843876.763759:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134563328 00000100:00100000:0.0:1788843876.763817:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788843876.763828:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f955180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3633:x1875738134563328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788843876.763882:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f955180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3633:x1875738134563328:12345-0@lo:400:kworker.0 Request processed in 56us (196us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843876.763890:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1788843876.763933:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9bd10f961880 x1875738134563328/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843892 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788843876.763946:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f961880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3633:1875738134563328:0@lo:400:kworker.0 00000100:00100000:2.0:1788843876.764281:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f962680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3629:1875738134563200:0@lo:38:kworker.0 00000100:00100000:2.0:1788843876.764330:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843876.764365:0:22717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134563200 00000100:00100000:2.0:1788843876.764369:0:22717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134563200 00000100:00100000:2.0:1788843876.764392:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788843876.764397:0:22717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f8d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3629:x1875738134563200:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1788843876.764428:0:22717:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 654 last 0 00000020:00000080:2.0:1788843876.764502:0:22717:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa762dfcbd58d2bcd 00000004:00100000:2.0:1788843876.764520:0:22717:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:2.0:1788843876.764527:0:22717:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 12884901888 00000100:00100000:0.0:1788843876.764938:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788843876.764948:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f8d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1875738134563712:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788843876.765173:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843876.765246:0:22716:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:2.0:1788843876.765256:0:22716:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:0.0:1788843876.765460:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134563712 00000100:00100000:0.0:1788843876.765466:0:22716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134563712 00000100:00100000:2.0:1788843876.765606:0:23743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788843876.765614:0:23743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f957100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3633:x1875738134563712:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788843876.765644:0:23743:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1788843876.765693:0:23743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f957100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3633:x1875738134563712:12345-0@lo:41:osp-pre-0-1.0 Request processed in 80us (520us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843876.765700:0:23743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788843876.765897:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f8d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1875738134563712:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788843876.766084:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843876.766159:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f960e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1875738134563456:0@lo:400:kworker.0 00000100:00100000:1.0:1788843876.766191:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843876.766211:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788843876.766217:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f963100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3630:1875738134563584:0@lo:400:kworker.0 00000100:00100000:1.0:1788843876.766243:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843876.766284:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134563584 00000100:00100000:1.0:1788843876.766289:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134563584 00000100:00100000:2.0:1788843876.766321:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134563072 00000100:00100000:2.0:1788843876.766325:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134563072 00000100:00100000:1.0:1788843876.766329:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788843876.766336:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f962a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3630:x1875738134563584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788843876.766352:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788843876.766358:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd124fd8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ce589ba-8334-438e-8f48-13932fcba8b1+18:3632:x1875738134563072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843876.766375:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f962a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3630:x1875738134563584:12345-0@lo:400:kworker.0 Request processed in 40us (132us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843876.766381:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788843876.766397:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd124fd8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ce589ba-8334-438e-8f48-13932fcba8b1+18:3632:x1875738134563072:12345-0@lo:400:kworker.0 Request processed in 39us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843876.766401:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134563456 00000100:00100000:2.0:1788843876.766403:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788843876.766404:0:22716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134563456 00000100:00100000:1.0:1788843876.766424:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788843876.766429:0:22716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f961180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3630:x1875738134563456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843876.766460:0:22716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f961180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3630:x1875738134563456:12345-0@lo:400:kworker.0 Request processed in 30us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843876.766466:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:1.0:1788843876.766492:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9bd10f963100 x1875738134563584/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843892 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788843876.766503:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f963100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3630:1875738134563584:0@lo:400:kworker.0 00000100:00100000:1.0:1788843876.766515:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f960e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1875738134563456:0@lo:400:kworker.0 00000100:00100000:1.0:1788843876.766541:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f962300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0ce589ba-8334-438e-8f48-13932fcba8b1:3632:1875738134563072:0@lo:400:kworker.0 00000100:00080000:2.0:1788843876.783059:0:22717:0:(import.c:65:import_set_state_nolock()) ffff9bd13fabb800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788843876.783182:0:22717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f8d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3629:x1875738134563200:12345-0@lo:38:kworker.0 Request processed in 18782us (18850us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843876.783194:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:3.0:1788843876.783237:0:3629:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 3 00000100:00080000:3.0:1788843876.783248:0:3629:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:3.0:1788843876.783254:0:3629:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1788843876.783257:0:3629:0:(import.c:65:import_set_state_nolock()) ffff9bd10f906000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:3.0:1788843876.783282:0:3629:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000abedbccc): req@ffff9bd10f961500 x1875738134556288/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788843876.783311:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f962680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3629:1875738134563200:0@lo:38:kworker.0 00000100:00100000:3.0:1788843876.783421:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f8d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1875738134563840:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788843876.783462:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843876.783535:0:23743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134563840 00000100:00100000:2.0:1788843876.783542:0:23743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134563840 00000100:00100000:2.0:1788843876.783587:0:23743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788843876.783597:0:23743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1074fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3633:x1875738134563840:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788843876.783623:0:23743:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788843876.783661:0:23743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1074fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3633:x1875738134563840:12345-0@lo:41:osp-pre-1-0.0 Request processed in 66us (200us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843876.783668:0:23743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788843876.783839:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f8d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1875738134563840:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788843876.783966:0:22754:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843876.783999:0:22754:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd13308b900 going to sleep for 11 seconds 00000100:00100000:2.0:1788843876.784180:0:22717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134556288 00000100:00100000:2.0:1788843876.784184:0:22717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134556288 00000100:00100000:2.0:1788843876.784213:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788843876.784220:0:22717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f962300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22754:x1875738134556288:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1788843876.784348:0:22754:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f961500 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22754:1875738134556288:0@lo:1000:lod0000_rec0001.0 00000040:01000000:1.0:1788843876.784380:0:22754:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:1.0:1788843876.784415:0:22754:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f961500 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22754:1875738134563968:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1788843876.784459:0:22717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f962300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22754:x1875738134556288:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 239us (493us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843876.784467:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788843876.784640:0:22754:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843876.784671:0:22754:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd13e936180 going to sleep for 11 seconds 00000100:00100000:3.0:1788843876.784885:0:23743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134563968 00000100:00100000:3.0:1788843876.784890:0:23743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134563968 00000100:00100000:3.0:1788843876.784990:0:23743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788843876.784999:0:23743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f960e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:22754:x1875738134563968:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1788843876.785199:0:23743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f960e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:22754:x1875738134563968:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 202us (561us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843876.785207:0:23743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788843876.785457:0:22754:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f961500 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22754:1875738134563968:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1788843876.785900:0:22754:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f961500 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22754:1875738134564096:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1788843876.785936:0:22754:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843876.786123:0:22717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134564096 00000100:00100000:3.0:1788843876.786129:0:22717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134564096 00000100:00100000:3.0:1788843876.786184:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788843876.786192:0:22717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f963100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22754:x1875738134564096:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1788843876.786250:0:22717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f963100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22754:x1875738134564096:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 59us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843876.786257:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788843876.786372:0:22754:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd13e936180 going to sleep for 11 seconds 00000100:00100000:1.0:1788843876.786390:0:22754:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f961500 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22754:1875738134564096:0@lo:1000:lod0000_rec0001.0 00000040:00080000:1.0:1788843876.786434:0:22754:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788843876.790357:0:22754:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1788843876.790454:0:22754:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 19, retries 0 00000004:00080000:1.0:1788843876.790459:0:22754:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:0.0:1788843876.956222:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788843877.136664:0:23769:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788843877.138756:0:23769:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788843877.979726:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788843878.024882:0:23819:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788843878.025414:0:23819:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788843879.003474:0:23471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788843879.063113:0:23868:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe091fab30 20000000:00000080:2.0:1788843879.063137:0:23868:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9bd140cc8400 uarg=0000000000000000 20000000:01000000:2.0:1788843879.063231:0:23868:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:2.0:1788843879.063246:0:23868:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:2.0:1788843879.063252:0:23868:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:2.0:1788843879.065592:0:23869:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 13 20000000:00000400:3.0:1788843879.065678:0:23868:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:3.0:1788843879.072701:0:23868:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1788843879.072879:0:23868:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9bd1420e4200/0xa762dfcbd58d2bd4 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843879.072904:0:23868:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bd007947a00/0xa762dfcbd58d2a7d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa762dfcbd58d2a76 expref: 17 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843879.072914:0:23868:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bd1153e6200/0xa762dfcbd58d2b80 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa762dfcbd58d2b79 expref: 17 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843879.072923:0:23868:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9bd1420e4200/0xa762dfcbd58d2bd4 lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 23868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843879.073043:0:23868:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bd1153e6200/0xa762dfcbd58d2b80 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa762dfcbd58d2b79 expref: 17 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843879.073085:0:23868:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9bd1153e6200/0xa762dfcbd58d2b80 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa762dfcbd58d2b79 expref: 17 pid: 22706 timeout: 757 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843879.073102:0:23868:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd1074fca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23868:1875738134564224:0@lo:104: 00000100:00100000:3.0:1788843879.073562:0:23868:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788843879.073661:0:23868:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bd007947a00/0xa762dfcbd58d2a7d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa762dfcbd58d2a76 expref: 17 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843879.073670:0:23868:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9bd007947a00/0xa762dfcbd58d2a7d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa762dfcbd58d2a76 expref: 17 pid: 22704 timeout: 757 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843879.073679:0:23868:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd1074fdf80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23868:1875738134564352:0@lo:104: 00000100:00100000:3.0:1788843879.073704:0:23868:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843879.076098:0:23868:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd13e9c4840 going to sleep for 11 seconds 00000100:00100000:2.0:1788843879.078442:0:22694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134564224 00000100:00100000:2.0:1788843879.078464:0:22694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134564224 00000100:00100000:2.0:1788843879.078543:0:22694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134564352 00000100:00100000:2.0:1788843879.078547:0:22694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134564352 00000100:00100000:2.0:1788843879.078568:0:22694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788843879.078580:0:22694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1074ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0ce589ba-8334-438e-8f48-13932fcba8b1+4:23868:x1875738134564224:12345-0@lo:104: 00010000:00010000:2.0:1788843879.078602:0:22694:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.133@tcp lock: ffff9bd118f70600/0xa762dfcbd58d2b79 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa762dfcbd58d2b80 expref: -99 pid: 23445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843879.079437:0:22694:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788843879.079449:0:22694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1074ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0ce589ba-8334-438e-8f48-13932fcba8b1+4:23868:x1875738134564224:12345-0@lo:104: Request processed in 870us (5888us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843879.079459:0:22694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788843879.079483:0:22694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788843879.079492:0:22694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1074ff480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0ce589ba-8334-438e-8f48-13932fcba8b1+3:23868:x1875738134564352:12345-0@lo:104: 00010000:00010000:3.0:1788843879.079505:0:22694:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.133@tcp lock: ffff9bd118f70000/0xa762dfcbd58d2a76 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa762dfcbd58d2a7d expref: -99 pid: 22690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843879.079559:0:22694:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788843879.079564:0:22694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1074ff480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0ce589ba-8334-438e-8f48-13932fcba8b1+3:23868:x1875738134564352:12345-0@lo:104: Request processed in 76us (5860us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843879.079571:0:22694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788843879.079682:0:23868:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd1074fca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23868:1875738134564224:0@lo:104: 00000100:00100000:2.0:1788843879.079695:0:23868:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd1074fdf80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23868:1875738134564352:0@lo:104: 00010000:00010000:2.0:1788843879.079725:0:23868:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9bd1420e4200/0xa762dfcbd58d2bd4 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 23868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843879.079985:0:22700:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788843879.079994:0:22700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.133@tcp lock: ffff9bd118f70600/0xa762dfcbd58d2b79 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa762dfcbd58d2b80 expref: -99 pid: 23445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843879.080004:0:22700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd118f70600 already unused, calling callback (ffffffffc12a7c20) 10000000:00010000:1.0:1788843879.080009:0:22700:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.133@tcp lock: ffff9bd118f70600/0xa762dfcbd58d2b79 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xa762dfcbd58d2b80 expref: -99 pid: 23445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843879.080019:0:22700:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.133@tcp lock: ffff9bd118f70600/0xa762dfcbd58d2b79 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xa762dfcbd58d2b80 expref: -99 pid: 23445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788843879.080027:0:22700:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.133@tcp lock: ffff9bd118f70600/0xa762dfcbd58d2b79 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xa762dfcbd58d2b80 expref: -99 pid: 23445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788843879.080033:0:22700:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788843879.080083:0:22700:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.133@tcp lock: ffff9bd118f70600/0xa762dfcbd58d2b79 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa762dfcbd58d2b80 expref: -99 pid: 23445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843879.080090:0:22700:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788843879.080130:0:22700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.133@tcp lock: ffff9bd118f70600/0xa762dfcbd58d2b79 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa762dfcbd58d2b80 expref: -99 pid: 23445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843879.080138:0:22700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.133@tcp lock: ffff9bd118f70600/0xa762dfcbd58d2b79 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa762dfcbd58d2b80 expref: -99 pid: 23445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843879.080171:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f961500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0ce589ba-8334-438e-8f48-13932fcba8b1:3630:1875738134564480:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788843879.080172:0:22700:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788843879.080176:0:22700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.133@tcp lock: ffff9bd118f70000/0xa762dfcbd58d2a76 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa762dfcbd58d2a7d expref: -99 pid: 22690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843879.080181:0:22700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd118f70000 already unused, calling callback (ffffffffc12a7c20) 10000000:00010000:1.0:1788843879.080184:0:22700:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.133@tcp lock: ffff9bd118f70000/0xa762dfcbd58d2a76 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa762dfcbd58d2a7d expref: -99 pid: 22690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843879.080191:0:22700:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.133@tcp lock: ffff9bd118f70000/0xa762dfcbd58d2a76 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa762dfcbd58d2a7d expref: -99 pid: 22690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788843879.080196:0:22700:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.133@tcp lock: ffff9bd118f70000/0xa762dfcbd58d2a76 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa762dfcbd58d2a7d expref: -99 pid: 22690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788843879.080201:0:22700:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:2.0:1788843879.080219:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788843879.080221:0:22700:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.133@tcp lock: ffff9bd118f70000/0xa762dfcbd58d2a76 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa762dfcbd58d2a7d expref: -99 pid: 22690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843879.080227:0:22700:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788843879.080233:0:22700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.133@tcp lock: ffff9bd118f70000/0xa762dfcbd58d2a76 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa762dfcbd58d2a7d expref: -99 pid: 22690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843879.080240:0:22700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.133@tcp lock: ffff9bd118f70000/0xa762dfcbd58d2a76 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa762dfcbd58d2a7d expref: -99 pid: 22690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843879.080263:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843879.080265:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788843879.080267:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:1.0:1788843879.080267:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788843879.080273:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f963800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0ce589ba-8334-438e-8f48-13932fcba8b1:3630:1875738134564608:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788843879.080306:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843879.080356:0:22696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134564480 00000100:00100000:1.0:1788843879.080362:0:22696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134564480 00010000:00010000:1.0:1788843879.080390:0:22696:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bd1153e6200/0xa762dfcbd58d2b80 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa762dfcbd58d2b79 expref: 18 pid: 22706 timeout: 757 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843879.080422:0:22696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134564608 00000100:00100000:1.0:1788843879.080426:0:22696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134564608 00000100:00100000:3.0:1788843879.080432:0:22698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00010000:00010000:1.0:1788843879.080437:0:22696:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bd007947a00/0xa762dfcbd58d2a7d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa762dfcbd58d2a76 expref: 19 pid: 22704 timeout: 757 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843879.080442:0:22698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f8d0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0ce589ba-8334-438e-8f48-13932fcba8b1+19:3630:x1875738134564480:12345-0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788843879.080449:0:22696:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00010000:00010000:3.0:1788843879.080455:0:22698:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1788843879.080455:0:22696:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:3.0:1788843879.080461:0:22698:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bd1153e6200/0xa762dfcbd58d2b80 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa762dfcbd58d2b79 expref: 19 pid: 22706 timeout: 757 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843879.080473:0:22698:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bd1153e6200/0xa762dfcbd58d2b80 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa762dfcbd58d2b79 expref: 19 pid: 22706 timeout: 757 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843879.080490:0:22698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd1153e6200/0xa762dfcbd58d2b80 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa762dfcbd58d2b79 expref: 19 pid: 22706 timeout: 757 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843879.080503:0:22698:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788843879.080508:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788843879.080544:0:22698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f8d0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0ce589ba-8334-438e-8f48-13932fcba8b1+18:3630:x1875738134564480:12345-0@lo:103:ldlm_bl.0 Request processed in 104us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843879.080551:0:22698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788843879.080569:0:22698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788843879.080575:0:22698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f8d1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0ce589ba-8334-438e-8f48-13932fcba8b1+17:3630:x1875738134564608:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788843879.080581:0:22698:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788843879.080585:0:22698:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bd007947a00/0xa762dfcbd58d2a7d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa762dfcbd58d2a76 expref: 17 pid: 22704 timeout: 757 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843879.080592:0:22698:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bd007947a00/0xa762dfcbd58d2a7d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa762dfcbd58d2a76 expref: 17 pid: 22704 timeout: 757 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843879.080602:0:22698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd007947a00/0xa762dfcbd58d2a7d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa762dfcbd58d2a76 expref: 17 pid: 22704 timeout: 757 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843879.080614:0:22698:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9bd1420e4200/0xa762dfcbd58d2bd4 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 23868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843879.080627:0:22698:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd1420e4200/0xa762dfcbd58d2bd4 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 23868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843879.080645:0:22698:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9bd1420e4200/0xa762dfcbd58d2bd4 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 23868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843879.080652:0:22698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9bd1420e4200/0xa762dfcbd58d2bd4 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 23868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843879.080660:0:22698:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9bd1420e4200/0xa762dfcbd58d2bd4 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 23868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843879.080666:0:22698:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9bd1420e4200/0xa762dfcbd58d2bd4 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 23868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843879.080671:0:22698:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd1420e4200 already unused, calling callback (ffffffffc0cb1420) 00010000:00010000:3.0:1788843879.080676:0:22698:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9bd1420e4200/0xa762dfcbd58d2bd4 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 23868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843879.080683:0:22698:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9bd1420e4200/0xa762dfcbd58d2bd4 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 23868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843879.080694:0:22698:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9bd1420e4200/0xa762dfcbd58d2bd4 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843879.080702:0:22698:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788843879.080718:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f961500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0ce589ba-8334-438e-8f48-13932fcba8b1:3630:1875738134564480:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788843879.080726:0:22698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f8d1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0ce589ba-8334-438e-8f48-13932fcba8b1+16:3630:x1875738134564608:12345-0@lo:103:ldlm_bl.0 Request processed in 152us (419us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843879.080732:0:22698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788843879.080733:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f963800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0ce589ba-8334-438e-8f48-13932fcba8b1:3630:1875738134564608:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788843879.080897:0:23868:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9bd1420e4200/0xa762dfcbd58d2bd4 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843879.080906:0:23868:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9bd1420e4200/0xa762dfcbd58d2bd4 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843879.080912:0:23868:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd1420e4200/0xa762dfcbd58d2bd4 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788843879.588543:0:22748:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788843880.028180:0:23471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788843880.538244:0:22708:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788843880.538251:0:22708:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9bd007394000 from 13 10000000:01000000:1.0:1788843880.538256:0:22708:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788843880.538315:0:22708:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd007947000/0xa762dfcbd58d2bdb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843880.538328:0:22708:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.133@tcp lock: ffff9bd007947000/0xa762dfcbd58d2bdb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843880.538339:0:22708:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.133@tcp lock: ffff9bd007947000/0xa762dfcbd58d2bdb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843880.538467:0:22708:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f963800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ce589ba-8334-438e-8f48-13932fcba8b1:22708:1875738134564736:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788843880.538546:0:22708:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843880.538647:0:22708:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd13e936f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788843880.547252:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134564736 00000100:00100000:2.0:1788843880.547267:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134564736 00000100:00100000:2.0:1788843880.547413:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788843880.547425:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd124fd9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ce589ba-8334-438e-8f48-13932fcba8b1+16:22708:x1875738134564736:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788843880.547443:0:22706:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788843880.547464:0:22706:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd1153e7a00/0xa762dfcbd58d2be2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa762dfcbd58d2bdb expref: -99 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843880.547493:0:22706:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd1153e7a00/0xa762dfcbd58d2be2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa762dfcbd58d2bdb expref: 17 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843880.547504:0:22706:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd1153e7a00/0xa762dfcbd58d2be2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa762dfcbd58d2bdb expref: 17 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843880.547514:0:22706:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd1153e7a00, rc 0) 00000100:00100000:2.0:1788843880.547614:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd124fd9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ce589ba-8334-438e-8f48-13932fcba8b1+17:22708:x1875738134564736:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 191us (9068us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843880.547621:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788843880.553251:0:22708:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f963800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ce589ba-8334-438e-8f48-13932fcba8b1:22708:1875738134564736:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788843880.553296:0:22708:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.133@tcp lock: ffff9bd007947000/0xa762dfcbd58d2bdb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d2be2 expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843880.553310:0:22708:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.133@tcp lock: ffff9bd007947000/0xa762dfcbd58d2bdb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa762dfcbd58d2be2 expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843880.553427:0:22708:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f954000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ce589ba-8334-438e-8f48-13932fcba8b1:22708:1875738134564864:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788843880.553492:0:22708:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843880.559200:0:22708:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd10764a9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788843880.561603:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134564864 00000100:00100000:1.0:1788843880.561617:0:22704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134564864 00000100:00100000:1.0:1788843880.561681:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788843880.561693:0:22704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd124fdb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ce589ba-8334-438e-8f48-13932fcba8b1+17:22708:x1875738134564864:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788843880.562849:0:22704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd124fdb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ce589ba-8334-438e-8f48-13932fcba8b1+17:22708:x1875738134564864:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1154us (9352us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843880.562860:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788843880.563601:0:22708:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f954000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ce589ba-8334-438e-8f48-13932fcba8b1:22708:1875738134564864:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788843880.563661:0:22708:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f961500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ce589ba-8334-438e-8f48-13932fcba8b1:22708:1875738134564992:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788843880.563718:0:22708:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843880.565572:0:22708:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd13e936c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788843880.567882:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134564992 00000100:00100000:0.0:1788843880.567897:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134564992 00000100:00100000:2.0:1788843880.568061:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788843880.568075:0:22704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd124fd9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ce589ba-8334-438e-8f48-13932fcba8b1+17:22708:x1875738134564992:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788843880.568294:0:22704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd124fd9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ce589ba-8334-438e-8f48-13932fcba8b1+17:22708:x1875738134564992:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 221us (4574us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843880.568302:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788843880.568713:0:22708:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f961500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ce589ba-8334-438e-8f48-13932fcba8b1:22708:1875738134564992:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788843880.570641:0:23932:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1788843880.571551:0:22708:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1788843880.571582:0:22708:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.133@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788843880.571595:0:22708:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd007947000/0xa762dfcbd58d2bdb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d2be2 expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843880.571608:0:22708:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.133@tcp lock: ffff9bd007947000/0xa762dfcbd58d2bdb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d2be2 expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788843880.571619:0:22708:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788843880.571622:0:22708:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9bd127b94800 from 13 10000000:01000000:3.0:1788843880.571625:0:22708:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788843880.571670:0:22708:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd1420e4800/0xa762dfcbd58d2be9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843880.571678:0:22708:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.133@tcp lock: ffff9bd1420e4800/0xa762dfcbd58d2be9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843880.571698:0:22708:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.133@tcp lock: ffff9bd1420e4800/0xa762dfcbd58d2be9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843880.571734:0:22708:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd1074ff800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ce589ba-8334-438e-8f48-13932fcba8b1:22708:1875738134565120:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788843880.571808:0:22708:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843880.571849:0:22708:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd111590300 going to sleep for 11 seconds 00000100:00100000:3.0:1788843880.571882:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134565120 00000100:00100000:3.0:1788843880.571888:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134565120 00000100:00100000:3.0:1788843880.571932:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788843880.571942:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd124fd8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ce589ba-8334-438e-8f48-13932fcba8b1+17:22708:x1875738134565120:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788843880.572522:0:22706:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788843880.572584:0:22706:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd1153e6600/0xa762dfcbd58d2bf0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa762dfcbd58d2be9 expref: -99 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843880.572622:0:22706:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd1153e6600/0xa762dfcbd58d2bf0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa762dfcbd58d2be9 expref: 18 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843880.572632:0:22706:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd1153e6600/0xa762dfcbd58d2bf0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa762dfcbd58d2be9 expref: 18 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843880.572641:0:22706:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd1153e6600, rc 0) 00000100:00100000:2.0:1788843880.572700:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd124fd8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ce589ba-8334-438e-8f48-13932fcba8b1+18:22708:x1875738134565120:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 759us (893us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843880.572707:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788843880.576712:0:22708:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd1074ff800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ce589ba-8334-438e-8f48-13932fcba8b1:22708:1875738134565120:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788843880.576768:0:22708:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.133@tcp lock: ffff9bd1420e4800/0xa762dfcbd58d2be9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d2bf0 expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843880.576781:0:22708:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.133@tcp lock: ffff9bd1420e4800/0xa762dfcbd58d2be9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa762dfcbd58d2bf0 expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843880.576868:0:22708:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd1074ff800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ce589ba-8334-438e-8f48-13932fcba8b1:22708:1875738134565248:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788843880.576930:0:22708:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843880.576974:0:22708:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd111590300 going to sleep for 11 seconds 00000100:00100000:0.0:1788843880.577334:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134565248 00000100:00100000:0.0:1788843880.577342:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134565248 00000100:00100000:0.0:1788843880.577406:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788843880.577417:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd124fd9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ce589ba-8334-438e-8f48-13932fcba8b1+18:22708:x1875738134565248:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788843880.577569:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd124fd9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ce589ba-8334-438e-8f48-13932fcba8b1+18:22708:x1875738134565248:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 153us (639us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843880.577577:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788843880.577919:0:22708:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd1074ff800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ce589ba-8334-438e-8f48-13932fcba8b1:22708:1875738134565248:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788843880.577967:0:22708:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd1074ff800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ce589ba-8334-438e-8f48-13932fcba8b1:22708:1875738134565376:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788843880.578008:0:22708:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843880.578044:0:22708:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd111590300 going to sleep for 11 seconds 00000100:00100000:0.0:1788843880.578290:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134565376 00000100:00100000:0.0:1788843880.578296:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134565376 00000100:00100000:0.0:1788843880.578326:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788843880.578334:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd124fd8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ce589ba-8334-438e-8f48-13932fcba8b1+18:22708:x1875738134565376:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788843880.578575:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd124fd8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ce589ba-8334-438e-8f48-13932fcba8b1+18:22708:x1875738134565376:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 240us (566us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843880.578582:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788843880.578665:0:22708:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd1074ff800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ce589ba-8334-438e-8f48-13932fcba8b1:22708:1875738134565376:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788843880.580891:0:23934:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1788843880.581659:0:22708:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1788843880.581700:0:22708:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.133@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788843880.581713:0:22708:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd1420e4800/0xa762dfcbd58d2be9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d2bf0 expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843880.581822:0:22708:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.133@tcp lock: ffff9bd1420e4800/0xa762dfcbd58d2be9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d2bf0 expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843881.050348:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788843881.882315:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788843881.882321:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788843881.882324:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788843881.882327:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788843881.882353:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788843881.882356:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788843881.882358:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788843881.882361:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788843881.882430:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f961500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0ce589ba-8334-438e-8f48-13932fcba8b1:3632:1875738134565504:0@lo:400:kworker.0 00000100:00100000:1.0:1788843881.882500:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843881.882560:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd1203d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3632:1875738134566016:0@lo:400:kworker.0 00000100:00100000:1.0:1788843881.882588:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843881.882614:0:3632:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788843881.882619:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f963800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1875738134565632:0@lo:400:kworker.0 00000100:00100000:1.0:1788843881.882643:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843881.882673:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f962680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3630:1875738134565760:0@lo:400:kworker.0 00000100:00100000:1.0:1788843881.882697:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843881.882712:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788843881.882717:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f961880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1875738134565888:0@lo:400:kworker.0 00000100:00100000:1.0:1788843881.882737:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843881.882770:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134565504 00000100:00100000:1.0:1788843881.882778:0:22704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134565504 00000100:00100000:1.0:1788843881.882825:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788843881.882834:0:22704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd124fd8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ce589ba-8334-438e-8f48-13932fcba8b1+18:3632:x1875738134565504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843881.882883:0:22704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd124fd8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ce589ba-8334-438e-8f48-13932fcba8b1+18:3632:x1875738134565504:12345-0@lo:400:kworker.0 Request processed in 50us (383us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843881.882890:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788843881.882920:0:22713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134566016 00000100:00100000:1.0:1788843881.882924:0:22713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134566016 00000100:00100000:3.0:1788843881.883483:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd1074ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1875738134566144:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788843881.883515:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843881.883562:0:23743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134565632 00000100:00100000:3.0:1788843881.883568:0:23743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134565632 00000100:00100000:3.0:1788843881.883589:0:23743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134565888 00000100:00100000:3.0:1788843881.883592:0:23743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134565888 00000100:00100000:3.0:1788843881.883602:0:23743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134566144 00000100:00100000:3.0:1788843881.883604:0:23743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134566144 00000100:00100000:3.0:1788843881.883613:0:23743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788843881.883620:0:23743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1203d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:3632:x1875738134565632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788843881.883658:0:23743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1203d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:3632:x1875738134565632:12345-0@lo:400:kworker.0 Request processed in 37us (1013us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843881.883673:0:23743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788843881.883687:0:23743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788843881.883693:0:23743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1203d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3630:x1875738134565888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788843881.883726:0:23743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1203d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3630:x1875738134565888:12345-0@lo:400:kworker.0 Request processed in 33us (988us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843881.883732:0:23743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788843881.883743:0:23743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788843881.883748:0:23743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1074fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3633:x1875738134566144:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788843881.883769:0:23743:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788843881.883802:0:23743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1074fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3633:x1875738134566144:12345-0@lo:41:osp-pre-1-0.0 Request processed in 53us (286us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843881.883808:0:23743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788843881.883844:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd1074ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1875738134566144:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788843881.883870:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f961880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1875738134565888:0@lo:400:kworker.0 00000100:00100000:1.0:1788843881.884046:0:22713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134565760 00000100:00100000:1.0:1788843881.884050:0:22713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134565760 00000100:00100000:1.0:1788843881.884065:0:22713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788843881.884071:0:22713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1203d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3632:x1875738134566016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843881.884103:0:22713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1203d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3632:x1875738134566016:12345-0@lo:400:kworker.0 Request processed in 32us (1515us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843881.884115:0:22713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788843881.884127:0:22713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788843881.884132:0:22713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1203d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3630:x1875738134565760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843881.884184:0:22713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1203d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3630:x1875738134565760:12345-0@lo:400:kworker.0 Request processed in 52us (1487us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843881.884190:0:22713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788843881.884287:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f963800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1875738134565632:0@lo:400:kworker.0 00000100:00100000:1.0:1788843881.884296:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f961500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0ce589ba-8334-438e-8f48-13932fcba8b1:3632:1875738134565504:0@lo:400:kworker.0 00010000:00080000:1.0:1788843881.884308:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9bd1203d1c00 x1875738134566016/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843897 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788843881.884317:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd1203d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3632:1875738134566016:0@lo:400:kworker.0 00000100:00100000:2.0:1788843881.889680:0:3631:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788843881.889704:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f8d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1875738134566272:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788843881.889781:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843881.889837:0:23743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134566272 00000100:00100000:2.0:1788843881.889845:0:23743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134566272 00000100:00100000:2.0:1788843881.889895:0:23743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788843881.889904:0:23743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f8d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3631:x1875738134566272:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788843881.889940:0:23743:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1788843881.889986:0:23743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f8d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3631:x1875738134566272:12345-0@lo:41:osp-pre-0-1.0 Request processed in 83us (206us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843881.889994:0:23743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788843881.890043:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f8d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1875738134566272:0@lo:41:osp-pre-0-1.0 00010000:00080000:3.0:1788843881.891090:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9bd10f962680 x1875738134565760/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843897 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788843881.891105:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f962680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3630:1875738134565760:0@lo:400:kworker.0 00000100:00100000:3.0:1788843881.891952:0:3629:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788843871/real 1788843871] req@ffff9bd10f8d2680 x1875738134559488/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788843881 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788843881.891974:0:3629:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9bd10f8d2680 x1875738134559488/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788843881 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788843881.891985:0:3629:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788843871/real 1788843871] req@ffff9bd10f956300 x1875738134559360/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788843881 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788843881.892016:0:3629:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9bd10f956300 x1875738134559360/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788843881 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788843881.892025:0:3629:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788843866/real 1788843866] req@ffff9bd10f955c00 x1875738134557312/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788843881 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788843881.892035:0:3629:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9bd10f955c00 x1875738134557312/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788843881 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788843881.892044:0:3629:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788843866/real 1788843866] req@ffff9bd10f956d80 x1875738134557440/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788843881 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788843881.892053:0:3629:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9bd10f956d80 x1875738134557440/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788843881 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788843881.892068:0:3629:0:(import.c:65:import_set_state_nolock()) ffff9bd112389800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788843881.892085:0:3629:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788843881.892088:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f8d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3629:1875738134559488:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1788843881.892093:0:3629:0:(import.c:65:import_set_state_nolock()) ffff9bd13fabb000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788843881.892098:0:3629:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788843881.892101:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f956300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3629:1875738134559360:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1788843881.892105:0:3629:0:(import.c:65:import_set_state_nolock()) ffff9bd10f7b9800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788843881.892109:0:3629:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788843881.892112:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f955c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3629:1875738134557312:0@lo:8:kworker.0 00000100:00080000:3.0:1788843881.892116:0:3629:0:(import.c:65:import_set_state_nolock()) ffff9bd0059c6000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788843881.892119:0:3629:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788843881.892122:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f956d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3629:1875738134557440:0@lo:8:kworker.0 00000100:00080000:1.0:1788843881.895865:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788843881.895876:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1788843881.895880:0:38:0:(import.c:65:import_set_state_nolock()) ffff9bd10f7b9800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788843881.895889:0:38:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 644 00000100:00080000:1.0:1788843881.895895:0:38:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788843881.895903:0:38:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9bd10f7b9800 using connection 192.168.203.133@tcp/0@lo 00000100:00100000:1.0:1788843881.895945:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bd1203d1c00 x1875738134566400/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788843881.895969:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788843881.895973:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788843881.895975:0:38:0:(import.c:65:import_set_state_nolock()) ffff9bd0059c6000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788843881.895978:0:38:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 644 00000100:00080000:1.0:1788843881.895989:0:38:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788843881.895994:0:38:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9bd0059c6000 using connection 192.168.203.133@tcp/0@lo 00000100:00100000:1.0:1788843881.896008:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bd1203d1f80 x1875738134566528/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788843881.896018:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788843881.896021:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1788843881.896023:0:38:0:(import.c:65:import_set_state_nolock()) ffff9bd13fabb000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788843881.896026:0:38:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 649 00000100:00080000:1.0:1788843881.896028:0:38:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788843881.896032:0:38:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9bd13fabb000 using connection 192.168.203.133@tcp/0@lo 00000100:00100000:1.0:1788843881.896041:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bd1203d0000 x1875738134566656/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788843881.896050:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788843881.896052:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788843881.896054:0:38:0:(import.c:65:import_set_state_nolock()) ffff9bd112389800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788843881.896057:0:38:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 649 00000100:00080000:1.0:1788843881.896059:0:38:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788843881.896063:0:38:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9bd112389800 using connection 192.168.203.133@tcp/0@lo 00000100:00100000:1.0:1788843881.896072:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bd1203d0a80 x1875738134566784/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788843881.896099:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd1203d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3629:1875738134566400:0@lo:8:kworker.0 00000400:00000100:1.0:1788843881.896182:0:3629:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875738134566400 offset 0 length 520: 4 00000100:00100000:1.0:1788843881.896224:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd1203d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3629:1875738134566528:0@lo:8:kworker.0 00000400:00000100:1.0:1788843881.896242:0:3629:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875738134566528 offset 0 length 520: 4 00000100:00100000:1.0:1788843881.896263:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd1203d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3629:1875738134566656:0@lo:8:kworker.0 00000400:00000100:1.0:1788843881.896292:0:3629:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875738134566656 offset 0 length 520: 4 00000100:00100000:1.0:1788843881.896303:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd1203d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3629:1875738134566784:0@lo:8:kworker.0 00000400:00000100:1.0:1788843881.896317:0:3629:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875738134566784 offset 0 length 520: 4 00010000:00010000:0.0:1788843882.075034:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788843882.912059:0:23446:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:0.0:1788843883.098878:0:23471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788843883.866886:0:23469:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788843884.130050:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843885.154256:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843886.171376:0:23471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788843886.503525:0:24218:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1788843886.503530:0:24218:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:1.0:1788843886.503532:0:24218:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:1.0:1788843886.503664:0:24218:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9bd006448000 00000020:01000004:1.0:1788843886.503683:0:24218:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:1.0:1788843886.504010:0:24218:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1788843886.504025:0:24218:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9bd13df33370) 00000020:00000080:1.0:1788843886.504043:0:24218:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1788843886.564873:0:24218:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1788843886.566991:0:24218:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:3.0:1788843886.567406:0:24218:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:3.0:1788843886.567605:0:24218:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1788843886.568068:0:24218:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1788843886.568453:0:24218:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:3.0:1788843886.568654:0:24218:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:01000000:3.0:1788843886.569458:0:24218:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1788843886.569645:0:24218:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1788843886.569658:0:24218:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788843886.569669:0:24218:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xa762dfcbd58d2bfe 00000020:01000004:3.0:1788843886.569676:0:24218:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:3.0:1788843886.569696:0:24218:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.133@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788843886.569699:0:24218:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.133@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788843886.569705:0:24218:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1788843886.569709:0:24218:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1788843886.569719:0:24218:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9bd1330fb370) 00000020:00000080:3.0:1788843886.569730:0:24218:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type ost with refcount 2 00000100:00100000:3.0:1788843886.570796:0:24218:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788843886.570976:0:24218:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1788843886.570982:0:24218:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:0.0:1788843886.581795:0:24218:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:0.0:1788843886.581812:0:24218:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:0.0:1788843886.583605:0:24218:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:0.0:1788843886.583615:0:24218:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:2.0:1788843886.590769:0:24218:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788843886.591562:0:24218:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:2.0:1788843886.591568:0:24218:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1788843886.594606:0:24218:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1788843886.594620:0:24218:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:2.0:1788843886.627675:0:24218:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788843886.627956:0:24218:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1788843886.627962:0:24218:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:2.0:1788843886.631186:0:24218:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1788843886.631200:0:24218:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:0.0:1788843886.632591:0:24218:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1788843886.632601:0:24218:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:0.0:1788843886.636498:0:24218:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788843886.637787:0:24218:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:1.0:1788843886.637797:0:24218:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:1.0:1788843886.638796:0:24218:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:1.0:1788843886.638806:0:24218:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:3.0:1788843886.708370:0:24218:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788843886.708866:0:24218:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:3.0:1788843886.708874:0:24218:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:3.0:1788843886.713532:0:24218:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:3.0:1788843886.713547:0:24218:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1788843886.714275:0:24218:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1788843886.714377:0:24218:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:3.0:1788843886.714385:0:24218:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.133@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:3.0:1788843886.726839:0:24218:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.133@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788843886.727020:0:24218:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.133@tcp, index=0000, flags=0x20002 00000020:01000004:3.0:1788843886.727026:0:24218:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788843886.727028:0:24218:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788843886.727029:0:24218:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788843886.727030:0:24218:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788843886.727031:0:24218:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788843886.727033:0:24218:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788843886.727034:0:24218:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788843886.727036:0:24218:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788843886.727037:0:24218:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788843886.727041:0:24218:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:3.0:1788843886.727043:0:24218:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788843886.727045:0:24218:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788843886.727046:0:24218:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788843886.727047:0:24218:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788843886.727048:0:24218:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788843886.727049:0:24218:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788843886.727050:0:24218:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788843886.727051:0:24218:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788843886.727053:0:24218:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788843886.727080:0:24218:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1788843886.727102:0:24218:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd1074ff800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ce589ba-8334-438e-8f48-13932fcba8b1:24218:1875738134566912:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788843886.727279:0:24218:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843886.727515:0:24218:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd13308d540 going to sleep for 11 seconds 00000100:00100000:0.0:1788843886.727562:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134566912 00000100:00100000:0.0:1788843886.727570:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134566912 00000100:00100000:0.0:1788843886.727669:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788843886.727679:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0059e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ce589ba-8334-438e-8f48-13932fcba8b1+18:24218:x1875738134566912:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788843886.727721:0:22705:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1788843886.727724:0:22705:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:0.0:1788843886.727728:0:22705:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1788843886.728072:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0059e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ce589ba-8334-438e-8f48-13932fcba8b1+18:24218:x1875738134566912:12345-0@lo:253:mount.lustre.0 Request processed in 393us (792us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843886.728080:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788843886.728181:0:24218:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd1074ff800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ce589ba-8334-438e-8f48-13932fcba8b1:24218:1875738134566912:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788843886.728191:0:24218:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1788843886.728194:0:24218:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788843886.728196:0:24218:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788843886.728197:0:24218:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788843886.728198:0:24218:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788843886.728199:0:24218:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788843886.728208:0:24218:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788843886.728209:0:24218:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788843886.728211:0:24218:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788843886.728212:0:24218:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788843886.728229:0:24218:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9bd006448000 from lustre-OST0000 10000000:01000000:3.0:1788843886.728260:0:24218:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:3.0:1788843886.728263:0:24218:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1788843886.728269:0:24218:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9bd005b60000 local copy 00010000:00010000:3.0:1788843886.728279:0:24218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd007946400/0xa762dfcbd58d29b9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d29c0 expref: -99 pid: 22690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843886.728459:0:24218:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd1074ff800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ce589ba-8334-438e-8f48-13932fcba8b1:24218:1875738134567040:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788843886.728487:0:24218:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843886.728636:0:24218:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd13308d9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788843886.728816:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134567040 00000100:00100000:1.0:1788843886.728822:0:22704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134567040 00000100:00100000:1.0:1788843886.728848:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788843886.728857:0:22704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0059e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ce589ba-8334-438e-8f48-13932fcba8b1+18:24218:x1875738134567040:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788843886.729035:0:22704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0059e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ce589ba-8334-438e-8f48-13932fcba8b1+18:24218:x1875738134567040:12345-0@lo:501:mount.lustre.0 Request processed in 179us (546us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788843886.729043:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788843886.729112:0:24218:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd1074ff800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ce589ba-8334-438e-8f48-13932fcba8b1:24218:1875738134567040:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1788843886.729125:0:24218:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.133@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1788843886.729170:0:24218:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.133@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1788843886.729177:0:24218:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd007946400/0xa762dfcbd58d29b9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d29c0 expref: -99 pid: 22690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843886.729185:0:24218:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.133@tcp lock: ffff9bd007946400/0xa762dfcbd58d29b9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d29c0 expref: -99 pid: 22690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788843886.729209:0:24218:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9bd006448000 10000000:01000000:3.0:1788843886.729213:0:24218:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788843886.729219:0:24218:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1788843886.729221:0:24218:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788843886.729224:0:24218:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1788843886.729227:0:24218:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1788843886.729259:0:24218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd1420e5a00/0xa762dfcbd58d2c0c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843886.729274:0:24218:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.133@tcp lock: ffff9bd1420e5a00/0xa762dfcbd58d2c0c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843886.729284:0:24218:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.133@tcp lock: ffff9bd1420e5a00/0xa762dfcbd58d2c0c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843886.729478:0:24218:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd1074ff800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ce589ba-8334-438e-8f48-13932fcba8b1:24218:1875738134567168:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788843886.729509:0:24218:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843886.729537:0:24218:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd13308d9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788843886.729610:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134567168 00000100:00100000:0.0:1788843886.729615:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134567168 00000100:00100000:0.0:1788843886.729639:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788843886.729646:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0059e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ce589ba-8334-438e-8f48-13932fcba8b1+18:24218:x1875738134567168:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788843886.729655:0:22705:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788843886.729669:0:22705:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd10f7ae000/0xa762dfcbd58d2c13 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xa762dfcbd58d2c0c expref: -99 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843886.729704:0:22705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd10f7ae000/0xa762dfcbd58d2c13 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa762dfcbd58d2c0c expref: 19 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843886.729714:0:22705:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd10f7ae000/0xa762dfcbd58d2c13 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa762dfcbd58d2c0c expref: 19 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843886.729723:0:22705:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd10f7ae000, rc 0) 00000100:00100000:0.0:1788843886.729762:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0059e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ce589ba-8334-438e-8f48-13932fcba8b1+19:24218:x1875738134567168:12345-0@lo:101:mount.lustre.0 Request processed in 117us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843886.729768:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788843886.729937:0:24218:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd1074ff800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ce589ba-8334-438e-8f48-13932fcba8b1:24218:1875738134567168:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788843886.729951:0:24218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.133@tcp lock: ffff9bd1420e5a00/0xa762dfcbd58d2c0c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d2c13 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843886.729960:0:24218:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.133@tcp lock: ffff9bd1420e5a00/0xa762dfcbd58d2c0c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xa762dfcbd58d2c13 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788843886.731216:0:24218:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000040:00080000:3.0:1788843886.732256:0:24218:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788843886.745455:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:3.0:1788843886.745515:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 128 off8544 00000040:00080000:3.0:1788843886.745530:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 112 off8656 00000040:00080000:3.0:1788843886.745544:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8880 00000040:00080000:3.0:1788843886.745557:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9104 00000040:00080000:3.0:1788843886.745570:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 80 off9184 00000040:00080000:3.0:1788843886.745582:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 224 off9408 00000040:00080000:3.0:1788843886.745594:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9632 00000040:00080000:3.0:1788843886.745605:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 80 off9712 00000040:00080000:3.0:1788843886.745617:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 224 off9936 00000040:00080000:3.0:1788843886.745639:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].11, 224 off10160 00000040:00080000:3.0:1788843886.745652:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].12, 120 off10280 00000040:00080000:3.0:1788843886.745677:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].13, 224 off10504 00000040:00080000:3.0:1788843886.745683:0:24218:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 13 count 14 00000100:00100000:3.0:1788843886.745803:0:24218:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd1074ff800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ce589ba-8334-438e-8f48-13932fcba8b1:24218:1875738134567296:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788843886.745869:0:24218:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843886.745903:0:24218:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd13308db40 going to sleep for 11 seconds 00000100:00100000:0.0:1788843886.747085:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134567296 00000100:00100000:0.0:1788843886.747109:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134567296 00000100:00100000:0.0:1788843886.747182:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788843886.747192:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007355450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ce589ba-8334-438e-8f48-13932fcba8b1+19:24218:x1875738134567296:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788843886.747373:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007355450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ce589ba-8334-438e-8f48-13932fcba8b1+19:24218:x1875738134567296:12345-0@lo:501:mount.lustre.0 Request processed in 182us (1503us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843886.747381:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788843886.748458:0:24218:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd1074ff800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ce589ba-8334-438e-8f48-13932fcba8b1:24218:1875738134567296:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788843886.748527:0:24218:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd1074ff800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ce589ba-8334-438e-8f48-13932fcba8b1:24218:1875738134567424:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788843886.748583:0:24218:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843886.748611:0:24218:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd13308db40 going to sleep for 11 seconds 00000100:00100000:1.0:1788843886.748704:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134567424 00000100:00100000:1.0:1788843886.748709:0:22704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134567424 00000100:00100000:1.0:1788843886.748757:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788843886.748766:0:22704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007354c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ce589ba-8334-438e-8f48-13932fcba8b1+19:24218:x1875738134567424:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788843886.752439:0:22704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007354c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ce589ba-8334-438e-8f48-13932fcba8b1+19:24218:x1875738134567424:12345-0@lo:503:mount.lustre.0 Request processed in 3661us (3842us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843886.752458:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788843886.754388:0:24218:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd1074ff800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ce589ba-8334-438e-8f48-13932fcba8b1:24218:1875738134567424:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788843886.755335:0:24218:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788843886.755459:0:24218:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f8d3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ce589ba-8334-438e-8f48-13932fcba8b1:24218:1875738134567552:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788843886.755540:0:24218:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843886.755638:0:24218:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd12e003780 going to sleep for 11 seconds 00000100:00100000:3.0:1788843886.756700:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134567552 00000100:00100000:3.0:1788843886.756710:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134567552 00000100:00100000:2.0:1788843886.757589:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788843886.757601:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007356450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ce589ba-8334-438e-8f48-13932fcba8b1+19:24218:x1875738134567552:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788843886.758732:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007356450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ce589ba-8334-438e-8f48-13932fcba8b1+19:24218:x1875738134567552:12345-0@lo:502:mount.lustre.0 Request processed in 1129us (3188us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843886.758744:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788843886.758910:0:24218:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f8d3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ce589ba-8334-438e-8f48-13932fcba8b1:24218:1875738134567552:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788843886.759232:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:3.0:1788843886.759276:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 128 off8544 00000040:00080000:3.0:1788843886.759293:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 112 off8656 00000040:00080000:3.0:1788843886.759308:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8880 00000040:00080000:3.0:1788843886.759323:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9104 00000040:00080000:3.0:1788843886.759337:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 80 off9184 00000040:00080000:3.0:1788843886.759350:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 224 off9408 00000040:00080000:3.0:1788843886.759364:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9632 00000040:00080000:3.0:1788843886.759395:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 80 off9712 00000040:00080000:3.0:1788843886.759409:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 224 off9936 00000040:00080000:3.0:1788843886.759541:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10160 00000040:00080000:3.0:1788843886.759559:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 120 off10280 00000100:00100000:3.0:1788843886.759598:0:24218:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd1074ff800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ce589ba-8334-438e-8f48-13932fcba8b1:24218:1875738134567680:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788843886.759653:0:24218:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843886.759705:0:24218:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd13308db40 going to sleep for 11 seconds 00000100:00100000:1.0:1788843886.759983:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134567680 00000100:00100000:1.0:1788843886.759991:0:22704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134567680 00000100:00100000:1.0:1788843886.760079:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788843886.760088:0:22704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007355c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ce589ba-8334-438e-8f48-13932fcba8b1+19:24218:x1875738134567680:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788843886.760211:0:22704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007355c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ce589ba-8334-438e-8f48-13932fcba8b1+19:24218:x1875738134567680:12345-0@lo:502:mount.lustre.0 Request processed in 123us (557us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843886.760218:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788843886.760307:0:24218:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd1074ff800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ce589ba-8334-438e-8f48-13932fcba8b1:24218:1875738134567680:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788843886.760348:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 224 off10504 00000040:00080000:3.0:1788843886.760356:0:24218:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 00000020:01000000:3.0:1788843886.761167:0:24235:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788843886.761175:0:24235:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:3.0:1788843886.761183:0:24235:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788843886.761185:0:24235:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1788843886.761191:0:24235:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788843886.761208:0:24235:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9bd1330f99b8) 00000020:00000080:3.0:1788843886.761231:0:24235:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type obdfilter with refcount 2 00000020:00000080:3.0:1788843886.761247:0:24235:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788843886.761333:0:24235:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9bd006448000 from lustre-OST0000, refs=2 00080000:01000000:3.0:1788843886.761341:0:24235:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788843886.761348:0:24235:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xa762dfcbd58d2c21 00010000:00010000:3.0:1788843886.774833:0:24235:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:00000004:3.0:1788843886.775512:0:24235:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 8589934600 00080000:10000000:3.0:1788843886.777528:0:24235:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/32) registered 00000020:00000080:3.0:1788843886.780129:0:24235:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:3.0:1788843886.780158:0:24235:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788843886.780164:0:24235:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788843886.780166:0:24235:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:3.0:1788843886.780170:0:24235:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788843886.780173:0:24235:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #25 00000020:01000000:3.0:1788843886.780175:0:24235:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788843886.780176:0:24235:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788843886.780177:0:24235:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788843886.780180:0:24235:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788843886.780181:0:24235:0:(obd_config.c:1563:class_process_config()) marker 25 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788843886.780184:0:24235:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788843886.780192:0:24235:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788843886.780194:0:24235:0:(obd_config.c:1563:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788843886.780197:0:24235:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788843886.780199:0:24235:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788843886.780201:0:24235:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788843886.780203:0:24235:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788843886.780204:0:24235:0:(obd_config.c:1563:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000020:01000000:3.0:1788843886.780207:0:24235:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788843886.780209:0:24235:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788843886.780210:0:24235:0:(obd_config.c:1563:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788843886.780213:0:24235:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1788843886.780254:0:24235:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788843886.780258:0:24235:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788843886.780260:0:24235:0:(obd_config.c:1563:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788843886.780263:0:24235:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 14 count 14 00000020:01000000:1.0:1788843886.780447:0:24218:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:1.0:1788843886.780476:0:24218:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.133@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1788843886.780499:0:24218:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd1420e5a00/0xa762dfcbd58d2c0c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d2c13 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843886.780512:0:24218:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.133@tcp lock: ffff9bd1420e5a00/0xa762dfcbd58d2c0c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d2c13 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788843886.780520:0:24218:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9bd006448000 from 1 10000000:01000000:1.0:1788843886.780523:0:24218:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788843886.780561:0:24218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd007946800/0xa762dfcbd58d2c28 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843886.780569:0:24218:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.133@tcp lock: ffff9bd007946800/0xa762dfcbd58d2c28 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843886.780580:0:24218:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.133@tcp lock: ffff9bd007946800/0xa762dfcbd58d2c28 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843886.780616:0:24218:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd1203d2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ce589ba-8334-438e-8f48-13932fcba8b1:24218:1875738134567808:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788843886.780801:0:24218:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843886.780846:0:24218:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd13e9c4240 going to sleep for 11 seconds 00000100:00100000:2.0:1788843886.782185:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134567808 00000100:00100000:2.0:1788843886.782197:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134567808 00000100:00100000:2.0:1788843886.783218:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788843886.783233:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007356050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ce589ba-8334-438e-8f48-13932fcba8b1+19:24218:x1875738134567808:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788843886.783261:0:22705:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788843886.783281:0:22705:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd1153e6a00/0xa762dfcbd58d2c2f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa762dfcbd58d2c28 expref: -99 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843886.783310:0:22705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd1153e6a00/0xa762dfcbd58d2c2f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa762dfcbd58d2c28 expref: 20 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843886.783321:0:22705:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd1153e6a00/0xa762dfcbd58d2c2f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa762dfcbd58d2c28 expref: 20 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843886.783330:0:22705:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd1153e6a00, rc 0) 00000100:00100000:2.0:1788843886.783420:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007356050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ce589ba-8334-438e-8f48-13932fcba8b1+20:24218:x1875738134567808:12345-0@lo:101:mount.lustre.0 Request processed in 183us (2724us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843886.783428:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788843886.783511:0:24218:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd1203d2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ce589ba-8334-438e-8f48-13932fcba8b1:24218:1875738134567808:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788843886.783529:0:24218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.133@tcp lock: ffff9bd007946800/0xa762dfcbd58d2c28 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d2c2f expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843886.783539:0:24218:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.133@tcp lock: ffff9bd007946800/0xa762dfcbd58d2c28 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa762dfcbd58d2c2f expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788843886.790640:0:24218:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000040:00080000:1.0:1788843886.791693:0:24218:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788843886.792648:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:1.0:1788843886.792695:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:1.0:1788843886.792728:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:1.0:1788843886.792745:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8976 00000040:00080000:1.0:1788843886.792758:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 112 off9088 00000040:00080000:1.0:1788843886.792772:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 224 off9312 00000040:00080000:1.0:1788843886.792785:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 224 off9536 00000040:00080000:1.0:1788843886.792799:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 128 off9664 00000040:00080000:1.0:1788843886.792812:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9888 00000040:00080000:1.0:1788843886.792826:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10112 00000040:00080000:1.0:1788843886.792838:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 128 off10240 00000040:00080000:1.0:1788843886.792859:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 224 off10464 00000040:00080000:1.0:1788843886.792865:0:24218:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 12 count 13 00000100:00100000:1.0:1788843886.793087:0:24218:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd1203d3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ce589ba-8334-438e-8f48-13932fcba8b1:24218:1875738134567936:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788843886.793183:0:24218:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843886.793224:0:24218:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd13e9c4a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788843886.797571:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134567936 00000100:00100000:0.0:1788843886.797588:0:22704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134567936 00000100:00100000:0.0:1788843886.797661:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788843886.797672:0:22704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007354450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ce589ba-8334-438e-8f48-13932fcba8b1+20:24218:x1875738134567936:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788843886.797866:0:22704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007354450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ce589ba-8334-438e-8f48-13932fcba8b1+20:24218:x1875738134567936:12345-0@lo:501:mount.lustre.0 Request processed in 195us (4682us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843886.797874:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788843886.798116:0:24218:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd1203d3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ce589ba-8334-438e-8f48-13932fcba8b1:24218:1875738134567936:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788843886.798196:0:24218:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f8d1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ce589ba-8334-438e-8f48-13932fcba8b1:24218:1875738134568064:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788843886.798265:0:24218:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843886.798289:0:24218:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd12e003480 going to sleep for 11 seconds 00000100:00100000:0.0:1788843886.798398:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134568064 00000100:00100000:0.0:1788843886.798404:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134568064 00000100:00100000:0.0:1788843886.798446:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788843886.798453:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007356850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ce589ba-8334-438e-8f48-13932fcba8b1+20:24218:x1875738134568064:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788843886.798530:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007356850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ce589ba-8334-438e-8f48-13932fcba8b1+20:24218:x1875738134568064:12345-0@lo:503:mount.lustre.0 Request processed in 76us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843886.798537:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788843886.798667:0:24218:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f8d1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ce589ba-8334-438e-8f48-13932fcba8b1:24218:1875738134568064:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788843886.799290:0:24218:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788843886.799396:0:24218:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f8d1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ce589ba-8334-438e-8f48-13932fcba8b1:24218:1875738134568192:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788843886.800094:0:24218:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843886.800118:0:24218:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd12e003480 going to sleep for 11 seconds 00000100:00100000:1.0:1788843886.800532:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134568192 00000100:00100000:1.0:1788843886.800542:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134568192 00000100:00100000:1.0:1788843886.800587:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788843886.800600:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007355850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ce589ba-8334-438e-8f48-13932fcba8b1+20:24218:x1875738134568192:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788843886.800742:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007355850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ce589ba-8334-438e-8f48-13932fcba8b1+20:24218:x1875738134568192:12345-0@lo:502:mount.lustre.0 Request processed in 143us (648us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843886.800749:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788843886.801060:0:24218:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f8d1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ce589ba-8334-438e-8f48-13932fcba8b1:24218:1875738134568192:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788843886.801362:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:3.0:1788843886.801391:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:3.0:1788843886.801405:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:3.0:1788843886.801747:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:3.0:1788843886.801765:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000040:00080000:3.0:1788843886.801776:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:3.0:1788843886.801842:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 224 off9536 00000040:00080000:3.0:1788843886.801857:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 128 off9664 00000040:00080000:3.0:1788843886.801871:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9888 00000040:00080000:3.0:1788843886.801885:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10112 00000040:00080000:3.0:1788843886.801900:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 128 off10240 00000100:00100000:3.0:1788843886.802545:0:24218:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd1074ff800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ce589ba-8334-438e-8f48-13932fcba8b1:24218:1875738134568320:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788843886.802608:0:24218:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843886.802635:0:24218:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd13308d300 going to sleep for 11 seconds 00000100:00100000:1.0:1788843886.802835:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134568320 00000100:00100000:1.0:1788843886.802843:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134568320 00000100:00100000:1.0:1788843886.802892:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788843886.802971:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007354050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ce589ba-8334-438e-8f48-13932fcba8b1+20:24218:x1875738134568320:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788843886.803087:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007354050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ce589ba-8334-438e-8f48-13932fcba8b1+20:24218:x1875738134568320:12345-0@lo:502:mount.lustre.0 Request processed in 186us (478us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843886.803094:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788843886.803281:0:24218:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd1074ff800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ce589ba-8334-438e-8f48-13932fcba8b1:24218:1875738134568320:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788843886.803346:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 224 off10464 00000040:00080000:3.0:1788843886.803354:0:24218:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:2.0:1788843886.805860:0:24239:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788843886.805872:0:24239:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788843886.805874:0:24239:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788843886.805882:0:24239:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9bd006448000 00000020:00000080:2.0:1788843886.805885:0:24239:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788843886.805894:0:24239:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788843886.805896:0:24239:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788843886.805897:0:24239:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1788843886.809128:0:24239:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788843886.814335:0:24239:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788843886.814344:0:24239:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788843886.814358:0:24239:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9bd006448000 00000020:00000080:0.0:1788843886.814361:0:24239:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788843886.814465:0:24239:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788843886.814470:0:24239:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788843886.814472:0:24239:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1788843886.814475:0:24239:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788843886.814480:0:24239:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788843886.814481:0:24239:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788843886.814485:0:24239:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9bd006448000 00000020:00000080:0.0:1788843886.814486:0:24239:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788843886.819033:0:24239:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788843886.826443:0:24239:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788843886.826450:0:24239:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788843886.826462:0:24239:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788843886.826469:0:24239:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788843886.826470:0:24239:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1788843886.826475:0:24239:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9bd006448000 00000020:00000080:1.0:1788843886.826478:0:24239:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788843886.826551:0:24239:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788843886.826555:0:24239:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788843886.826557:0:24239:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1788843886.826560:0:24239:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 13 count 13 00000020:01000000:3.0:1788843886.826918:0:24218:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:3.0:1788843886.826949:0:24218:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.133@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788843886.826974:0:24218:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd007946800/0xa762dfcbd58d2c28 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d2c2f expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843886.826986:0:24218:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.133@tcp lock: ffff9bd007946800/0xa762dfcbd58d2c28 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d2c2f expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788843886.827040:0:24218:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788843886.827042:0:24218:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9bd006448000 10000000:01000000:3.0:1788843886.827045:0:24218:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9bd006448000 10000000:01000000:3.0:1788843886.827049:0:24218:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788843886.827054:0:24218:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9bd006448000 from 1 10000000:01000000:3.0:1788843886.827057:0:24218:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788843886.827096:0:24218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd1420e5200/0xa762dfcbd58d2c36 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843886.827103:0:24218:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.133@tcp lock: ffff9bd1420e5200/0xa762dfcbd58d2c36 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843886.827114:0:24218:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.133@tcp lock: ffff9bd1420e5200/0xa762dfcbd58d2c36 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843886.827178:0:24218:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd1074ff800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ce589ba-8334-438e-8f48-13932fcba8b1:24218:1875738134568448:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788843886.827257:0:24218:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843886.827304:0:24218:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd107659240 going to sleep for 11 seconds 00000100:00100000:2.0:1788843886.827567:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134568448 00000100:00100000:2.0:1788843886.827575:0:22704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134568448 00000100:00100000:2.0:1788843886.827628:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788843886.827637:0:22704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007357450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ce589ba-8334-438e-8f48-13932fcba8b1+20:24218:x1875738134568448:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788843886.827651:0:22704:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788843886.827664:0:22704:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd1153e6400/0xa762dfcbd58d2c3d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xa762dfcbd58d2c36 expref: -99 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843886.827698:0:22704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd1153e6400/0xa762dfcbd58d2c3d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa762dfcbd58d2c36 expref: 21 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843886.827709:0:22704:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd1153e6400/0xa762dfcbd58d2c3d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa762dfcbd58d2c36 expref: 21 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843886.827718:0:22704:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd1153e6400, rc 0) 00000100:00100000:2.0:1788843886.827758:0:22704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007357450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ce589ba-8334-438e-8f48-13932fcba8b1+21:24218:x1875738134568448:12345-0@lo:101:mount.lustre.0 Request processed in 121us (501us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843886.827765:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788843886.830115:0:24218:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd1074ff800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ce589ba-8334-438e-8f48-13932fcba8b1:24218:1875738134568448:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788843886.830170:0:24218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.133@tcp lock: ffff9bd1420e5200/0xa762dfcbd58d2c36 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d2c3d expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843886.830183:0:24218:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.133@tcp lock: ffff9bd1420e5200/0xa762dfcbd58d2c36 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xa762dfcbd58d2c3d expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788843886.835986:0:24218:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000040:00080000:3.0:1788843886.836317:0:24218:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788843886.839311:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:3.0:1788843886.839379:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 120 off8536 00000040:00080000:3.0:1788843886.839399:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 168 off8704 00000040:00080000:3.0:1788843886.839425:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8928 00000040:00080000:3.0:1788843886.839443:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 224 off9152 00000040:00080000:3.0:1788843886.839457:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 120 off9272 00000040:00080000:3.0:1788843886.839470:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 168 off9440 00000040:00080000:3.0:1788843886.839482:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 224 off9664 00000040:00080000:3.0:1788843886.839495:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:3.0:1788843886.839507:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 120 off10008 00000040:00080000:3.0:1788843886.839519:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 224 off10232 00000040:00080000:3.0:1788843886.839532:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10456 00000040:00080000:3.0:1788843886.840786:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].13, 88 off10544 00000040:00080000:3.0:1788843886.840832:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].14, 128 off10672 00000040:00080000:3.0:1788843886.840851:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].15, 144 off10816 00000040:00080000:3.0:1788843886.840864:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].16, 160 off10976 00000040:00080000:3.0:1788843886.840877:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].17, 224 off11200 00000040:00080000:3.0:1788843886.841217:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].18, 224 off11424 00000040:00080000:3.0:1788843886.841249:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].19, 80 off11504 00000040:00080000:3.0:1788843886.841266:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].20, 224 off11728 00000040:00080000:3.0:1788843886.841279:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].21, 224 off11952 00000040:00080000:3.0:1788843886.841293:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].22, 88 off12040 00000040:00080000:3.0:1788843886.841307:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].23, 128 off12168 00000040:00080000:3.0:1788843886.841322:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].24, 144 off12312 00000040:00080000:3.0:1788843886.841347:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].25, 160 off12472 00000040:00080000:3.0:1788843886.841362:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].26, 224 off12696 00000040:00080000:3.0:1788843886.841377:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].27, 224 off12920 00000040:00080000:3.0:1788843886.841390:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].28, 80 off13000 00000040:00080000:3.0:1788843886.841402:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].29, 224 off13224 00000040:00080000:3.0:1788843886.842023:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].30, 224 off13448 00000040:00080000:3.0:1788843886.842053:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].31, 88 off13536 00000040:00080000:3.0:1788843886.842068:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].32, 128 off13664 00000040:00080000:3.0:1788843886.842083:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].33, 144 off13808 00000040:00080000:3.0:1788843886.842113:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].34, 128 off13936 00000040:00080000:3.0:1788843886.842128:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].35, 224 off14160 00000040:00080000:3.0:1788843886.842542:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].36, 224 off14384 00000040:00080000:3.0:1788843886.842564:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].37, 80 off14464 00000040:00080000:3.0:1788843886.842577:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].38, 224 off14688 00000040:00080000:3.0:1788843886.842591:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].39, 224 off14912 00000040:00080000:3.0:1788843886.842602:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].40, 88 off15000 00000040:00080000:3.0:1788843886.842616:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].41, 128 off15128 00000040:00080000:3.0:1788843886.842630:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].42, 144 off15272 00000040:00080000:3.0:1788843886.842644:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].43, 128 off15400 00000040:00080000:3.0:1788843886.842658:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].44, 224 off15624 00000040:00080000:3.0:1788843886.842671:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].45, 224 off15848 00000040:00080000:3.0:1788843886.842682:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].46, 80 off15928 00000040:00080000:3.0:1788843886.843758:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].47, 224 off16152 00000040:00080000:3.0:1788843886.843773:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].48, 232 off16384 00000040:00080000:3.0:1788843886.844225:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].49, 224 off16608 00000040:00080000:3.0:1788843886.844257:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].50, 120 off16728 00000040:00080000:3.0:1788843886.844275:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].51, 224 off16952 00000040:00080000:3.0:1788843886.844280:0:24218:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 51 count 51 00000100:00100000:3.0:1788843886.844389:0:24218:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd1074ff800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ce589ba-8334-438e-8f48-13932fcba8b1:24218:1875738134568576:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788843886.844472:0:24218:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843886.844711:0:24218:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd1076590c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788843886.853529:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134568576 00000100:00100000:2.0:1788843886.853546:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134568576 00000100:00100000:2.0:1788843886.853610:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788843886.853620:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007355050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ce589ba-8334-438e-8f48-13932fcba8b1+21:24218:x1875738134568576:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788843886.854097:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007355050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ce589ba-8334-438e-8f48-13932fcba8b1+21:24218:x1875738134568576:12345-0@lo:501:mount.lustre.0 Request processed in 476us (9622us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843886.854106:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788843886.854373:0:24218:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd1074ff800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ce589ba-8334-438e-8f48-13932fcba8b1:24218:1875738134568576:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788843886.854512:0:24218:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd1074ff800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ce589ba-8334-438e-8f48-13932fcba8b1:24218:1875738134568704:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788843886.854558:0:24218:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843886.854628:0:24218:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd1076590c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788843886.858852:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134568704 00000100:00100000:1.0:1788843886.858867:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134568704 00000100:00100000:1.0:1788843886.858928:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788843886.858939:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007354850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ce589ba-8334-438e-8f48-13932fcba8b1+21:24218:x1875738134568704:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788843886.859121:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007354850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ce589ba-8334-438e-8f48-13932fcba8b1+21:24218:x1875738134568704:12345-0@lo:503:mount.lustre.0 Request processed in 184us (4562us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843886.859128:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788843886.860845:0:24218:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd1074ff800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ce589ba-8334-438e-8f48-13932fcba8b1:24218:1875738134568704:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788843886.863135:0:24218:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788843886.863304:0:24218:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f957b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ce589ba-8334-438e-8f48-13932fcba8b1:24218:1875738134568832:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788843886.863388:0:24218:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843886.864102:0:24218:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd0013d49c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788843886.867282:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134568832 00000100:00100000:2.0:1788843886.867298:0:22704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134568832 00000100:00100000:3.0:1788843886.872813:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788843886.872829:0:22704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007357050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ce589ba-8334-438e-8f48-13932fcba8b1+21:24218:x1875738134568832:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788843886.873030:0:22704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007357050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ce589ba-8334-438e-8f48-13932fcba8b1+21:24218:x1875738134568832:12345-0@lo:502:mount.lustre.0 Request processed in 205us (9641us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843886.873038:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788843886.874567:0:24218:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f957b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ce589ba-8334-438e-8f48-13932fcba8b1:24218:1875738134568832:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788843886.874851:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:2.0:1788843886.874883:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 120 off8536 00000040:00080000:2.0:1788843886.874897:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 168 off8704 00000040:00080000:2.0:1788843886.874930:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8928 00000040:00080000:2.0:1788843886.874944:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 224 off9152 00000040:00080000:2.0:1788843886.874956:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 120 off9272 00000040:00080000:2.0:1788843886.874967:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 168 off9440 00000040:00080000:2.0:1788843886.874991:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 224 off9664 00000040:00080000:2.0:1788843886.875004:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:2.0:1788843886.875018:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 120 off10008 00000040:00080000:2.0:1788843886.875030:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 224 off10232 00000040:00080000:2.0:1788843886.875044:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10456 00000040:00080000:2.0:1788843886.875057:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].13, 88 off10544 00000040:00080000:2.0:1788843886.875069:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].14, 128 off10672 00000040:00080000:2.0:1788843886.875081:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].15, 144 off10816 00000040:00080000:2.0:1788843886.875094:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].16, 160 off10976 00000040:00080000:2.0:1788843886.875107:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].17, 224 off11200 00000040:00080000:2.0:1788843886.875120:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].18, 224 off11424 00000040:00080000:2.0:1788843886.875133:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].19, 80 off11504 00000040:00080000:2.0:1788843886.875169:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].20, 224 off11728 00000040:00080000:2.0:1788843886.875185:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].21, 224 off11952 00000040:00080000:2.0:1788843886.875217:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].22, 88 off12040 00000040:00080000:2.0:1788843886.875231:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].23, 128 off12168 00000040:00080000:2.0:1788843886.875256:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].24, 144 off12312 00000040:00080000:2.0:1788843886.875268:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].25, 160 off12472 00000040:00080000:2.0:1788843886.875281:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].26, 224 off12696 00000040:00080000:2.0:1788843886.875293:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].27, 224 off12920 00000040:00080000:2.0:1788843886.875306:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].28, 80 off13000 00000040:00080000:2.0:1788843886.875318:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].29, 224 off13224 00000040:00080000:2.0:1788843886.875330:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].30, 224 off13448 00000040:00080000:2.0:1788843886.875342:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].31, 88 off13536 00000040:00080000:2.0:1788843886.875355:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].32, 128 off13664 00000040:00080000:2.0:1788843886.875369:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].33, 144 off13808 00000040:00080000:2.0:1788843886.875382:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].34, 128 off13936 00000040:00080000:2.0:1788843886.875395:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].35, 224 off14160 00000040:00080000:2.0:1788843886.875406:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].36, 224 off14384 00000040:00080000:2.0:1788843886.875431:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].37, 80 off14464 00000040:00080000:2.0:1788843886.875461:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].38, 224 off14688 00000040:00080000:2.0:1788843886.875476:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].39, 224 off14912 00000040:00080000:2.0:1788843886.875486:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].40, 88 off15000 00000040:00080000:2.0:1788843886.875510:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].41, 128 off15128 00000040:00080000:2.0:1788843886.875523:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].42, 144 off15272 00000040:00080000:2.0:1788843886.875535:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].43, 128 off15400 00000040:00080000:2.0:1788843886.875548:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].44, 224 off15624 00000040:00080000:2.0:1788843886.875561:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].45, 224 off15848 00000040:00080000:2.0:1788843886.875574:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].46, 80 off15928 00000040:00080000:2.0:1788843886.875588:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].47, 224 off16152 00000040:00080000:2.0:1788843886.875600:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].48, 232 off16384 00000100:00100000:2.0:1788843886.875652:0:24218:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f8d2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ce589ba-8334-438e-8f48-13932fcba8b1:24218:1875738134568960:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788843886.875722:0:24218:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843886.879083:0:24218:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd1102c23c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788843886.880264:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134568960 00000100:00100000:1.0:1788843886.880275:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134568960 00000100:00100000:1.0:1788843886.880539:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788843886.880550:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007356c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ce589ba-8334-438e-8f48-13932fcba8b1+21:24218:x1875738134568960:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788843886.882577:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007356c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ce589ba-8334-438e-8f48-13932fcba8b1+21:24218:x1875738134568960:12345-0@lo:502:mount.lustre.0 Request processed in 2021us (6848us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843886.882591:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788843886.883719:0:24218:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f8d2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ce589ba-8334-438e-8f48-13932fcba8b1:24218:1875738134568960:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788843886.884748:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].49, 224 off16608 00000040:00080000:2.0:1788843886.884789:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].50, 120 off16728 00000100:00100000:2.0:1788843886.884840:0:24218:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f8d2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ce589ba-8334-438e-8f48-13932fcba8b1:24218:1875738134569088:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788843886.885107:0:24218:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843886.885157:0:24218:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd11ae7bd80 going to sleep for 11 seconds 00000100:00100000:1.0:1788843886.886081:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134569088 00000100:00100000:1.0:1788843886.886091:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134569088 00000100:00100000:1.0:1788843886.886191:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788843886.886201:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007357c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ce589ba-8334-438e-8f48-13932fcba8b1+21:24218:x1875738134569088:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788843886.886337:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007357c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ce589ba-8334-438e-8f48-13932fcba8b1+21:24218:x1875738134569088:12345-0@lo:502:mount.lustre.0 Request processed in 136us (1230us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843886.886344:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788843886.886522:0:24218:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f8d2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ce589ba-8334-438e-8f48-13932fcba8b1:24218:1875738134569088:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788843886.886598:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].51, 224 off16952 00000040:00080000:2.0:1788843886.886611:0:24218:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:2.0:1788843886.888508:0:24245:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1788843886.888525:0:24245:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9bd10e8ccd28) 00000020:00000080:2.0:1788843886.888549:0:24245:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type lwp with refcount 2 00000020:01000004:2.0:1788843886.888644:0:24245:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9bd006448000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1788843886.888649:0:24245:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9bd006448000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1788843886.888652:0:24245:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9bd006448000 3 00010000:00080000:2.0:1788843886.888681:0:24245:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9bd001789800@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.133@tcp at head 00010000:00010000:0.0:1788843886.902596:0:24245:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-9 is initialized 00000020:00000080:0.0:1788843886.903068:0:24245:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:0.0:1788843886.903118:0:24245:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788843886.903132:0:24245:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xa762dfcbd58d2c4b 00000100:00080000:0.0:1788843886.903288:0:24245:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788843886.903295:0:24245:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9bd001789800 using connection 192.168.203.133@tcp/0@lo 00000100:00100000:0.0:1788843886.903332:0:24245:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bd10f957480 x1875738134569216/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788843886.903396:0:24245:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788843886.903680:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788843886.903701:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788843886.903704:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788843886.903707:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788843886.903736:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788843886.903739:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788843886.903741:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788843886.903744:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788843886.903792:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f8d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3630:1875738134569728:0@lo:400:kworker.0 00000100:00100000:2.0:1788843886.903886:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843886.904250:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788843886.904259:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f8d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1875738134569344:0@lo:400:kworker.0 00000100:00100000:2.0:1788843886.904292:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843886.904324:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f8d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1875738134569600:0@lo:400:kworker.0 00000100:00100000:2.0:1788843886.904347:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843886.904365:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788843886.904371:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f8d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3633:1875738134569472:0@lo:400:kworker.0 00000100:00100000:2.0:1788843886.904391:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843886.904432:0:23743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134569344 00000100:00100000:2.0:1788843886.904440:0:23743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134569344 00000100:00100000:2.0:1788843886.904478:0:23743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134569600 00000100:00100000:2.0:1788843886.904481:0:23743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134569600 00000100:00100000:2.0:1788843886.904497:0:23743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788843886.904505:0:23743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f8d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3630:x1875738134569344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788843886.904559:0:23743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f8d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3630:x1875738134569344:12345-0@lo:400:kworker.0 Request processed in 54us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843886.904573:0:23743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788843886.904589:0:23743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788843886.904594:0:23743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f8d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3633:x1875738134569600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788843886.904623:0:23743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f8d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3633:x1875738134569600:12345-0@lo:400:kworker.0 Request processed in 29us (275us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843886.904630:0:23743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788843886.904666:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f8d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1875738134569600:0@lo:400:kworker.0 00000100:00100000:2.0:1788843886.905326:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f8d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1875738134569344:0@lo:400:kworker.0 00000020:01000004:0.0:1788843886.905676:0:24245:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1788843886.905704:0:24245:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff9bd0078b99b8) 00000020:00000080:0.0:1788843886.905732:0:24245:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type lwp with refcount 2 00000020:01000004:0.0:1788843886.905819:0:24245:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9bd006448000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1788843886.905824:0:24245:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9bd006448000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1788843886.905827:0:24245:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9bd006448000 3 00010000:00080000:0.0:1788843886.905857:0:24245:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9bd104818800@lustre-MDT0001-lwp-OST0000: add connection 192.168.203.133@tcp at head 00000100:00100000:1.0:1788843886.912132:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f957480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3629:1875738134569216:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788843886.912241:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843886.912322:0:22713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134569728 00000100:00100000:1.0:1788843886.912330:0:22713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134569728 00000100:00100000:1.0:1788843886.912366:0:22713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134569472 00000100:00100000:1.0:1788843886.912369:0:22713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134569472 00000100:00100000:1.0:1788843886.912382:0:22713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134569216 00000100:00100000:1.0:1788843886.912384:0:22713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134569216 00000100:00100000:1.0:1788843886.912399:0:22713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788843886.912408:0:22713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f8d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3630:x1875738134569728:12345-0@lo:400:kworker.0 00010000:00010000:0.0:1788843886.913653:0:24245:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-10 is initialized 00000100:00100000:1.0:1788843886.914048:0:22713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f8d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3630:x1875738134569728:12345-0@lo:400:kworker.0 Request processed in 1637us (10159us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843886.914060:0:22713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788843886.914087:0:22713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788843886.914096:0:22713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007ba1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3633:x1875738134569472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843886.914265:0:22713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007ba1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3633:x1875738134569472:12345-0@lo:400:kworker.0 Request processed in 170us (9871us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843886.914280:0:22713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788843886.914294:0:22713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788843886.914299:0:22713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1203d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3629:x1875738134569216:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1788843886.914323:0:22713:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 664 last 0 00000020:00000080:1.0:1788843886.914356:0:22713:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xa762dfcbd58d2c59 00000004:00100000:1.0:1788843886.914373:0:22713:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788843886.914406:0:22713:0:(import.c:65:import_set_state_nolock()) ffff9bd12e00e000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788843886.914460:0:22713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1203d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3629:x1875738134569216:12345-0@lo:38:llog_process_th.0 Request processed in 159us (2227us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843886.914466:0:22713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1788843886.914528:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9bd10f8d1180 x1875738134569728/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843902 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788843886.914543:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f8d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3630:1875738134569728:0@lo:400:kworker.0 00010000:00080000:1.0:1788843886.914577:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9bd10f957480 x1875738134569216/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788843896 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788843886.914586:0:3629:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788843886.914593:0:3629:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 3 00000100:00080000:1.0:1788843886.914601:0:3629:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1788843886.914606:0:3629:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788843886.914608:0:3629:0:(import.c:65:import_set_state_nolock()) ffff9bd001789800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788843886.914613:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f957480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3629:1875738134569216:0@lo:38:llog_process_th.0 00000020:00000080:0.0:1788843886.914867:0:24245:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:0.0:1788843886.914941:0:24245:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788843886.914948:0:24245:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0xa762dfcbd58d2c60 00000100:00080000:0.0:1788843886.914955:0:24245:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788843886.914960:0:24245:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff9bd104818800 using connection 192.168.203.133@tcp/0@lo 00000100:00100000:0.0:1788843886.914984:0:24245:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bd10f954700 x1875738134569856/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788843886.915002:0:24245:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:2.0:1788843886.915193:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788843886.915198:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788843886.915200:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788843886.915203:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788843886.915206:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788843886.915209:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788843886.915211:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788843886.915214:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788843886.917027:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f954700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3629:1875738134569856:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788843886.917097:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843886.918822:0:22713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134569856 00000100:00100000:0.0:1788843886.918835:0:22713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134569856 00000100:00100000:0.0:1788843886.918880:0:22713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788843886.918889:0:22713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1203d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3629:x1875738134569856:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1788843886.918931:0:22713:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 664 last 0 00000020:00000080:0.0:1788843886.918979:0:22713:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0xa762dfcbd58d2c67 00000004:00100000:0.0:1788843886.918997:0:22713:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788843886.919029:0:22713:0:(import.c:65:import_set_state_nolock()) ffff9bd007336000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788843886.919100:0:22713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1203d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3629:x1875738134569856:12345-0@lo:38:llog_process_th.0 Request processed in 210us (2002us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843886.919108:0:22713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1788843886.921558:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9bd10f954700 x1875738134569856/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788843896 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788843886.921574:0:3629:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788843886.921584:0:3629:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 3 00000100:00080000:1.0:1788843886.921593:0:3629:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1788843886.921597:0:3629:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1788843886.921601:0:3629:0:(import.c:65:import_set_state_nolock()) ffff9bd104818800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788843886.921609:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f954700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3629:1875738134569856:0@lo:38:llog_process_th.0 00010000:00080000:3.0:1788843886.922600:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9bd10f8d3100 x1875738134569472/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843902 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788843886.922612:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f8d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3633:1875738134569472:0@lo:400:kworker.0 00000040:00080000:0.0:1788843886.923647:0:24245:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 52 count 51 00000020:01000000:3.0:1788843886.924882:0:24218:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:3.0:1788843886.924984:0:24218:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.133@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788843886.925008:0:24218:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd1420e5200/0xa762dfcbd58d2c36 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d2c3d expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843886.925020:0:24218:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.133@tcp lock: ffff9bd1420e5200/0xa762dfcbd58d2c36 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d2c3d expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788843886.925076:0:24218:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788843886.925079:0:24218:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788843886.925080:0:24218:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788843886.925081:0:24218:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788843886.925083:0:24218:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788843886.925085:0:24218:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788843886.925086:0:24218:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788843886.925088:0:24218:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788843886.925090:0:24218:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788843886.925098:0:24218:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:3.0:1788843886.925100:0:24218:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788843886.925101:0:24218:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788843886.925102:0:24218:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788843886.925103:0:24218:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788843886.925104:0:24218:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788843886.925105:0:24218:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788843886.925106:0:24218:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788843886.925107:0:24218:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788843886.925108:0:24218:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788843886.925163:0:24218:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1788843886.925184:0:24218:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd1074fd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ce589ba-8334-438e-8f48-13932fcba8b1:24218:1875738134569984:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788843886.925264:0:24218:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843886.925303:0:24218:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd13308d600 going to sleep for 11 seconds 00000100:00100000:0.0:1788843886.925973:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134569984 00000100:00100000:0.0:1788843886.925982:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134569984 00000100:00100000:0.0:1788843886.926039:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788843886.926048:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007357850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ce589ba-8334-438e-8f48-13932fcba8b1+21:24218:x1875738134569984:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788843886.926074:0:22705:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1788843886.926089:0:22705:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1788843886.932871:0:22705:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788843886.932889:0:22705:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:3.0:1788843886.933082:0:22727:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788843886.933086:0:22727:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788843886.933109:0:22727:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9bd1420e4200/0xa762dfcbd58d2c6e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843886.933128:0:22727:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bd1420e4400/0xa762dfcbd58d2bb8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa762dfcbd58d2bb1 expref: 21 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843886.933136:0:22727:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bd1420e4600/0xa762dfcbd58d2bc6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa762dfcbd58d2bbf expref: 21 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843886.933173:0:22727:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9bd1420e4200/0xa762dfcbd58d2c6e lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843886.933217:0:22727:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bd1420e4600/0xa762dfcbd58d2bc6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa762dfcbd58d2bbf expref: 21 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843886.933242:0:22727:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9bd1420e4600/0xa762dfcbd58d2bc6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa762dfcbd58d2bbf expref: 21 pid: 22706 timeout: 764 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843886.933276:0:22727:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd1074fce00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22727:1875738134570112:0@lo:104: 00000100:00100000:3.0:1788843886.933344:0:22727:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788843886.933397:0:22727:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bd1420e4400/0xa762dfcbd58d2bb8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa762dfcbd58d2bb1 expref: 21 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843886.933408:0:22727:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9bd1420e4400/0xa762dfcbd58d2bb8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa762dfcbd58d2bb1 expref: 21 pid: 22706 timeout: 764 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843886.933427:0:22727:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd1074ff100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22727:1875738134570240:0@lo:104: 00000100:00100000:3.0:1788843886.933451:0:22727:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843886.933475:0:22727:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd13308dc00 going to sleep for 11 seconds 00000100:00100000:1.0:1788843886.933605:0:22695:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1788843886.933639:0:22695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134570112 00000100:00100000:1.0:1788843886.933646:0:22695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134570112 00000100:00100000:1.0:1788843886.933694:0:22695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134570240 00000100:00100000:1.0:1788843886.933697:0:22695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134570240 00000100:00100000:1.0:1788843886.933719:0:22695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788843886.933727:0:22695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1074fd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0ce589ba-8334-438e-8f48-13932fcba8b1+4:22727:x1875738134570112:12345-0@lo:104: 00010000:00010000:1.0:1788843886.933740:0:22695:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.133@tcp lock: ffff9bd1153e7000/0xa762dfcbd58d2bbf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa762dfcbd58d2bc6 expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843886.933811:0:22695:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788843886.933817:0:22695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1074fd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0ce589ba-8334-438e-8f48-13932fcba8b1+4:22727:x1875738134570112:12345-0@lo:104: Request processed in 91us (474us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843886.933824:0:22695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788843886.933842:0:22695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788843886.933848:0:22695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd107601c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0ce589ba-8334-438e-8f48-13932fcba8b1+3:22727:x1875738134570240:12345-0@lo:104: 00010000:00010000:1.0:1788843886.933856:0:22695:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.133@tcp lock: ffff9bd007947c00/0xa762dfcbd58d2bb1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa762dfcbd58d2bb8 expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843886.934328:0:22695:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788843886.934335:0:22695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd107601c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0ce589ba-8334-438e-8f48-13932fcba8b1+3:22727:x1875738134570240:12345-0@lo:104: Request processed in 486us (882us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843886.934341:0:22695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:1.0:1788843886.934383:0:22700:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788843886.934389:0:22700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.133@tcp lock: ffff9bd1153e7000/0xa762dfcbd58d2bbf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa762dfcbd58d2bc6 expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843886.934397:0:22700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd1153e7000 already unused, calling callback (ffffffffc12a7c20) 10000000:00010000:1.0:1788843886.934401:0:22700:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.133@tcp lock: ffff9bd1153e7000/0xa762dfcbd58d2bbf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xa762dfcbd58d2bc6 expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843886.934411:0:22700:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.133@tcp lock: ffff9bd1153e7000/0xa762dfcbd58d2bbf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xa762dfcbd58d2bc6 expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788843886.934486:0:22700:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.133@tcp lock: ffff9bd1153e7000/0xa762dfcbd58d2bbf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xa762dfcbd58d2bc6 expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788843886.934492:0:22700:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788843886.934524:0:22700:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.133@tcp lock: ffff9bd1153e7000/0xa762dfcbd58d2bbf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa762dfcbd58d2bc6 expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843886.934531:0:22700:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788843886.934551:0:22700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.133@tcp lock: ffff9bd1153e7000/0xa762dfcbd58d2bbf lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa762dfcbd58d2bc6 expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843886.934557:0:22700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.133@tcp lock: ffff9bd1153e7000/0xa762dfcbd58d2bbf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa762dfcbd58d2bc6 expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843886.934581:0:22700:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788843886.934584:0:22700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.133@tcp lock: ffff9bd007947c00/0xa762dfcbd58d2bb1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa762dfcbd58d2bb8 expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843886.934589:0:22700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd007947c00 already unused, calling callback (ffffffffc12a7c20) 10000000:00010000:1.0:1788843886.934592:0:22700:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.133@tcp lock: ffff9bd007947c00/0xa762dfcbd58d2bb1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa762dfcbd58d2bb8 expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843886.934598:0:22700:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.133@tcp lock: ffff9bd007947c00/0xa762dfcbd58d2bb1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa762dfcbd58d2bb8 expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788843886.934604:0:22700:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.133@tcp lock: ffff9bd007947c00/0xa762dfcbd58d2bb1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa762dfcbd58d2bb8 expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788843886.934608:0:22700:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788843886.934621:0:22700:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.133@tcp lock: ffff9bd007947c00/0xa762dfcbd58d2bb1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa762dfcbd58d2bb8 expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843886.934626:0:22700:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788843886.934642:0:22700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.133@tcp lock: ffff9bd007947c00/0xa762dfcbd58d2bb1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa762dfcbd58d2bb8 expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843886.934648:0:22700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.133@tcp lock: ffff9bd007947c00/0xa762dfcbd58d2bb1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa762dfcbd58d2bb8 expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843886.934661:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843886.934662:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843886.934664:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843886.934670:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788843886.934805:0:22727:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd1074fce00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22727:1875738134570112:0@lo:104: 00000100:00100000:3.0:1788843886.934817:0:22727:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd1074ff100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22727:1875738134570240:0@lo:104: 00010000:00010000:3.0:1788843886.934838:0:22727:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9bd1420e4200/0xa762dfcbd58d2c6e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843886.935375:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007357850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ce589ba-8334-438e-8f48-13932fcba8b1+21:24218:x1875738134569984:12345-0@lo:253:mount.lustre.0 Request processed in 9326us (10108us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843886.935386:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788843886.935599:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd1203d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0ce589ba-8334-438e-8f48-13932fcba8b1:3631:1875738134570368:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788843886.935635:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843886.935806:0:24218:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd1074fd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ce589ba-8334-438e-8f48-13932fcba8b1:24218:1875738134569984:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788843886.935817:0:24218:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1788843886.935820:0:24218:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788843886.935822:0:24218:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788843886.935823:0:24218:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788843886.935824:0:24218:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788843886.935825:0:24218:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788843886.935826:0:24218:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788843886.935828:0:24218:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788843886.935830:0:24218:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788843886.935831:0:24218:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788843886.935842:0:24218:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:1.0:1788843886.936876:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd1203d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0ce589ba-8334-438e-8f48-13932fcba8b1:3632:1875738134570496:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788843886.936976:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843886.937132:0:22698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134570368 00000100:00100000:2.0:1788843886.937164:0:22698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134570368 00010000:00010000:2.0:1788843886.937197:0:22698:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bd1420e4600/0xa762dfcbd58d2bc6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa762dfcbd58d2bbf expref: 21 pid: 22706 timeout: 764 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843886.937223:0:22698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134570496 00000100:00100000:2.0:1788843886.937226:0:22698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134570496 00010000:00010000:2.0:1788843886.937257:0:22698:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bd1420e4400/0xa762dfcbd58d2bb8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa762dfcbd58d2bb1 expref: 22 pid: 22706 timeout: 764 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843886.937277:0:22698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788843886.937285:0:22698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1203d2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0ce589ba-8334-438e-8f48-13932fcba8b1+22:3631:x1875738134570368:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788843886.937297:0:22698:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788843886.937303:0:22698:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bd1420e4600/0xa762dfcbd58d2bc6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa762dfcbd58d2bbf expref: 22 pid: 22706 timeout: 764 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843886.937315:0:22698:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bd1420e4600/0xa762dfcbd58d2bc6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa762dfcbd58d2bbf expref: 22 pid: 22706 timeout: 764 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843886.937333:0:22698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd1420e4600/0xa762dfcbd58d2bc6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa762dfcbd58d2bbf expref: 22 pid: 22706 timeout: 764 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843886.937346:0:22698:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788843886.937380:0:22698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1203d2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0ce589ba-8334-438e-8f48-13932fcba8b1+21:3631:x1875738134570368:12345-0@lo:103:ldlm_bl.0 Request processed in 95us (1744us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843886.937386:0:22698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788843886.937401:0:22698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788843886.937407:0:22698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd11504c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0ce589ba-8334-438e-8f48-13932fcba8b1+20:3632:x1875738134570496:12345-0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788843886.937527:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd1203d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0ce589ba-8334-438e-8f48-13932fcba8b1:3631:1875738134570368:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788843886.937563:0:22698:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788843886.937571:0:22698:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bd1420e4400/0xa762dfcbd58d2bb8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa762dfcbd58d2bb1 expref: 20 pid: 22706 timeout: 764 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843886.937580:0:22698:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bd1420e4400/0xa762dfcbd58d2bb8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa762dfcbd58d2bb1 expref: 20 pid: 22706 timeout: 764 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843886.937589:0:22698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd1420e4400/0xa762dfcbd58d2bb8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa762dfcbd58d2bb1 expref: 20 pid: 22706 timeout: 764 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843886.937609:0:22698:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9bd1420e4200/0xa762dfcbd58d2c6e lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843886.937617:0:22698:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd1420e4200/0xa762dfcbd58d2c6e lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788843886.937633:0:22698:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.016777481s 00010000:00010000:2.0:1788843886.937638:0:22698:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9bd1420e4200/0xa762dfcbd58d2c6e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843886.937644:0:22698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9bd1420e4200/0xa762dfcbd58d2c6e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843886.937651:0:22698:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9bd1420e4200/0xa762dfcbd58d2c6e lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843886.937657:0:22698:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9bd1420e4200/0xa762dfcbd58d2c6e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843886.937662:0:22698:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd1420e4200 already unused, calling callback (ffffffffc0cb1420) 00010000:00010000:2.0:1788843886.937666:0:22698:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9bd1420e4200/0xa762dfcbd58d2c6e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843886.937674:0:22698:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9bd1420e4200/0xa762dfcbd58d2c6e lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843886.938094:0:22698:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9bd1420e4200/0xa762dfcbd58d2c6e lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843886.938108:0:22698:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788843886.938178:0:22698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd11504c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0ce589ba-8334-438e-8f48-13932fcba8b1+19:3632:x1875738134570496:12345-0@lo:103:ldlm_bl.0 Request processed in 770us (1200us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843886.938185:0:22698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788843886.938511:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd1203d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0ce589ba-8334-438e-8f48-13932fcba8b1:3632:1875738134570496:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788843886.938578:0:22727:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9bd1420e4200/0xa762dfcbd58d2c6e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843886.938592:0:22727:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9bd1420e4200/0xa762dfcbd58d2c6e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843886.938598:0:22727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd1420e4200/0xa762dfcbd58d2c6e lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00000004:1.0:1788843886.944493:0:24218:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 12884901888 00002000:00080000:1.0:1788843886.950081:0:24218:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:1.0:1788843886.950090:0:24218:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:1.0:1788843886.950129:0:24218:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788843886.950357:0:24218:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.133@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788843886.950378:0:24218:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=49 00000080:00000004:1.0:1788843886.950403:0:24218:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:1.0:1788843886.952009:0:24218:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788843886.953063:0:24218:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1788843887.007005:0:3632:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788843887.007029:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007ba2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1875738134570624:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788843887.007099:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843887.007166:0:23743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134570624 00000100:00100000:2.0:1788843887.007174:0:23743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134570624 00000100:00100000:2.0:1788843887.007220:0:23743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788843887.007229:0:23743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007ba0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3632:x1875738134570624:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788843887.007274:0:23743:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788843887.007318:0:23743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007ba0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3632:x1875738134570624:12345-0@lo:41:osp-pre-1-0.0 Request processed in 89us (218us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843887.007325:0:23743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788843887.007375:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007ba2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1875738134570624:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788843887.007604:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f955880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1875738134570752:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788843887.007631:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843887.011854:0:22717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134570752 00000100:00100000:0.0:1788843887.011870:0:22717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134570752 00000100:00100000:0.0:1788843887.012517:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788843887.012530:0:22717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007ba2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3630:x1875738134570752:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788843887.012568:0:22717:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1788843887.012663:0:22717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007ba2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3630:x1875738134570752:12345-0@lo:41:osp-pre-0-1.0 Request processed in 136us (5030us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843887.012670:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788843887.014607:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f955880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1875738134570752:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1788843887.194456:0:23471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788843888.041318:0:24299:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788843888.041565:0:24299:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788843888.219944:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788843888.412591:0:22708:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788843888.412599:0:22708:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9bd007394000 from 13 10000000:01000000:0.0:1788843888.412603:0:22708:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788843888.412655:0:22708:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd10f7ae400/0xa762dfcbd58d2c75 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843888.412666:0:22708:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.133@tcp lock: ffff9bd10f7ae400/0xa762dfcbd58d2c75 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843888.412678:0:22708:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.133@tcp lock: ffff9bd10f7ae400/0xa762dfcbd58d2c75 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843888.412715:0:22708:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f956a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ce589ba-8334-438e-8f48-13932fcba8b1:22708:1875738134570880:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788843888.412798:0:22708:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843888.412854:0:22708:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd111590b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788843888.412918:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134570880 00000100:00100000:2.0:1788843888.412926:0:22704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134570880 00000100:00100000:2.0:1788843888.412985:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788843888.412997:0:22704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0018b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ce589ba-8334-438e-8f48-13932fcba8b1+19:22708:x1875738134570880:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788843888.413011:0:22704:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788843888.413025:0:22704:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd1153e7e00/0xa762dfcbd58d2c7c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa762dfcbd58d2c75 expref: -99 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843888.413048:0:22704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd1153e7e00/0xa762dfcbd58d2c7c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa762dfcbd58d2c75 expref: 20 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843888.413067:0:22704:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd1153e7e00/0xa762dfcbd58d2c7c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa762dfcbd58d2c75 expref: 20 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843888.413077:0:22704:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd1153e7e00, rc 0) 00000100:00100000:2.0:1788843888.413116:0:22704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0018b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ce589ba-8334-438e-8f48-13932fcba8b1+20:22708:x1875738134570880:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 121us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843888.413124:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788843888.413391:0:22708:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f956a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ce589ba-8334-438e-8f48-13932fcba8b1:22708:1875738134570880:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788843888.413409:0:22708:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.133@tcp lock: ffff9bd10f7ae400/0xa762dfcbd58d2c75 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d2c7c expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843888.413418:0:22708:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.133@tcp lock: ffff9bd10f7ae400/0xa762dfcbd58d2c75 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa762dfcbd58d2c7c expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843888.413475:0:22708:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f956a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ce589ba-8334-438e-8f48-13932fcba8b1:22708:1875738134571008:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788843888.413507:0:22708:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843888.413535:0:22708:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd111590b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788843888.413651:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134571008 00000100:00100000:2.0:1788843888.413655:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134571008 00000100:00100000:2.0:1788843888.413689:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788843888.413696:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0018b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ce589ba-8334-438e-8f48-13932fcba8b1+20:22708:x1875738134571008:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788843888.413709:0:22705:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788843888.413727:0:22705:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788843888.413730:0:22705:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 13 00000100:00100000:2.0:1788843888.413811:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0018b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ce589ba-8334-438e-8f48-13932fcba8b1+20:22708:x1875738134571008:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 115us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843888.413818:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788843888.413967:0:22708:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f956a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ce589ba-8334-438e-8f48-13932fcba8b1:22708:1875738134571008:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788843888.414022:0:22708:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.133@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788843888.414029:0:22708:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd10f7ae400/0xa762dfcbd58d2c75 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d2c7c expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843888.414036:0:22708:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.133@tcp lock: ffff9bd10f7ae400/0xa762dfcbd58d2c75 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d2c7c expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788843888.414045:0:22708:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788843888.414047:0:22708:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9bd127b94800 from 13 10000000:01000000:0.0:1788843888.414050:0:22708:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788843888.414066:0:22708:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd10f7afc00/0xa762dfcbd58d2c83 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843888.414083:0:22708:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.133@tcp lock: ffff9bd10f7afc00/0xa762dfcbd58d2c83 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843888.414090:0:22708:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.133@tcp lock: ffff9bd10f7afc00/0xa762dfcbd58d2c83 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843888.414103:0:22708:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f956a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ce589ba-8334-438e-8f48-13932fcba8b1:22708:1875738134571136:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788843888.414129:0:22708:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843888.414178:0:22708:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd111590b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788843888.414247:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134571136 00000100:00100000:2.0:1788843888.414252:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134571136 00000100:00100000:2.0:1788843888.414285:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788843888.414292:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0018b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ce589ba-8334-438e-8f48-13932fcba8b1+20:22708:x1875738134571136:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788843888.414299:0:22706:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788843888.414308:0:22706:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd1153e6200/0xa762dfcbd58d2c8a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa762dfcbd58d2c83 expref: -99 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843888.414323:0:22706:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd1153e6200/0xa762dfcbd58d2c8a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa762dfcbd58d2c83 expref: 21 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843888.414344:0:22706:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd1153e6200/0xa762dfcbd58d2c8a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa762dfcbd58d2c83 expref: 21 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843888.414351:0:22706:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd1153e6200, rc 0) 00000100:00100000:2.0:1788843888.414389:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0018b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ce589ba-8334-438e-8f48-13932fcba8b1+21:22708:x1875738134571136:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 87us (249us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843888.414396:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788843888.414514:0:22708:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f956a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ce589ba-8334-438e-8f48-13932fcba8b1:22708:1875738134571136:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788843888.414524:0:22708:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.133@tcp lock: ffff9bd10f7afc00/0xa762dfcbd58d2c83 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d2c8a expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843888.414532:0:22708:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.133@tcp lock: ffff9bd10f7afc00/0xa762dfcbd58d2c83 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa762dfcbd58d2c8a expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843888.414564:0:22708:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f956a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ce589ba-8334-438e-8f48-13932fcba8b1:22708:1875738134571264:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788843888.414589:0:22708:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843888.414613:0:22708:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd111590b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788843888.414853:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134571264 00000100:00100000:2.0:1788843888.414858:0:22704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134571264 00000100:00100000:2.0:1788843888.414889:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1788843888.414896:0:22704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0018b2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ce589ba-8334-438e-8f48-13932fcba8b1+21:22708:x1875738134571264:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788843888.414907:0:22704:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788843888.414918:0:22704:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788843888.414921:0:22704:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 13 00000100:00100000:2.0:1788843888.414993:0:22704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0018b2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ce589ba-8334-438e-8f48-13932fcba8b1+21:22708:x1875738134571264:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 97us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843888.415001:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788843888.415105:0:22708:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f956a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ce589ba-8334-438e-8f48-13932fcba8b1:22708:1875738134571264:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788843888.415172:0:22708:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.133@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788843888.415179:0:22708:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd10f7afc00/0xa762dfcbd58d2c83 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d2c8a expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843888.415186:0:22708:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.133@tcp lock: ffff9bd10f7afc00/0xa762dfcbd58d2c83 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d2c8a expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843889.242814:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788843889.823547:0:22748:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788843890.268286:0:23471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843891.299188:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788843892.126698:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788843892.126705:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788843892.126708:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788843892.126711:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788843892.126724:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788843892.126727:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788843892.126730:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788843892.126733:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788843892.126775:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007ba3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1875738134571392:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788843892.126859:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843892.126914:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd1203d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3631:1875738134571904:0@lo:400:kworker.0 00000100:00100000:1.0:1788843892.126941:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843892.126957:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd1203d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3631:1875738134572416:0@lo:400:kworker.0 00000100:00100000:1.0:1788843892.126976:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843892.127002:0:3631:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1788843892.127009:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd1203d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1875738134571776:0@lo:400:kworker.0 00000100:00100000:1.0:1788843892.127031:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843892.127048:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd1203d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3631:1875738134572288:0@lo:400:kworker.0 00000100:00100000:1.0:1788843892.127068:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843892.127091:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd1203d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1875738134571520:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788843892.127115:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843892.127133:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd1203d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1875738134572032:0@lo:400:kworker.0 00000100:00100000:1.0:1788843892.127171:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843892.127184:0:3632:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788843892.127189:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd1203d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0ce589ba-8334-438e-8f48-13932fcba8b1:3632:1875738134571648:0@lo:400:kworker.0 00000100:00100000:1.0:1788843892.127228:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843892.127251:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd1203d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3632:1875738134572160:0@lo:400:kworker.0 00000100:00100000:1.0:1788843892.127271:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843892.127306:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134571392 00000100:00100000:1.0:1788843892.127313:0:22716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134571392 00000100:00100000:1.0:1788843892.127346:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134571776 00000100:00100000:1.0:1788843892.127349:0:22716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134571776 00000100:00100000:1.0:1788843892.127359:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134571520 00000100:00100000:1.0:1788843892.127361:0:22716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134571520 00000100:00100000:1.0:1788843892.127370:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134572032 00000100:00100000:1.0:1788843892.127379:0:22716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134572032 00000100:00100000:1.0:1788843892.127395:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788843892.127404:0:22716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd008623100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3631:x1875738134571392:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788843892.127440:0:22716:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788843892.127487:0:22716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd008623100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3631:x1875738134571392:12345-0@lo:41:osp-pre-1-0.0 Request processed in 83us (627us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843892.127494:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788843892.127510:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788843892.127515:0:22716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd008623800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3631:x1875738134571776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843892.127543:0:22716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd008623800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3631:x1875738134571776:12345-0@lo:400:kworker.0 Request processed in 28us (512us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843892.127549:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788843892.127561:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788843892.127566:0:22716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd008622d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3632:x1875738134571520:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788843892.127580:0:22716:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1788843892.127610:0:22716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd008622d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3632:x1875738134571520:12345-0@lo:41:osp-pre-0-1.0 Request processed in 43us (494us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843892.127616:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788843892.127627:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788843892.127633:0:22716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd008620700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3632:x1875738134572032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843892.127659:0:22716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd008620700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3632:x1875738134572032:12345-0@lo:400:kworker.0 Request processed in 27us (487us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843892.127664:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788843892.127685:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134571904 00000100:00100000:1.0:1788843892.127688:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134571904 00000100:00100000:1.0:1788843892.127705:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134572416 00000100:00100000:1.0:1788843892.127715:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134572416 00000100:00100000:1.0:1788843892.127742:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134572288 00000100:00100000:1.0:1788843892.127744:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134572288 00000100:00100000:1.0:1788843892.127754:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134572160 00000100:00100000:1.0:1788843892.127756:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134572160 00000100:00100000:1.0:1788843892.127766:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788843892.127771:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd008622a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3631:x1875738134571904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843892.127799:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd008622a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3631:x1875738134571904:12345-0@lo:400:kworker.0 Request processed in 28us (857us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843892.127805:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788843892.127818:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788843892.127823:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd008622300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3631:x1875738134572416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843892.127849:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd008622300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3631:x1875738134572416:12345-0@lo:400:kworker.0 Request processed in 26us (872us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843892.127855:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788843892.127865:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788843892.127871:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd008621c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3631:x1875738134572288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843892.127891:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd008621c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3631:x1875738134572288:12345-0@lo:400:kworker.0 Request processed in 21us (822us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843892.127896:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788843892.127904:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788843892.127909:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd008620e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3632:x1875738134572160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843892.127926:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd008620e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3632:x1875738134572160:12345-0@lo:400:kworker.0 Request processed in 18us (656us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843892.127931:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788843892.127955:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134571648 00000100:00100000:1.0:1788843892.127959:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134571648 00000100:00100000:1.0:1788843892.127989:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1788843892.127995:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0018b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ce589ba-8334-438e-8f48-13932fcba8b1+21:3632:x1875738134571648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843892.128023:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0018b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ce589ba-8334-438e-8f48-13932fcba8b1+21:3632:x1875738134571648:12345-0@lo:400:kworker.0 Request processed in 28us (795us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843892.128028:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00080000:1.0:1788843892.128063:0:22707:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788843892.128067:0:22707:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788843892.128099:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd1203d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1875738134571776:0@lo:400:kworker.0 00010000:00080000:1.0:1788843892.128113:0:3631:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd1203d3800 x1875738134572288/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843908 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788843892.128124:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd1203d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3631:1875738134572288:0@lo:400:kworker.0 00000100:00100000:1.0:1788843892.128137:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007ba3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1875738134571392:0@lo:41:osp-pre-1-0.0 00010000:00080000:1.0:1788843892.128170:0:3631:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd1203d1880 x1875738134571904/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843908 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788843892.128178:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd1203d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3631:1875738134571904:0@lo:400:kworker.0 00010000:00080000:1.0:1788843892.128188:0:3631:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd1203d2300 x1875738134572416/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843908 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788843892.128196:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd1203d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3631:1875738134572416:0@lo:400:kworker.0 00000100:00100000:1.0:1788843892.128244:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd1203d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0ce589ba-8334-438e-8f48-13932fcba8b1:3632:1875738134571648:0@lo:400:kworker.0 00010000:00080000:1.0:1788843892.128255:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd1203d2680 x1875738134572160/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843908 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788843892.128262:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd1203d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3632:1875738134572160:0@lo:400:kworker.0 00000100:00100000:1.0:1788843892.128286:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd1203d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1875738134571520:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788843892.128294:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd1203d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1875738134572032:0@lo:400:kworker.0 00010000:00010000:1.0:1788843892.322240:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788843893.086807:0:23469:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788843893.341913:0:23471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788843894.244125:0:24590:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg333-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1788843894.363752:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788843895.227342:0:24642:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788843895.227619:0:24642:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788843895.389637:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788843896.155388:0:3629:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788843881/real 1788843881] req@ffff9bd1203d0000 x1875738134566656/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788843896 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788843896.155418:0:3629:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9bd1203d0000 x1875738134566656/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788843896 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788843896.155429:0:3629:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788843881/real 1788843881] req@ffff9bd1203d0a80 x1875738134566784/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788843896 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788843896.155454:0:3629:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9bd1203d0a80 x1875738134566784/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788843896 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788843896.155476:0:3629:0:(import.c:65:import_set_state_nolock()) ffff9bd13fabb000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788843896.155493:0:3629:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788843896.155498:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd1203d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3629:1875738134566656:0@lo:8:kworker.0 00000100:00080000:2.0:1788843896.155503:0:3629:0:(import.c:65:import_set_state_nolock()) ffff9bd112389800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788843896.155508:0:3629:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788843896.155511:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd1203d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3629:1875738134566784:0@lo:8:kworker.0 00000100:00080000:3.0:1788843896.155641:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788843896.155646:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788843896.155649:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788843896.155651:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788843896.155675:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788843896.155678:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1788843896.155682:0:8:0:(import.c:65:import_set_state_nolock()) ffff9bd13fabb000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788843896.155687:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 659 00000100:00080000:3.0:1788843896.155698:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788843896.155705:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9bd13fabb000 using connection 192.168.203.133@tcp/0@lo 00000100:00100000:3.0:1788843896.155726:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bd1074fdc00 x1875738134573056/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788843896.155739:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788843896.155741:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788843896.155743:0:8:0:(import.c:65:import_set_state_nolock()) ffff9bd112389800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788843896.155746:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 659 00000100:00080000:3.0:1788843896.155748:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788843896.155751:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9bd112389800 using connection 192.168.203.133@tcp/0@lo 00000100:00100000:3.0:1788843896.155762:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bd1074ffb80 x1875738134573184/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788843896.155802:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd1074fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3630:1875738134572800:0@lo:400:kworker.0 00000100:00100000:3.0:1788843896.156467:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843896.156520:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd1074ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3630:1875738134573568:0@lo:400:kworker.0 00000100:00100000:3.0:1788843896.156552:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843896.156634:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788843896.156641:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd1074fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1875738134572928:0@lo:400:kworker.0 00000100:00100000:3.0:1788843896.156676:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843896.156789:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd1074fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0ce589ba-8334-438e-8f48-13932fcba8b1:3632:1875738134572544:0@lo:400:kworker.0 00000100:00100000:1.0:1788843896.156825:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843896.156851:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd1074ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3632:1875738134573312:0@lo:400:kworker.0 00000100:00100000:1.0:1788843896.156871:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843896.156889:0:3632:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788843896.156895:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd1074ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1875738134572672:0@lo:400:kworker.0 00000100:00100000:1.0:1788843896.156914:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843896.156930:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd1074fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3632:1875738134573440:0@lo:400:kworker.0 00000100:00100000:1.0:1788843896.156947:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843896.156969:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134572800 00000100:00100000:1.0:1788843896.156976:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134572800 00000100:00100000:1.0:1788843896.157011:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134573568 00000100:00100000:1.0:1788843896.157014:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134573568 00000100:00100000:1.0:1788843896.157037:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134573312 00000100:00100000:1.0:1788843896.157040:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134573312 00000100:00100000:1.0:1788843896.157051:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134573440 00000100:00100000:1.0:1788843896.157053:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134573440 00000100:00100000:1.0:1788843896.157069:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788843896.157078:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1074fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3630:x1875738134572800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843896.157131:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1074fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3630:x1875738134572800:12345-0@lo:400:kworker.0 Request processed in 54us (665us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843896.157160:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788843896.157190:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788843896.157313:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd1074fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3629:1875738134573056:0@lo:8:kworker.0 00000100:00100000:2.0:1788843896.157348:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843896.157368:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd1074ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3629:1875738134573184:0@lo:8:kworker.0 00000100:00100000:2.0:1788843896.157392:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843896.157422:0:24222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134573056 00000100:00100000:2.0:1788843896.157426:0:24222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134573056 00000100:00100000:2.0:1788843896.157443:0:24222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134573184 00000100:00100000:2.0:1788843896.157445:0:24222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134573184 00000100:00100000:3.0:1788843896.157692:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134572544 00000100:00100000:3.0:1788843896.157696:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134572544 00000100:00100000:3.0:1788843896.157729:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788843896.157737:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0018b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ce589ba-8334-438e-8f48-13932fcba8b1+21:3632:x1875738134572544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788843896.157779:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0018b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ce589ba-8334-438e-8f48-13932fcba8b1+21:3632:x1875738134572544:12345-0@lo:400:kworker.0 Request processed in 42us (952us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843896.157795:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00010000:00080000:3.0:1788843896.157845:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd1074fce00 x1875738134572800/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843912 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788843896.157858:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd1074fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3630:1875738134572800:0@lo:400:kworker.0 00000100:00100000:1.0:1788843896.157915:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1074fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3630:x1875738134573568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843896.157952:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1074fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3630:x1875738134573568:12345-0@lo:400:kworker.0 Request processed in 39us (1399us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843896.157958:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788843896.157972:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788843896.157979:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd008623b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3632:x1875738134573312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843896.158008:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd008623b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3632:x1875738134573312:12345-0@lo:400:kworker.0 Request processed in 30us (1135us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843896.158013:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788843896.158025:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788843896.158031:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd008623480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3632:x1875738134573440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843896.158057:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd008623480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3632:x1875738134573440:12345-0@lo:400:kworker.0 Request processed in 26us (1108us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843896.158063:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788843896.158086:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134572928 00000100:00100000:1.0:1788843896.158090:0:22716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134572928 00000100:00100000:1.0:1788843896.158112:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134572672 00000100:00100000:1.0:1788843896.158115:0:22716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134572672 00000100:00100000:1.0:1788843896.158128:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788843896.158134:0:22716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f962d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3630:x1875738134572928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843896.158223:0:22716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f962d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3630:x1875738134572928:12345-0@lo:400:kworker.0 Request processed in 88us (1545us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843896.158229:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788843896.158242:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788843896.158248:0:22716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd008620380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3632:x1875738134572672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843896.158273:0:22716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd008620380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3632:x1875738134572672:12345-0@lo:400:kworker.0 Request processed in 26us (1358us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843896.158284:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:1.0:1788843896.158307:0:22707:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788843896.158311:0:22707:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788843896.158498:0:24222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788843896.158506:0:24222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007ba1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3629:x1875738134573056:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1788843896.158533:0:24222:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 674 last 0 00000020:00000080:2.0:1788843896.158577:0:24222:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xa762dfcbd58d2c91 00002000:00100000:2.0:1788843896.158593:0:24222:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff9bd00178e800 ocd_connect_flags: 0xa044401443000026 ocd_version: 211396f ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:2.0:1788843896.158597:0:24222:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:2.0:1788843896.158600:0:24222:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1788843896.158769:0:24222:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:2.0:1788843896.158794:0:24222:0:(import.c:65:import_set_state_nolock()) ffff9bd00178e000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788843896.158850:0:24222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007ba1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3629:x1875738134573056:12345-0@lo:8:kworker.0 Request processed in 343us (1500us total) trans 0 rc 0/0 00010000:00080000:1.0:1788843896.158904:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd1074fdc00 x1875738134573056/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788843916 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788843896.158913:0:3629:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788843896.158921:0:3629:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 3 00000100:00080000:1.0:1788843896.158929:0:3629:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1788843896.158933:0:3629:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1788843896.158935:0:3629:0:(import.c:65:import_set_state_nolock()) ffff9bd13fabb000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1788843896.158949:0:3629:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1788843896.158954:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd1074fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3629:1875738134573056:0@lo:8:kworker.0 00000100:00100000:3.0:1788843896.159337:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd1074fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1875738134572928:0@lo:400:kworker.0 00010000:00080000:3.0:1788843896.159350:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd1074ff800 x1875738134573568/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843912 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788843896.159359:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd1074ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3630:1875738134573568:0@lo:400:kworker.0 00000004:00080000:3.0:1788843896.159418:0:23455:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:3.0:1788843896.159441:0:23455:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f961500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23455:1875738134573824:0@lo:7:osp-pre-0-1.0 00000100:00100000:3.0:1788843896.159478:0:23455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843896.159498:0:23455:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd10300f780 going to sleep for 11 seconds 00000100:00100000:3.0:1788843896.159508:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788843896.159514:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f962680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1875738134573696:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788843896.159537:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843896.159671:0:24225:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1788843896.159679:0:24225:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:3.0:1788843896.159716:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd1074ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1875738134572672:0@lo:400:kworker.0 00010000:00080000:3.0:1788843896.159734:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd1074fd180 x1875738134573440/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843912 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788843896.159744:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd1074fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3632:1875738134573440:0@lo:400:kworker.0 00000100:00100000:3.0:1788843896.159753:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd1074fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0ce589ba-8334-438e-8f48-13932fcba8b1:3632:1875738134572544:0@lo:400:kworker.0 00010000:00080000:3.0:1788843896.159777:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd1074ff480 x1875738134573312/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843912 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788843896.159786:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd1074ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3632:1875738134573312:0@lo:400:kworker.0 00000100:00100000:1.0:1788843896.159999:0:24225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134573824 00000100:00100000:1.0:1788843896.160006:0:24225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134573824 00000100:00080000:1.0:1788843896.160048:0:22707:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788843896.160192:0:24686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788843896.160323:0:24686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007ba2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3629:x1875738134573184:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1788843896.160351:0:24686:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788843896.160904:0:24222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788843896.160931:0:24222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788843896.160941:0:24222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f963800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:23455:x1875738134573824:12345-0@lo:7:osp-pre-0-1.0 00000004:00080000:1.0:1788843896.162216:0:23454:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1788843896.162311:0:23454:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 674215169649ns, next at 0ns, rc = 0 00080000:00080000:1.0:1788843896.162319:0:23454:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:2.0:1788843896.169515:0:24226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134573696 00000100:00100000:2.0:1788843896.169529:0:24226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134573696 00000100:00100000:2.0:1788843896.169592:0:24226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788843896.169603:0:24226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f961880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3630:x1875738134573696:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788843896.169632:0:24226:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3915857920 avail 3684335616 00000100:00100000:2.0:1788843896.169720:0:24226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f961880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3630:x1875738134573696:12345-0@lo:13:osp-pre-0-1.0 Request processed in 119us (10181us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843896.169726:0:24226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1788843896.169796:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd10f962680 x1875738134573696/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788843912 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788843896.169833:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f962680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1875738134573696:0@lo:13:osp-pre-0-1.0 00002000:00080000:2.0:1788843896.171685:0:24222:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:2.0:1788843896.171693:0:24222:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x41:0x0] 00000100:00100000:2.0:1788843896.171778:0:24222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f963800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:23455:x1875738134573824:12345-0@lo:7:osp-pre-0-1.0 Request processed in 10837us (12296us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843896.171788:0:24222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1788843896.172378:0:23455:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd10f961500 x1875738134573824/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788843912 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788843896.172406:0:23455:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f961500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23455:1875738134573824:0@lo:7:osp-pre-0-1.0 00000004:00080000:0.0:1788843896.172423:0:23455:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x41:0x0] 00000100:00100000:0.0:1788843896.172469:0:23455:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f954e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23455:1875738134573952:0@lo:5:osp-pre-0-1.0 00000100:00100000:0.0:1788843896.172509:0:23455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843896.172542:0:23455:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd13e936180 going to sleep for 11 seconds 00000100:00100000:2.0:1788843896.172657:0:24225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134573952 00000100:00100000:2.0:1788843896.172664:0:24225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134573952 00000100:00100000:2.0:1788843896.172705:0:24225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788843896.172714:0:24225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f954380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:23455:x1875738134573952:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:2.0:1788843896.172748:0:24225:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = 0 00000100:00100000:2.0:1788843896.172784:0:24225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f954380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:23455:x1875738134573952:12345-0@lo:5:osp-pre-0-1.0 Request processed in 72us (275us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843896.172791:0:24225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1788843896.172819:0:23455:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd10f954e00 x1875738134573952/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788843912 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788843896.172828:0:23455:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f954e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23455:1875738134573952:0@lo:5:osp-pre-0-1.0 00000004:00080000:0.0:1788843896.174758:0:23446:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00000004:00080000:2.0:1788843896.175338:0:23455:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x41:0x0] from OST, last_created [0x280000400:0x41:0x0]last_used is [0x280000400:0x41:0x0] 00000100:00100000:2.0:1788843896.175404:0:23455:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007ba0a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23455:1875738134574080:0@lo:5:osp-pre-0-1.0 00000100:00100000:2.0:1788843896.175469:0:23455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843896.175504:0:23455:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd1050cf780 going to sleep for 11 seconds 00000100:00100000:0.0:1788843896.176695:0:24222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134574080 00000100:00100000:0.0:1788843896.176706:0:24222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134574080 00000100:00100000:0.0:1788843896.176763:0:24222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788843896.176773:0:24222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007ba3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:23455:x1875738134574080:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:0.0:1788843896.176819:0:24222:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 66 00000100:00100000:3.0:1788843896.201586:0:24686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007ba2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3629:x1875738134573184:12345-0@lo:8:kworker.0 Request processed in 41257us (44184us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788843896.201600:0:24686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:2.0:1788843896.202055:0:3629:0:(import.c:65:import_set_state_nolock()) ffff9bd112389800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788843896.202062:0:3629:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788843896.202066:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd1074ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3629:1875738134573184:0@lo:8:kworker.0 00000001:00080000:2.0:1788843896.213420:0:24219:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901889 is committed 00000001:00100000:2.0:1788843896.213435:0:24219:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:3.0:1788843896.213695:0:24222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007ba3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:23455:x1875738134574080:12345-0@lo:5:osp-pre-0-1.0 Request processed in 36918us (38220us total) trans 12884901889 rc 0/0 00000100:00100000:3.0:1788843896.213708:0:24222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1788843896.219979:0:23455:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd007ba0a80 x1875738134574080/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788843912 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788843896.219995:0:23455:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 12884901889 gen 2 00000100:00100000:2.0:1788843896.220003:0:23455:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007ba0a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23455:1875738134574080:0@lo:5:osp-pre-0-1.0 00000004:00080000:2.0:1788843896.220021:0:23455:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x41:0x0]-[0x280000400:0x61:0x0] 00000100:00100000:2.0:1788843896.220081:0:23455:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007ba0a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:23455:1875738134574208:0@lo:900:osp-pre-0-1.0 00000100:00100000:2.0:1788843896.220183:0:23455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843896.220337:0:23455:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd1050cf780 going to sleep for 11 seconds 00000100:00100000:2.0:1788843896.220378:0:22723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134574208 00000100:00100000:2.0:1788843896.220385:0:22723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134574208 00000100:00100000:2.0:1788843896.220431:0:22723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788843896.220441:0:22723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007ba1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:23455:x1875738134574208:12345-0@lo:900:osp-pre-0-1.0 00000100:00100000:2.0:1788843896.220496:0:22723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007ba1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:23455:x1875738134574208:12345-0@lo:900:osp-pre-0-1.0 Request processed in 56us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843896.220504:0:22723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788843896.220536:0:23455:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd007ba0a80 x1875738134574208/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788843912 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788843896.220546:0:23455:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007ba0a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:23455:1875738134574208:0@lo:900:osp-pre-0-1.0 00000020:00000004:3.0:1788843896.227090:0:24693:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788843896.227481:0:24693:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788843896.413365:0:23471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788843897.242617:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd008621880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1875738134574336:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788843897.242715:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843897.242836:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134574336 00000100:00100000:3.0:1788843897.242860:0:22716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134574336 00000100:00100000:3.0:1788843897.242930:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788843897.242942:0:22716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f957800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3632:x1875738134574336:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788843897.242984:0:22716:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1788843897.243444:0:22716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f957800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3632:x1875738134574336:12345-0@lo:41:osp-pre-0-1.0 Request processed in 503us (726us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843897.243454:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788843897.243548:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd008621880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1875738134574336:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788843897.244216:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007ba0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1875738134574464:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788843897.244270:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843897.245009:0:22717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134574464 00000100:00100000:1.0:1788843897.245020:0:22717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134574464 00000100:00100000:1.0:1788843897.245082:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788843897.245093:0:22717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007ba0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3633:x1875738134574464:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788843897.245129:0:22717:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788843897.245234:0:22717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007ba0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3633:x1875738134574464:12345-0@lo:41:osp-pre-1-0.0 Request processed in 142us (962us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843897.245242:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788843897.245277:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007ba0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1875738134574464:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788843897.435262:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788843898.470320:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788843899.052587:0:22748:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788843899.482407:0:23471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843900.521829:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788843901.277075:0:3629:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788843881/real 1788843881] req@ffff9bd1203d1c00 x1875738134566400/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788843901 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788843901.277115:0:3629:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9bd1203d1c00 x1875738134566400/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788843901 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788843901.277126:0:3629:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788843881/real 1788843881] req@ffff9bd1203d1f80 x1875738134566528/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788843901 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788843901.277164:0:3629:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9bd1203d1f80 x1875738134566528/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788843901 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788843901.277190:0:3629:0:(import.c:65:import_set_state_nolock()) ffff9bd10f7b9800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788843901.277221:0:3629:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788843901.277236:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd1203d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3629:1875738134566400:0@lo:8:kworker.0 00000100:00080000:1.0:1788843901.277243:0:3629:0:(import.c:65:import_set_state_nolock()) ffff9bd0059c6000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788843901.277249:0:3629:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788843901.277252:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd1203d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3629:1875738134566528:0@lo:8:kworker.0 00000100:00080000:0.0:1788843901.277570:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788843901.277576:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1788843901.277579:0:8:0:(import.c:65:import_set_state_nolock()) ffff9bd10f7b9800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788843901.277587:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 659 00000100:00080000:0.0:1788843901.277592:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1788843901.277600:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9bd10f7b9800 using connection 192.168.203.133@tcp/0@lo 00000100:00100000:0.0:1788843901.277622:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bd10f955f80 x1875738134574848/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788843901.277644:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788843901.277660:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788843901.277662:0:8:0:(import.c:65:import_set_state_nolock()) ffff9bd0059c6000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788843901.277666:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 659 00000100:00080000:0.0:1788843901.277668:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1788843901.277672:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9bd0059c6000 using connection 192.168.203.133@tcp/0@lo 00000100:00100000:0.0:1788843901.277686:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bd10f955500 x1875738134574976/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788843901.277728:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788843901.277732:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788843901.277734:0:8:0:(import.c:65:import_set_state_nolock()) ffff9bd112389800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788843901.277737:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 674 00000100:00080000:0.0:1788843901.277740:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1788843901.277743:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9bd112389800 using connection 192.168.203.133@tcp/0@lo 00000100:00100000:0.0:1788843901.277754:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bd10f954700 x1875738134575488/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788843901.277804:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f954e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3632:1875738134575104:0@lo:400:kworker.0 00000100:00100000:0.0:1788843901.277872:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843901.277929:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f957b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3632:1875738134575744:0@lo:400:kworker.0 00000100:00100000:0.0:1788843901.277957:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843901.277983:0:3632:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788843901.277990:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f956a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1875738134575232:0@lo:400:kworker.0 00000100:00100000:3.0:1788843901.278024:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f954a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0ce589ba-8334-438e-8f48-13932fcba8b1:3630:1875738134574592:0@lo:400:kworker.0 00000100:00100000:0.0:1788843901.278024:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843901.278053:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f956d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3632:1875738134575872:0@lo:400:kworker.0 00000100:00100000:0.0:1788843901.278109:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843901.278117:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843901.278220:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f955880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1875738134575360:0@lo:400:kworker.0 00000100:00100000:3.0:1788843901.278269:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843901.278299:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788843901.278306:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f956680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1875738134574720:0@lo:400:kworker.0 00000100:00100000:3.0:1788843901.278331:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843901.278351:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f957480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3630:1875738134575616:0@lo:400:kworker.0 00000100:00100000:3.0:1788843901.278389:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843901.278420:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134575232 00000100:00100000:3.0:1788843901.278429:0:22716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134575232 00000100:00100000:3.0:1788843901.278497:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134574720 00000100:00100000:3.0:1788843901.278500:0:22716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134574720 00000100:00100000:3.0:1788843901.278520:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788843901.278530:0:22716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f954000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3632:x1875738134575232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788843901.278588:0:22716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f954000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3632:x1875738134575232:12345-0@lo:400:kworker.0 Request processed in 60us (570us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843901.278596:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788843901.278615:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788843901.278622:0:22716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f962680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3630:x1875738134574720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788843901.278653:0:22716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f962680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3630:x1875738134574720:12345-0@lo:400:kworker.0 Request processed in 32us (321us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843901.278659:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788843901.278681:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134574592 00000100:00100000:3.0:1788843901.278684:0:22704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134574592 00000100:00100000:3.0:1788843901.278714:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788843901.278721:0:22704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0018b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ce589ba-8334-438e-8f48-13932fcba8b1+21:3630:x1875738134574592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788843901.278752:0:22704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0018b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ce589ba-8334-438e-8f48-13932fcba8b1+21:3630:x1875738134574592:12345-0@lo:400:kworker.0 Request processed in 33us (639us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843901.278769:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788843901.278803:0:24224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134575360 00000100:00100000:3.0:1788843901.278806:0:24224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134575360 00000100:00100000:3.0:1788843901.278846:0:24224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788843901.278853:0:24224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f961500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3630:x1875738134575360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788843901.278883:0:24224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f961500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3630:x1875738134575360:12345-0@lo:400:kworker.0 Request processed in 31us (614us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843901.278890:0:24224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788843901.278940:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f956680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1875738134574720:0@lo:400:kworker.0 00000100:00100000:3.0:1788843901.278964:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f954a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0ce589ba-8334-438e-8f48-13932fcba8b1:3630:1875738134574592:0@lo:400:kworker.0 00000100:00100000:0.0:1788843901.278991:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f956a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1875738134575232:0@lo:400:kworker.0 00010000:00080000:3.0:1788843901.278992:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd10f955880 x1875738134575360/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788843917 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788843901.279018:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f955880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1875738134575360:0@lo:400:kworker.0 00000100:00100000:0.0:1788843901.279060:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134575104 00000100:00100000:0.0:1788843901.279067:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134575104 00000100:00100000:0.0:1788843901.279100:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134575744 00000100:00100000:0.0:1788843901.279102:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134575744 00000100:00100000:0.0:1788843901.279126:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134575872 00000100:00100000:0.0:1788843901.279129:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134575872 00000100:00100000:0.0:1788843901.279169:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134575616 00000100:00100000:0.0:1788843901.279172:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134575616 00000100:00100000:0.0:1788843901.279186:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788843901.279192:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f955c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3632:x1875738134575104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788843901.279253:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f955c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3632:x1875738134575104:12345-0@lo:400:kworker.0 Request processed in 61us (1381us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843901.279260:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788843901.279276:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788843901.279282:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f956300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3632:x1875738134575744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788843901.279390:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f956300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3632:x1875738134575744:12345-0@lo:400:kworker.0 Request processed in 108us (1432us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843901.279397:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788843901.279409:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788843901.279415:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd00723d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3632:x1875738134575872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788843901.279442:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd00723d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3632:x1875738134575872:12345-0@lo:400:kworker.0 Request processed in 27us (1334us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843901.279448:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788843901.279457:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788843901.279463:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1074ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3630:x1875738134575616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788843901.279491:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1074ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3630:x1875738134575616:12345-0@lo:400:kworker.0 Request processed in 29us (1102us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843901.279507:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788843901.279538:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f955f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3629:1875738134574848:0@lo:8:kworker.0 00000100:00100000:0.0:1788843901.279568:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843901.279598:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f955500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3629:1875738134574976:0@lo:8:kworker.0 00000100:00100000:0.0:1788843901.279623:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843901.279637:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f954700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3629:1875738134575488:0@lo:8:kworker.0 00000100:00100000:0.0:1788843901.279658:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843901.279939:0:24686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134574848 00000100:00100000:3.0:1788843901.279949:0:24686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134574848 00000100:00100000:3.0:1788843901.279987:0:24686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134574976 00000100:00100000:3.0:1788843901.279990:0:24686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134574976 00000100:00100000:3.0:1788843901.279999:0:24686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134575488 00000100:00100000:3.0:1788843901.280003:0:24686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134575488 00000100:00100000:3.0:1788843901.280026:0:24686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788843901.280032:0:24686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd00723d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3629:x1875738134574848:12345-0@lo:8:kworker.0 00000100:00100000:0.0:1788843901.280041:0:24225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788843901.280051:0:24225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd00723ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3629:x1875738134574976:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1788843901.280073:0:24686:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 679 last 0 00010000:00020000:0.0:1788843901.280074:0:24225:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00080000:1.0:1788843901.280106:0:22707:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788843901.280114:0:22707:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788843901.280120:0:22707:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00000080:3.0:1788843901.280126:0:24686:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa762dfcbd58d2c98 00000100:00100000:0.0:1788843901.280177:0:24225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd00723ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3629:x1875738134574976:12345-0@lo:8:kworker.0 Request processed in 81us (507us total) trans 0 rc -19/-19 00002000:00100000:3.0:1788843901.280182:0:24686:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9bd10f903000 ocd_connect_flags: 0xa044401443000026 ocd_version: 211396f ocd_grant: 0 ocd_index: 0 ocd_group 0 00000100:00100000:0.0:1788843901.280191:0:24225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00002000:00080000:3.0:1788843901.280194:0:24686:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:3.0:1788843901.280212:0:24686:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:0.0:1788843901.280222:0:24225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788843901.280228:0:24225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd00723e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3629:x1875738134575488:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1788843901.280239:0:24225:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788843901.280270:0:24225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd00723e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3629:x1875738134575488:12345-0@lo:8:kworker.0 Request processed in 41us (610us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788843901.280277:0:24225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00002000:00080000:3.0:1788843901.280321:0:24686:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788843901.280355:0:24686:0:(import.c:65:import_set_state_nolock()) ffff9bd007701000 : changing import state from RECOVER to FULL 00000100:00080000:0.0:1788843901.280422:0:3629:0:(import.c:65:import_set_state_nolock()) ffff9bd0059c6000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788843901.280430:0:3629:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788843901.280435:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f955500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3629:1875738134574976:0@lo:8:kworker.0 00000100:00080000:0.0:1788843901.280444:0:3629:0:(import.c:65:import_set_state_nolock()) ffff9bd112389800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788843901.280447:0:3629:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788843901.280460:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f954700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3629:1875738134575488:0@lo:8:kworker.0 00000100:00100000:3.0:1788843901.280639:0:24686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd00723d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3629:x1875738134574848:12345-0@lo:8:kworker.0 Request processed in 603us (1068us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843901.280647:0:24686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1788843901.280715:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd10f956d80 x1875738134575872/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843917 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788843901.280729:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f956d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3632:1875738134575872:0@lo:400:kworker.0 00010000:00080000:3.0:1788843901.280745:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd10f954e00 x1875738134575104/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843917 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788843901.280753:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f954e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3632:1875738134575104:0@lo:400:kworker.0 00010000:00080000:3.0:1788843901.280766:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd10f957b80 x1875738134575744/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843917 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788843901.280773:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f957b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3632:1875738134575744:0@lo:400:kworker.0 00010000:00080000:3.0:1788843901.280817:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd10f957480 x1875738134575616/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843917 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788843901.280825:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f957480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3630:1875738134575616:0@lo:400:kworker.0 00010000:00080000:0.0:1788843901.282609:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd10f955f80 x1875738134574848/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788843926 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788843901.282629:0:3629:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788843901.283004:0:3629:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 3 00000100:00080000:0.0:1788843901.283079:0:3629:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1788843901.283085:0:3629:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1788843901.283090:0:3629:0:(import.c:65:import_set_state_nolock()) ffff9bd10f7b9800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1788843901.283397:0:3629:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1788843901.283406:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f955f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3629:1875738134574848:0@lo:8:kworker.0 00000004:00080000:3.0:1788843901.283530:0:22737:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x22:0x0] 00000100:00100000:3.0:1788843901.283556:0:22737:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd1074fd500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22737:1875738134576128:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1788843901.283619:0:22736:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1788843901.283720:0:22736:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 679336578301ns, next at 0ns, rc = 0 00080000:00080000:1.0:1788843901.283727:0:22736:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:1.0:1788843901.283883:0:3631:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788843901.283894:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd1074ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1875738134576000:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788843901.283926:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843901.283975:0:24226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134576000 00000100:00100000:1.0:1788843901.283982:0:24226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134576000 00000100:00100000:1.0:1788843901.284377:0:24226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788843901.284388:0:24226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd008622680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3631:x1875738134576000:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788843901.284416:0:24226:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3915857920 avail 3684335616 00000100:00100000:1.0:1788843901.284464:0:24226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd008622680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3631:x1875738134576000:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (537us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843901.284471:0:24226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:1.0:1788843901.284495:0:22707:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788843901.284521:0:3631:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd1074ff480 x1875738134576000/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788843917 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788843901.284537:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd1074ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1875738134576000:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788843901.284625:0:22737:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843901.284653:0:22737:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd11ae7bf00 going to sleep for 11 seconds 00000100:00100000:1.0:1788843901.284698:0:24225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134576128 00000100:00100000:1.0:1788843901.284750:0:24225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134576128 00000100:00100000:1.0:1788843901.284788:0:24225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788843901.284795:0:24225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1074fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:22737:x1875738134576128:12345-0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1788843901.293171:0:22691:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00080000:1.0:1788843901.298053:0:24225:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:1.0:1788843901.298065:0:24225:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = -31 00002000:02000040:1.0:1788843901.298072:0:24225:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:35 to 0x280000401:65) 00002000:00010000:2.0:1788843901.320175:0:24225:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788843901.320187:0:24225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000436b382/0xa762dfcbd58d2c9f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843901.320207:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x41:0x0].0x0 since=679s v=(0 0) 00010000:00010000:2.0:1788843901.320212:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x41:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788843901.320219:0:24225:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000436b382/0xa762dfcbd58d2c9f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843901.320237:0:24225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000436b382/0xa762dfcbd58d2c9f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843901.320253:0:24225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000436b382/0xa762dfcbd58d2c9f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843901.320261:0:24225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000436b382/0xa762dfcbd58d2c9f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843901.320284:0:24225:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788843901.323886:0:22699:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788843901.323898:0:22699:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000436b382/0xa762dfcbd58d2c9f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843901.323910:0:22699:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd1153e7000 already unused, calling callback (ffffffffc0cb1420) 00010000:00010000:1.0:1788843901.323915:0:22699:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000436b382/0xa762dfcbd58d2c9f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843901.323925:0:22699:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000436b382/0xa762dfcbd58d2c9f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843901.323960:0:22699:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000436b382/0xa762dfcbd58d2c9f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843901.323969:0:22699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000436b382/0xa762dfcbd58d2c9f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843901.323992:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843901.323995:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843901.323997:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788843901.326011:0:24225:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788843901.326024:0:24225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ab43c061/0xa762dfcbd58d2ca6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843901.326040:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x40:0x0].0x0 since=679s v=(0 0) 00010000:00010000:2.0:1788843901.326044:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788843901.326050:0:24225:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ab43c061/0xa762dfcbd58d2ca6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843901.326063:0:24225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ab43c061/0xa762dfcbd58d2ca6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843901.326073:0:24225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ab43c061/0xa762dfcbd58d2ca6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843901.326080:0:24225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ab43c061/0xa762dfcbd58d2ca6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843901.326196:0:24225:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788843901.327609:0:24225:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788843901.327621:0:24225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c326052e/0xa762dfcbd58d2cad lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843901.327635:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3f:0x0].0x0 since=679s v=(0 0) 00010000:00010000:0.0:1788843901.327639:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788843901.327645:0:24225:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c326052e/0xa762dfcbd58d2cad lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843901.327660:0:24225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c326052e/0xa762dfcbd58d2cad lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843901.327670:0:24225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c326052e/0xa762dfcbd58d2cad lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843901.327678:0:24225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c326052e/0xa762dfcbd58d2cad lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843901.331986:0:23471:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788843901.332001:0:23471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ab43c061/0xa762dfcbd58d2ca6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843901.332015:0:23471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd1153e6800 already unused, calling callback (ffffffffc0cb1420) 00010000:00010000:1.0:1788843901.332020:0:23471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab43c061/0xa762dfcbd58d2ca6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843901.332031:0:23471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab43c061/0xa762dfcbd58d2ca6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843901.332053:0:23471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ab43c061/0xa762dfcbd58d2ca6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843901.332060:0:23471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ab43c061/0xa762dfcbd58d2ca6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843901.332102:0:23471:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788843901.332106:0:23471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c326052e/0xa762dfcbd58d2cad lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843901.332112:0:23471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd10f7aee00 already unused, calling callback (ffffffffc0cb1420) 00010000:00010000:1.0:1788843901.332115:0:23471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c326052e/0xa762dfcbd58d2cad lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843901.332124:0:23471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c326052e/0xa762dfcbd58d2cad lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843901.332157:0:23471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c326052e/0xa762dfcbd58d2cad lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843901.332166:0:23471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843901.332168:0:23471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843901.332171:0:23471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843901.332386:0:24225:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788843901.332394:0:24225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c326052e/0xa762dfcbd58d2cad lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843901.332964:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788843901.333079:0:24225:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788843901.333087:0:24225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cb3ff51a/0xa762dfcbd58d2cb4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843901.333100:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3e:0x0].0x0 since=679s v=(0 0) 00010000:00010000:0.0:1788843901.333105:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788843901.333111:0:24225:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cb3ff51a/0xa762dfcbd58d2cb4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843901.333122:0:24225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cb3ff51a/0xa762dfcbd58d2cb4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843901.333131:0:24225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cb3ff51a/0xa762dfcbd58d2cb4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843901.333411:0:24225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cb3ff51a/0xa762dfcbd58d2cb4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843901.333434:0:24225:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788843901.333705:0:22699:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788843901.333713:0:22699:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cb3ff51a/0xa762dfcbd58d2cb4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843901.333720:0:22699:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd10f7ae600 already unused, calling callback (ffffffffc0cb1420) 00010000:00010000:1.0:1788843901.333724:0:22699:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cb3ff51a/0xa762dfcbd58d2cb4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843901.333745:0:22699:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cb3ff51a/0xa762dfcbd58d2cb4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843901.333758:0:22699:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cb3ff51a/0xa762dfcbd58d2cb4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843901.333765:0:22699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cb3ff51a/0xa762dfcbd58d2cb4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843901.333781:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843901.333783:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843901.333784:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788843901.333980:0:24225:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788843901.333987:0:24225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009a092430/0xa762dfcbd58d2cbb lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843901.334002:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3d:0x0].0x0 since=679s v=(0 0) 00010000:00010000:0.0:1788843901.334006:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788843901.334010:0:24225:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009a092430/0xa762dfcbd58d2cbb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843901.334019:0:24225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009a092430/0xa762dfcbd58d2cbb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843901.334026:0:24225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009a092430/0xa762dfcbd58d2cbb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843901.334032:0:24225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009a092430/0xa762dfcbd58d2cbb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843901.334946:0:24225:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788843901.338757:0:24225:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788843901.338771:0:24225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aeda8cb3/0xa762dfcbd58d2cc2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843901.338788:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3c:0x0].0x0 since=679s v=(0 0) 00010000:00010000:0.0:1788843901.338794:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788843901.338810:0:24225:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aeda8cb3/0xa762dfcbd58d2cc2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843901.338825:0:24225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000aeda8cb3/0xa762dfcbd58d2cc2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843901.341007:0:24225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aeda8cb3/0xa762dfcbd58d2cc2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843901.341022:0:24225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000aeda8cb3/0xa762dfcbd58d2cc2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843901.342369:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd1074ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1875738134576256:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788843901.342449:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843901.342529:0:24226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134576256 00000100:00100000:3.0:1788843901.342537:0:24226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134576256 00000100:00100000:3.0:1788843901.342583:0:24226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788843901.342592:0:24226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1074ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3631:x1875738134576256:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788843901.342618:0:24226:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3915857920 avail 3684335616 00000100:00100000:3.0:1788843901.342663:0:24226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1074ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3631:x1875738134576256:12345-0@lo:13:osp-pre-0-1.0 Request processed in 72us (215us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843901.342671:0:24226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788843901.342719:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd1074ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1875738134576256:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1788843901.346534:0:23471:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788843901.346548:0:23471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009a092430/0xa762dfcbd58d2cbb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843901.346561:0:23471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd10f7aec00 already unused, calling callback (ffffffffc0cb1420) 00010000:00010000:1.0:1788843901.346567:0:23471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009a092430/0xa762dfcbd58d2cbb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843901.346578:0:23471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009a092430/0xa762dfcbd58d2cbb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843901.346600:0:23471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009a092430/0xa762dfcbd58d2cbb lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843901.346622:0:23471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009a092430/0xa762dfcbd58d2cbb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843901.352286:0:24225:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788843901.352311:0:23471:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788843901.352321:0:23471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000aeda8cb3/0xa762dfcbd58d2cc2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843901.352334:0:23471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd10f7ae200 already unused, calling callback (ffffffffc0cb1420) 00010000:00010000:0.0:1788843901.352338:0:23471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000aeda8cb3/0xa762dfcbd58d2cc2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843901.352350:0:23471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000aeda8cb3/0xa762dfcbd58d2cc2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843901.352373:0:23471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000aeda8cb3/0xa762dfcbd58d2cc2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843901.352382:0:23471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aeda8cb3/0xa762dfcbd58d2cc2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843901.352403:0:23471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843901.352413:0:23471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843901.352415:0:23471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843901.352676:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788843901.353115:0:24225:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788843901.353123:0:24225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e9414993/0xa762dfcbd58d2cc9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843901.353174:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3b:0x0].0x0 since=679s v=(0 0) 00010000:00010000:0.0:1788843901.353180:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788843901.353186:0:24225:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e9414993/0xa762dfcbd58d2cc9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843901.353199:0:24225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e9414993/0xa762dfcbd58d2cc9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843901.353209:0:24225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e9414993/0xa762dfcbd58d2cc9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843901.353215:0:24225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e9414993/0xa762dfcbd58d2cc9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843901.353232:0:24225:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788843901.353545:0:24225:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788843901.353551:0:24225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007d8a2fd/0xa762dfcbd58d2cd0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843901.353560:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3a:0x0].0x0 since=679s v=(0 0) 00010000:00010000:0.0:1788843901.353564:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788843901.353568:0:24225:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000007d8a2fd/0xa762dfcbd58d2cd0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843901.353585:0:24225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000007d8a2fd/0xa762dfcbd58d2cd0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843901.353593:0:24225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007d8a2fd/0xa762dfcbd58d2cd0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843901.353599:0:24225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000007d8a2fd/0xa762dfcbd58d2cd0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843901.353615:0:24225:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788843901.353623:0:23471:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788843901.353628:0:23471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e9414993/0xa762dfcbd58d2cc9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843901.353634:0:23471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd10f7af000 already unused, calling callback (ffffffffc0cb1420) 00010000:00010000:0.0:1788843901.353637:0:23471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e9414993/0xa762dfcbd58d2cc9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843901.353645:0:23471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e9414993/0xa762dfcbd58d2cc9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843901.353656:0:23471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e9414993/0xa762dfcbd58d2cc9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843901.353663:0:23471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e9414993/0xa762dfcbd58d2cc9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843901.353685:0:23471:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788843901.353689:0:23471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000007d8a2fd/0xa762dfcbd58d2cd0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843901.353695:0:23471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd10f7ae800 already unused, calling callback (ffffffffc0cb1420) 00010000:00010000:0.0:1788843901.353699:0:23471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000007d8a2fd/0xa762dfcbd58d2cd0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843901.353707:0:23471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000007d8a2fd/0xa762dfcbd58d2cd0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843901.353718:0:23471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000007d8a2fd/0xa762dfcbd58d2cd0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843901.353725:0:23471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000007d8a2fd/0xa762dfcbd58d2cd0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843901.353737:0:23471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843901.353739:0:23471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843901.353741:0:23471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843901.355764:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788843901.355997:0:24225:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788843901.356007:0:24225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003ea6c0d6/0xa762dfcbd58d2cd7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843901.356022:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x39:0x0].0x0 since=679s v=(0 0) 00010000:00010000:3.0:1788843901.356027:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788843901.356033:0:24225:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003ea6c0d6/0xa762dfcbd58d2cd7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843901.356049:0:24225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003ea6c0d6/0xa762dfcbd58d2cd7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843901.356059:0:24225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003ea6c0d6/0xa762dfcbd58d2cd7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843901.356067:0:24225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003ea6c0d6/0xa762dfcbd58d2cd7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843901.356105:0:24225:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788843901.356575:0:22700:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788843901.356582:0:22700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003ea6c0d6/0xa762dfcbd58d2cd7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843901.356592:0:22700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd1420e4400 already unused, calling callback (ffffffffc0cb1420) 00010000:00010000:1.0:1788843901.356597:0:22700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003ea6c0d6/0xa762dfcbd58d2cd7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843901.356607:0:22700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003ea6c0d6/0xa762dfcbd58d2cd7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843901.356625:0:22700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003ea6c0d6/0xa762dfcbd58d2cd7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843901.356634:0:22700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003ea6c0d6/0xa762dfcbd58d2cd7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843901.356652:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843901.356654:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843901.356656:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788843901.356771:0:24225:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788843901.356776:0:24225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000feef1e72/0xa762dfcbd58d2cde lrc: 3/0,1 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843901.356786:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x38:0x0].0x0 since=679s v=(0 0) 00010000:00010000:3.0:1788843901.356790:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788843901.356794:0:24225:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000feef1e72/0xa762dfcbd58d2cde lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843901.356914:0:24225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000feef1e72/0xa762dfcbd58d2cde lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843901.356925:0:24225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000feef1e72/0xa762dfcbd58d2cde lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843901.356934:0:24225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000feef1e72/0xa762dfcbd58d2cde lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843901.356951:0:24225:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788843901.357964:0:23471:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788843901.357975:0:23471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000feef1e72/0xa762dfcbd58d2cde lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843901.357985:0:23471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd1420e4200 already unused, calling callback (ffffffffc0cb1420) 00010000:00010000:0.0:1788843901.357996:0:23471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000feef1e72/0xa762dfcbd58d2cde lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843901.358006:0:23471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000feef1e72/0xa762dfcbd58d2cde lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843901.358023:0:23471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000feef1e72/0xa762dfcbd58d2cde lrc: 1/0,0 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843901.358031:0:23471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000feef1e72/0xa762dfcbd58d2cde lrc: 0/0,0 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843901.358047:0:23471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843901.358049:0:23471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843901.358051:0:23471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788843901.358196:0:24225:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788843901.358204:0:24225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000050a2c32f/0xa762dfcbd58d2ce5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843901.358215:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x37:0x0].0x0 since=679s v=(0 0) 00010000:00010000:3.0:1788843901.358224:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788843901.358230:0:24225:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000050a2c32f/0xa762dfcbd58d2ce5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843901.358241:0:24225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000050a2c32f/0xa762dfcbd58d2ce5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843901.358251:0:24225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000050a2c32f/0xa762dfcbd58d2ce5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843901.358259:0:24225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000050a2c32f/0xa762dfcbd58d2ce5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843901.358282:0:24225:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788843901.359970:0:22699:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788843901.359982:0:22699:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000050a2c32f/0xa762dfcbd58d2ce5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843901.359995:0:22699:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd1420e4600 already unused, calling callback (ffffffffc0cb1420) 00010000:00010000:0.0:1788843901.360000:0:22699:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000050a2c32f/0xa762dfcbd58d2ce5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843901.360011:0:22699:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000050a2c32f/0xa762dfcbd58d2ce5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843901.360030:0:22699:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000050a2c32f/0xa762dfcbd58d2ce5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843901.360050:0:22699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000050a2c32f/0xa762dfcbd58d2ce5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843901.360074:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843901.360076:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843901.360078:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788843901.361110:0:24225:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788843901.361123:0:24225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000054283b65/0xa762dfcbd58d2cec lrc: 3/0,1 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843901.361179:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x36:0x0].0x0 since=679s v=(0 0) 00010000:00010000:3.0:1788843901.361185:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788843901.361191:0:24225:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000054283b65/0xa762dfcbd58d2cec lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843901.361206:0:24225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000054283b65/0xa762dfcbd58d2cec lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843901.361217:0:24225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000054283b65/0xa762dfcbd58d2cec lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843901.361232:0:24225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000054283b65/0xa762dfcbd58d2cec lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843901.361255:0:24225:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788843901.361643:0:22700:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788843901.361650:0:22700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000054283b65/0xa762dfcbd58d2cec lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843901.361660:0:22700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd118f70000 already unused, calling callback (ffffffffc0cb1420) 00010000:00010000:0.0:1788843901.361665:0:22700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000054283b65/0xa762dfcbd58d2cec lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843901.361674:0:22700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000054283b65/0xa762dfcbd58d2cec lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843901.361691:0:22700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000054283b65/0xa762dfcbd58d2cec lrc: 1/0,0 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843901.361699:0:22700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000054283b65/0xa762dfcbd58d2cec lrc: 0/0,0 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843901.361717:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843901.361719:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843901.361721:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788843901.362202:0:24225:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788843901.362209:0:24225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ac962e58/0xa762dfcbd58d2cf3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843901.362220:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x35:0x0].0x0 since=679s v=(0 0) 00010000:00010000:3.0:1788843901.362224:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788843901.362229:0:24225:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ac962e58/0xa762dfcbd58d2cf3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843901.362240:0:24225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ac962e58/0xa762dfcbd58d2cf3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843901.362248:0:24225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ac962e58/0xa762dfcbd58d2cf3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843901.362256:0:24225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ac962e58/0xa762dfcbd58d2cf3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843901.362274:0:24225:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788843901.362642:0:23471:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788843901.362648:0:23471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ac962e58/0xa762dfcbd58d2cf3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843901.362657:0:23471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd118f70600 already unused, calling callback (ffffffffc0cb1420) 00010000:00010000:0.0:1788843901.362661:0:23471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ac962e58/0xa762dfcbd58d2cf3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843901.362670:0:23471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ac962e58/0xa762dfcbd58d2cf3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843901.362685:0:23471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ac962e58/0xa762dfcbd58d2cf3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843901.362693:0:23471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ac962e58/0xa762dfcbd58d2cf3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843901.362709:0:23471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843901.362711:0:23471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843901.362712:0:23471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788843901.366218:0:24225:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788843901.366239:0:24225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e4e75d57/0xa762dfcbd58d2cfa lrc: 3/0,1 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843901.366256:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x34:0x0].0x0 since=679s v=(0 0) 00010000:00010000:1.0:1788843901.366262:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788843901.366268:0:24225:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e4e75d57/0xa762dfcbd58d2cfa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843901.366282:0:24225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e4e75d57/0xa762dfcbd58d2cfa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843901.366293:0:24225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e4e75d57/0xa762dfcbd58d2cfa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843901.366302:0:24225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e4e75d57/0xa762dfcbd58d2cfa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843901.366323:0:24225:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788843901.366555:0:22699:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788843901.366563:0:22699:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e4e75d57/0xa762dfcbd58d2cfa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843901.366578:0:22699:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd007947400 already unused, calling callback (ffffffffc0cb1420) 00010000:00010000:3.0:1788843901.366582:0:22699:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e4e75d57/0xa762dfcbd58d2cfa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843901.366592:0:22699:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e4e75d57/0xa762dfcbd58d2cfa lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843901.366611:0:22699:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e4e75d57/0xa762dfcbd58d2cfa lrc: 1/0,0 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843901.366619:0:22699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e4e75d57/0xa762dfcbd58d2cfa lrc: 0/0,0 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843901.366637:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788843901.366639:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788843901.366641:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788843901.367000:0:24225:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788843901.367008:0:24225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000070f1b190/0xa762dfcbd58d2d01 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843901.367016:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x33:0x0].0x0 since=679s v=(0 0) 00010000:00010000:1.0:1788843901.367019:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788843901.367023:0:24225:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000070f1b190/0xa762dfcbd58d2d01 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843901.367032:0:24225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000070f1b190/0xa762dfcbd58d2d01 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843901.367046:0:24225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000070f1b190/0xa762dfcbd58d2d01 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843901.367052:0:24225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000070f1b190/0xa762dfcbd58d2d01 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843901.367073:0:24225:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788843901.367246:0:22700:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788843901.367253:0:22700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000070f1b190/0xa762dfcbd58d2d01 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843901.367260:0:22700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd007946c00 already unused, calling callback (ffffffffc0cb1420) 00010000:00010000:3.0:1788843901.367263:0:22700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000070f1b190/0xa762dfcbd58d2d01 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843901.367270:0:22700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000070f1b190/0xa762dfcbd58d2d01 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843901.367288:0:22700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000070f1b190/0xa762dfcbd58d2d01 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843901.367296:0:22700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000070f1b190/0xa762dfcbd58d2d01 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843901.367310:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788843901.367312:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788843901.367314:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788843901.368057:0:24225:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788843901.368065:0:24225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000092bcb600/0xa762dfcbd58d2d08 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843901.368075:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x32:0x0].0x0 since=679s v=(0 0) 00010000:00010000:3.0:1788843901.368079:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788843901.368085:0:24225:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000092bcb600/0xa762dfcbd58d2d08 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843901.368095:0:24225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000092bcb600/0xa762dfcbd58d2d08 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843901.368104:0:24225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000092bcb600/0xa762dfcbd58d2d08 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843901.368113:0:24225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000092bcb600/0xa762dfcbd58d2d08 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843901.368170:0:24225:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788843901.368332:0:23471:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788843901.368339:0:23471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000092bcb600/0xa762dfcbd58d2d08 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843901.368348:0:23471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd118f71000 already unused, calling callback (ffffffffc0cb1420) 00010000:00010000:1.0:1788843901.368352:0:23471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000092bcb600/0xa762dfcbd58d2d08 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843901.368361:0:23471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000092bcb600/0xa762dfcbd58d2d08 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843901.368375:0:23471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000092bcb600/0xa762dfcbd58d2d08 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843901.368383:0:23471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000092bcb600/0xa762dfcbd58d2d08 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843901.368402:0:23471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843901.368409:0:23471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843901.368412:0:23471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788843901.369071:0:24225:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788843901.369078:0:24225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ffc5647f/0xa762dfcbd58d2d0f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843901.369089:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x31:0x0].0x0 since=679s v=(0 0) 00010000:00010000:3.0:1788843901.369092:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788843901.369096:0:24225:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ffc5647f/0xa762dfcbd58d2d0f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843901.369106:0:24225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ffc5647f/0xa762dfcbd58d2d0f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843901.369115:0:24225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ffc5647f/0xa762dfcbd58d2d0f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843901.369123:0:24225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ffc5647f/0xa762dfcbd58d2d0f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843901.369184:0:24225:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788843901.369409:0:22699:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788843901.369416:0:22699:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ffc5647f/0xa762dfcbd58d2d0f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843901.369425:0:22699:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd007be3a00 already unused, calling callback (ffffffffc0cb1420) 00010000:00010000:1.0:1788843901.369429:0:22699:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ffc5647f/0xa762dfcbd58d2d0f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843901.369438:0:22699:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ffc5647f/0xa762dfcbd58d2d0f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843901.369450:0:22699:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ffc5647f/0xa762dfcbd58d2d0f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843901.369458:0:22699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ffc5647f/0xa762dfcbd58d2d0f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843901.369473:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843901.369475:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843901.369477:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788843901.369706:0:24225:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788843901.369711:0:24225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008db1e87c/0xa762dfcbd58d2d16 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843901.369720:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x30:0x0].0x0 since=679s v=(0 0) 00010000:00010000:3.0:1788843901.369730:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788843901.369735:0:24225:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008db1e87c/0xa762dfcbd58d2d16 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843901.369744:0:24225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008db1e87c/0xa762dfcbd58d2d16 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843901.369751:0:24225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008db1e87c/0xa762dfcbd58d2d16 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843901.369758:0:24225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008db1e87c/0xa762dfcbd58d2d16 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843901.369781:0:24225:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788843901.371471:0:22700:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788843901.371484:0:22700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008db1e87c/0xa762dfcbd58d2d16 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843901.371496:0:22700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd007be2200 already unused, calling callback (ffffffffc0cb1420) 00010000:00010000:1.0:1788843901.371500:0:22700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008db1e87c/0xa762dfcbd58d2d16 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843901.371524:0:22700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008db1e87c/0xa762dfcbd58d2d16 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843901.371542:0:22700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008db1e87c/0xa762dfcbd58d2d16 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843901.371550:0:22700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008db1e87c/0xa762dfcbd58d2d16 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843901.371571:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843901.371573:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843901.371575:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788843901.372118:0:24225:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788843901.372128:0:24225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a581158d/0xa762dfcbd58d2d1d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843901.372469:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f:0x0].0x0 since=679s v=(0 0) 00010000:00010000:3.0:1788843901.372474:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788843901.372481:0:24225:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a581158d/0xa762dfcbd58d2d1d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843901.372494:0:24225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a581158d/0xa762dfcbd58d2d1d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843901.372504:0:24225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a581158d/0xa762dfcbd58d2d1d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843901.372529:0:24225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a581158d/0xa762dfcbd58d2d1d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843901.372547:0:24225:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788843901.373075:0:24225:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788843901.373081:0:24225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000008b6bf6/0xa762dfcbd58d2d24 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843901.373090:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e:0x0].0x0 since=679s v=(0 0) 00010000:00010000:3.0:1788843901.373094:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788843901.373097:0:24225:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000008b6bf6/0xa762dfcbd58d2d24 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843901.373106:0:24225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000008b6bf6/0xa762dfcbd58d2d24 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843901.373114:0:24225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000008b6bf6/0xa762dfcbd58d2d24 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843901.373412:0:23471:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788843901.373420:0:23471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a581158d/0xa762dfcbd58d2d1d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843901.373428:0:23471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd007be2000 already unused, calling callback (ffffffffc0cb1420) 00010000:00010000:1.0:1788843901.373433:0:23471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a581158d/0xa762dfcbd58d2d1d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843901.373441:0:23471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a581158d/0xa762dfcbd58d2d1d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843901.373461:0:23471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a581158d/0xa762dfcbd58d2d1d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843901.373481:0:23471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a581158d/0xa762dfcbd58d2d1d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843901.373498:0:23471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843901.373500:0:23471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843901.373502:0:23471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788843901.373560:0:24225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000008b6bf6/0xa762dfcbd58d2d24 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843901.373582:0:24225:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788843901.374442:0:22699:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788843901.374451:0:22699:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000008b6bf6/0xa762dfcbd58d2d24 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843901.374461:0:22699:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd007be3600 already unused, calling callback (ffffffffc0cb1420) 00010000:00010000:1.0:1788843901.374466:0:22699:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000008b6bf6/0xa762dfcbd58d2d24 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843901.374475:0:22699:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000008b6bf6/0xa762dfcbd58d2d24 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843901.374490:0:22699:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000008b6bf6/0xa762dfcbd58d2d24 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843901.374499:0:22699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000008b6bf6/0xa762dfcbd58d2d24 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843901.374514:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843901.374516:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843901.374518:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788843901.374671:0:24225:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788843901.374678:0:24225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000db0a7cef/0xa762dfcbd58d2d2b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843901.374694:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d:0x0].0x0 since=679s v=(0 0) 00010000:00010000:3.0:1788843901.375592:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788843901.375603:0:24225:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000db0a7cef/0xa762dfcbd58d2d2b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843901.375619:0:24225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db0a7cef/0xa762dfcbd58d2d2b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843901.375630:0:24225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000db0a7cef/0xa762dfcbd58d2d2b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843901.375640:0:24225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000db0a7cef/0xa762dfcbd58d2d2b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843901.375666:0:24225:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788843901.376237:0:22700:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788843901.376245:0:22700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000db0a7cef/0xa762dfcbd58d2d2b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843901.376255:0:22700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd007be2a00 already unused, calling callback (ffffffffc0cb1420) 00010000:00010000:1.0:1788843901.376260:0:22700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000db0a7cef/0xa762dfcbd58d2d2b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843901.376270:0:22700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000db0a7cef/0xa762dfcbd58d2d2b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843901.376286:0:22700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000db0a7cef/0xa762dfcbd58d2d2b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843901.376294:0:22700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db0a7cef/0xa762dfcbd58d2d2b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843901.376312:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843901.376314:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843901.376315:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788843901.377539:0:24225:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788843901.377554:0:24225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000094ab9f32/0xa762dfcbd58d2d32 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843901.377572:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c:0x0].0x0 since=679s v=(0 0) 00010000:00010000:2.0:1788843901.377577:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788843901.377582:0:24225:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000094ab9f32/0xa762dfcbd58d2d32 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843901.377597:0:24225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000094ab9f32/0xa762dfcbd58d2d32 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843901.377606:0:24225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000094ab9f32/0xa762dfcbd58d2d32 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843901.377617:0:24225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000094ab9f32/0xa762dfcbd58d2d32 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843901.377707:0:24225:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788843901.377840:0:23471:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788843901.377847:0:23471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000094ab9f32/0xa762dfcbd58d2d32 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843901.377921:0:23471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd1153e7c00 already unused, calling callback (ffffffffc0cb1420) 00010000:00010000:1.0:1788843901.377925:0:23471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000094ab9f32/0xa762dfcbd58d2d32 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843901.377955:0:23471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000094ab9f32/0xa762dfcbd58d2d32 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843901.377971:0:23471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000094ab9f32/0xa762dfcbd58d2d32 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843901.377978:0:23471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000094ab9f32/0xa762dfcbd58d2d32 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843901.377999:0:23471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843901.378001:0:23471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843901.378004:0:23471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788843901.378717:0:24225:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788843901.379346:0:24225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069bb5ad6/0xa762dfcbd58d2d39 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843901.379361:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b:0x0].0x0 since=679s v=(0 0) 00010000:00010000:2.0:1788843901.379374:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788843901.379379:0:24225:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000069bb5ad6/0xa762dfcbd58d2d39 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843901.379392:0:24225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000069bb5ad6/0xa762dfcbd58d2d39 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843901.379400:0:24225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069bb5ad6/0xa762dfcbd58d2d39 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843901.379408:0:24225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000069bb5ad6/0xa762dfcbd58d2d39 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843901.379432:0:24225:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788843901.381011:0:22699:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788843901.381023:0:22699:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000069bb5ad6/0xa762dfcbd58d2d39 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843901.381036:0:22699:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd1153e7200 already unused, calling callback (ffffffffc0cb1420) 00010000:00010000:0.0:1788843901.381041:0:22699:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000069bb5ad6/0xa762dfcbd58d2d39 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843901.381068:0:22699:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000069bb5ad6/0xa762dfcbd58d2d39 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843901.381086:0:22699:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000069bb5ad6/0xa762dfcbd58d2d39 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843901.381094:0:22699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000069bb5ad6/0xa762dfcbd58d2d39 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843901.381115:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843901.381117:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843901.381119:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788843901.395225:0:24225:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788843901.395240:0:24225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069bb5ad6/0xa762dfcbd58d2d40 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843901.395256:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a:0x0].0x0 since=679s v=(0 0) 00010000:00010000:2.0:1788843901.395261:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788843901.395267:0:24225:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000069bb5ad6/0xa762dfcbd58d2d40 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843901.395282:0:24225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000069bb5ad6/0xa762dfcbd58d2d40 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843901.395293:0:24225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069bb5ad6/0xa762dfcbd58d2d40 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843901.395308:0:24225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000069bb5ad6/0xa762dfcbd58d2d40 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843901.395369:0:24225:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788843901.397886:0:24225:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788843901.397899:0:24225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000094ab9f32/0xa762dfcbd58d2d47 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843901.397916:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x29:0x0].0x0 since=679s v=(0 0) 00010000:00010000:2.0:1788843901.397921:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788843901.397927:0:24225:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000094ab9f32/0xa762dfcbd58d2d47 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843901.397940:0:24225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000094ab9f32/0xa762dfcbd58d2d47 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843901.397950:0:24225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000094ab9f32/0xa762dfcbd58d2d47 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843901.397959:0:24225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000094ab9f32/0xa762dfcbd58d2d47 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843901.402834:0:22700:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788843901.402856:0:22700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000069bb5ad6/0xa762dfcbd58d2d40 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843901.402872:0:22700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd1153e7200 already unused, calling callback (ffffffffc0cb1420) 00010000:00010000:1.0:1788843901.402877:0:22700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000069bb5ad6/0xa762dfcbd58d2d40 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843901.402889:0:22700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000069bb5ad6/0xa762dfcbd58d2d40 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843901.402913:0:22700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000069bb5ad6/0xa762dfcbd58d2d40 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843901.402935:0:22700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000069bb5ad6/0xa762dfcbd58d2d40 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843901.403995:0:24225:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788843901.405922:0:22700:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788843901.405931:0:22700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000094ab9f32/0xa762dfcbd58d2d47 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843901.405954:0:22700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd1153e7c00 already unused, calling callback (ffffffffc0cb1420) 00010000:00010000:2.0:1788843901.405960:0:22700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000094ab9f32/0xa762dfcbd58d2d47 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843901.405971:0:22700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000094ab9f32/0xa762dfcbd58d2d47 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843901.405992:0:22700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000094ab9f32/0xa762dfcbd58d2d47 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843901.406005:0:22700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000094ab9f32/0xa762dfcbd58d2d47 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843901.406031:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788843901.406033:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843901.407045:0:23471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788843901.411843:0:24225:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788843901.411969:0:24225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000008da1907/0xa762dfcbd58d2d4e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843901.411988:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x28:0x0].0x0 since=679s v=(0 0) 00010000:00010000:3.0:1788843901.411993:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788843901.412000:0:24225:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000008da1907/0xa762dfcbd58d2d4e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843901.412015:0:24225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000008da1907/0xa762dfcbd58d2d4e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843901.412039:0:24225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000008da1907/0xa762dfcbd58d2d4e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843901.412048:0:24225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000008da1907/0xa762dfcbd58d2d4e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843901.412075:0:24225:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788843901.412486:0:24225:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788843901.412492:0:24225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d108c08f/0xa762dfcbd58d2d55 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843901.412500:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x27:0x0].0x0 since=679s v=(0 0) 00010000:00010000:3.0:1788843901.412504:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788843901.412508:0:24225:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d108c08f/0xa762dfcbd58d2d55 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843901.412518:0:24225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d108c08f/0xa762dfcbd58d2d55 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843901.412526:0:24225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d108c08f/0xa762dfcbd58d2d55 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843901.412533:0:24225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d108c08f/0xa762dfcbd58d2d55 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843901.412560:0:24225:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788843901.412895:0:22700:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788843901.412903:0:22700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000008da1907/0xa762dfcbd58d2d4e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843901.412912:0:22700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd007be3200 already unused, calling callback (ffffffffc0cb1420) 00010000:00010000:2.0:1788843901.412918:0:22700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000008da1907/0xa762dfcbd58d2d4e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843901.412927:0:22700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000008da1907/0xa762dfcbd58d2d4e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843901.412959:0:22700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000008da1907/0xa762dfcbd58d2d4e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843901.412966:0:22700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000008da1907/0xa762dfcbd58d2d4e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843901.412985:0:22700:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788843901.412989:0:22700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d108c08f/0xa762dfcbd58d2d55 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843901.412995:0:22700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd007be2800 already unused, calling callback (ffffffffc0cb1420) 00010000:00010000:2.0:1788843901.412999:0:22700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d108c08f/0xa762dfcbd58d2d55 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843901.413006:0:22700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d108c08f/0xa762dfcbd58d2d55 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843901.413014:0:22700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d108c08f/0xa762dfcbd58d2d55 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843901.413021:0:22700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d108c08f/0xa762dfcbd58d2d55 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843901.413032:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788843901.413034:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788843901.413041:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788843901.413451:0:24225:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788843901.413457:0:24225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b0acc4a0/0xa762dfcbd58d2d5c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843901.413467:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x26:0x0].0x0 since=679s v=(0 0) 00010000:00010000:3.0:1788843901.413471:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788843901.413476:0:24225:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b0acc4a0/0xa762dfcbd58d2d5c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843901.413485:0:24225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b0acc4a0/0xa762dfcbd58d2d5c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843901.413492:0:24225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b0acc4a0/0xa762dfcbd58d2d5c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843901.413499:0:24225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b0acc4a0/0xa762dfcbd58d2d5c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843901.413523:0:24225:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788843901.413771:0:23471:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788843901.413778:0:23471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b0acc4a0/0xa762dfcbd58d2d5c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843901.413785:0:23471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd007be3800 already unused, calling callback (ffffffffc0cb1420) 00010000:00010000:1.0:1788843901.413788:0:23471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b0acc4a0/0xa762dfcbd58d2d5c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843901.413796:0:23471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b0acc4a0/0xa762dfcbd58d2d5c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843901.413821:0:23471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b0acc4a0/0xa762dfcbd58d2d5c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843901.413828:0:23471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b0acc4a0/0xa762dfcbd58d2d5c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843901.413845:0:23471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843901.413856:0:23471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843901.413858:0:23471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843901.413865:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788843901.414132:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788843901.414317:0:24225:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788843901.414324:0:24225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000064461fa2/0xa762dfcbd58d2d63 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843901.414333:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x25:0x0].0x0 since=679s v=(0 0) 00010000:00010000:3.0:1788843901.414345:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788843901.414350:0:24225:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000064461fa2/0xa762dfcbd58d2d63 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843901.414361:0:24225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000064461fa2/0xa762dfcbd58d2d63 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843901.414369:0:24225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000064461fa2/0xa762dfcbd58d2d63 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843901.414376:0:24225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000064461fa2/0xa762dfcbd58d2d63 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843901.414392:0:24225:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788843901.414679:0:23471:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788843901.414694:0:23471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000064461fa2/0xa762dfcbd58d2d63 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843901.414702:0:23471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd007be3000 already unused, calling callback (ffffffffc0cb1420) 00010000:00010000:1.0:1788843901.414706:0:23471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000064461fa2/0xa762dfcbd58d2d63 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843901.414715:0:23471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000064461fa2/0xa762dfcbd58d2d63 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843901.414740:0:23471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000064461fa2/0xa762dfcbd58d2d63 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843901.414747:0:23471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000064461fa2/0xa762dfcbd58d2d63 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843901.414765:0:23471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843901.414768:0:23471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843901.414770:0:23471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788843901.417079:0:24225:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788843901.417094:0:24225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ab43c061/0xa762dfcbd58d2d6a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843901.417111:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x24:0x0].0x0 since=679s v=(0 0) 00010000:00010000:2.0:1788843901.417115:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788843901.417121:0:24225:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ab43c061/0xa762dfcbd58d2d6a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843901.417164:0:24225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ab43c061/0xa762dfcbd58d2d6a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843901.417177:0:24225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ab43c061/0xa762dfcbd58d2d6a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843901.417186:0:24225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ab43c061/0xa762dfcbd58d2d6a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843901.417206:0:24225:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788843901.417597:0:22699:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788843901.417606:0:22699:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ab43c061/0xa762dfcbd58d2d6a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843901.417615:0:22699:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd1153e6800 already unused, calling callback (ffffffffc0cb1420) 00010000:00010000:0.0:1788843901.417619:0:22699:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab43c061/0xa762dfcbd58d2d6a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843901.417629:0:22699:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab43c061/0xa762dfcbd58d2d6a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843901.417648:0:22699:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ab43c061/0xa762dfcbd58d2d6a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843901.417668:0:22699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ab43c061/0xa762dfcbd58d2d6a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843901.417686:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843901.417687:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843901.417689:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788843901.418002:0:24225:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788843901.418009:0:24225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000436b382/0xa762dfcbd58d2d71 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843901.418017:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x23:0x0].0x0 since=679s v=(0 0) 00010000:00010000:2.0:1788843901.418021:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788843901.418025:0:24225:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000436b382/0xa762dfcbd58d2d71 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843901.418040:0:24225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000436b382/0xa762dfcbd58d2d71 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843901.418048:0:24225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000436b382/0xa762dfcbd58d2d71 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843901.418054:0:24225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000436b382/0xa762dfcbd58d2d71 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843901.418387:0:24225:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:2.0:1788843901.418445:0:24225:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:34 00000100:00100000:2.0:1788843901.418550:0:24225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1074fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:22737:x1875738134576128:12345-0@lo:5:osp-pre-0-0.0 Request processed in 133750us (133920us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843901.418560:0:24225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788843901.418762:0:22737:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd1074fd500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22737:1875738134576128:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1788843901.418779:0:22737:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x41:0x0] from OST, last_created [0x280000401:0x41:0x0]last_used is [0x280000401:0x22:0x0] 00000100:00100000:1.0:1788843901.418837:0:22737:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd008620a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22737:1875738134576384:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1788843901.419035:0:22737:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843901.419066:0:22737:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd104a350c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788843901.419113:0:24222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134576384 00000100:00100000:3.0:1788843901.419122:0:24222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134576384 00000100:00100000:3.0:1788843901.419192:0:24222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788843901.419201:0:24222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd008621f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:22737:x1875738134576384:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:3.0:1788843901.419238:0:24222:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 66 00000001:00080000:2.0:1788843901.427757:0:24219:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901890 is committed 00000001:00100000:2.0:1788843901.427823:0:24219:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:0.0:1788843901.428010:0:22700:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788843901.428022:0:22700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000436b382/0xa762dfcbd58d2d71 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843901.428035:0:22700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd1153e7000 already unused, calling callback (ffffffffc0cb1420) 00010000:00010000:0.0:1788843901.428041:0:22700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000436b382/0xa762dfcbd58d2d71 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843901.428053:0:22700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000436b382/0xa762dfcbd58d2d71 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843901.428076:0:22700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000436b382/0xa762dfcbd58d2d71 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843901.428085:0:22700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000436b382/0xa762dfcbd58d2d71 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843901.428106:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843901.428108:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843901.428110:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788843901.428353:0:24222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd008621f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:22737:x1875738134576384:12345-0@lo:5:osp-pre-0-0.0 Request processed in 9148us (9314us total) trans 12884901890 rc 0/0 00000100:00100000:3.0:1788843901.428363:0:24222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788843901.428525:0:22737:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 12884901890 gen 2 00000100:00100000:0.0:1788843901.428534:0:22737:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd008620a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22737:1875738134576384:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1788843901.428552:0:22737:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x41:0x0]-[0x280000401:0x61:0x0] 00010000:00010000:3.0:1788843901.531587:0:23471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788843902.363261:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007ba0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1875738134576512:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788843902.363339:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843902.363398:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134576512 00000100:00100000:2.0:1788843902.363406:0:22716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134576512 00000100:00100000:2.0:1788843902.363450:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788843902.363460:0:22716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007ba0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3632:x1875738134576512:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788843902.363495:0:22716:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788843902.363538:0:22716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007ba0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3632:x1875738134576512:12345-0@lo:41:osp-pre-1-0.0 Request processed in 79us (199us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843902.363556:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788843902.363604:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007ba0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1875738134576512:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788843902.363891:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd008621500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1875738134576640:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788843902.363920:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843902.364703:0:23743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134576640 00000100:00100000:1.0:1788843902.364710:0:23743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134576640 00000100:00100000:1.0:1788843902.364788:0:23743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788843902.364796:0:23743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007ba0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3633:x1875738134576640:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788843902.364831:0:23743:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1788843902.364890:0:23743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007ba0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3633:x1875738134576640:12345-0@lo:41:osp-pre-0-1.0 Request processed in 95us (969us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843902.364898:0:23743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788843902.364936:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd008621500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1875738134576640:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788843902.556586:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788843903.322907:0:23469:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788843903.581609:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788843903.605282:0:25038:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1788843903.605286:0:25038:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:0.0:1788843903.605288:0:25038:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:0.0:1788843903.605404:0:25038:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9bd007334800 00000020:01000004:0.0:1788843903.605421:0:25038:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:0.0:1788843903.605435:0:25038:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1788843903.605449:0:25038:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9bd0078bcd28) 00000020:00000080:0.0:1788843903.605468:0:25038:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1788843903.729177:0:25038:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1788843903.734190:0:25038:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:3.0:1788843903.735402:0:25038:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:3.0:1788843903.735737:0:25038:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1788843903.736883:0:25038:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1788843903.738967:0:25038:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1788843903.739716:0:25038:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:01000000:3.0:1788843903.742605:0:25038:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1788843903.743451:0:25038:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1788843903.743468:0:25038:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788843903.743482:0:25038:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xa762dfcbd58d2d7f 00000020:01000004:3.0:1788843903.743491:0:25038:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:3.0:1788843903.743514:0:25038:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.133@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788843903.743517:0:25038:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.133@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788843903.743524:0:25038:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1788843903.743557:0:25038:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:3.0:1788843903.743562:0:25038:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.133@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1788843903.767867:0:25038:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.133@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788843903.768395:0:25038:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.133@tcp, index=0001, flags=0x20002 00000020:01000004:2.0:1788843903.768401:0:25038:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788843903.768403:0:25038:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788843903.768404:0:25038:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788843903.768406:0:25038:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788843903.768407:0:25038:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788843903.768408:0:25038:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788843903.768410:0:25038:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788843903.768412:0:25038:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788843903.768413:0:25038:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788843903.768417:0:25038:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:2.0:1788843903.768419:0:25038:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788843903.768421:0:25038:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788843903.768422:0:25038:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788843903.768423:0:25038:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788843903.768424:0:25038:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788843903.768425:0:25038:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788843903.768426:0:25038:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788843903.768427:0:25038:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788843903.768428:0:25038:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788843903.768459:0:25038:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1788843903.768483:0:25038:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007ba3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ce589ba-8334-438e-8f48-13932fcba8b1:25038:1875738134576768:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788843903.768567:0:25038:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843903.768690:0:25038:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd13e936180 going to sleep for 11 seconds 00000100:00100000:1.0:1788843903.788521:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134576768 00000100:00100000:1.0:1788843903.788538:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134576768 00000100:00100000:0.0:1788843903.788701:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1788843903.788712:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0018b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ce589ba-8334-438e-8f48-13932fcba8b1+21:25038:x1875738134576768:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788843903.788751:0:22705:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1788843903.788754:0:22705:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:0.0:1788843903.788758:0:22705:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1788843903.789259:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0018b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ce589ba-8334-438e-8f48-13932fcba8b1+21:25038:x1875738134576768:12345-0@lo:253:mount.lustre.0 Request processed in 547us (20689us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843903.789268:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1788843903.789444:0:25038:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007ba3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ce589ba-8334-438e-8f48-13932fcba8b1:25038:1875738134576768:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788843903.789459:0:25038:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1788843903.789463:0:25038:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788843903.789465:0:25038:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788843903.789466:0:25038:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788843903.789467:0:25038:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788843903.789468:0:25038:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788843903.789470:0:25038:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788843903.789471:0:25038:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788843903.789473:0:25038:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788843903.789474:0:25038:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1788843903.789497:0:25038:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9bd007334800 from lustre-OST0001 10000000:01000000:1.0:1788843903.789530:0:25038:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:1.0:1788843903.789533:0:25038:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1788843903.789541:0:25038:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9bd005b60000 local copy 00010000:00010000:1.0:1788843903.789551:0:25038:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd007946400/0xa762dfcbd58d29b9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d29c0 expref: -99 pid: 22690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843903.789670:0:25038:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd008620000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ce589ba-8334-438e-8f48-13932fcba8b1:25038:1875738134576896:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788843903.789707:0:25038:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843903.789749:0:25038:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd104a350c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788843903.789829:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134576896 00000100:00100000:3.0:1788843903.789836:0:22704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134576896 00000100:00100000:3.0:1788843903.789876:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1788843903.789896:0:22704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0018b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ce589ba-8334-438e-8f48-13932fcba8b1+21:25038:x1875738134576896:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788843903.789967:0:22704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0018b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ce589ba-8334-438e-8f48-13932fcba8b1+21:25038:x1875738134576896:12345-0@lo:501:mount.lustre.0 Request processed in 82us (259us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788843903.789974:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788843903.791739:0:25038:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd008620000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ce589ba-8334-438e-8f48-13932fcba8b1:25038:1875738134576896:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1788843903.791783:0:25038:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.133@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1788843903.791832:0:25038:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.133@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1788843903.791842:0:25038:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd007946400/0xa762dfcbd58d29b9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d29c0 expref: -99 pid: 22690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843903.791853:0:25038:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.133@tcp lock: ffff9bd007946400/0xa762dfcbd58d29b9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d29c0 expref: -99 pid: 22690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788843903.791902:0:25038:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9bd007334800 10000000:01000000:1.0:1788843903.791909:0:25038:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788843903.791915:0:25038:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1788843903.791918:0:25038:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788843903.791922:0:25038:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:1.0:1788843903.791926:0:25038:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1788843903.791959:0:25038:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd007946200/0xa762dfcbd58d2d86 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843903.791967:0:25038:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.133@tcp lock: ffff9bd007946200/0xa762dfcbd58d2d86 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843903.791977:0:25038:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.133@tcp lock: ffff9bd007946200/0xa762dfcbd58d2d86 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843903.791997:0:25038:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd008620000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ce589ba-8334-438e-8f48-13932fcba8b1:25038:1875738134577024:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788843903.792064:0:25038:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843903.792104:0:25038:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd104a350c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788843903.792418:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134577024 00000100:00100000:0.0:1788843903.792427:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134577024 00000100:00100000:0.0:1788843903.792476:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1788843903.792487:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0018b3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ce589ba-8334-438e-8f48-13932fcba8b1+21:25038:x1875738134577024:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788843903.792501:0:22706:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788843903.792516:0:22706:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd10f7aec00/0xa762dfcbd58d2d8d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xa762dfcbd58d2d86 expref: -99 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843903.792552:0:22706:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd10f7aec00/0xa762dfcbd58d2d8d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa762dfcbd58d2d86 expref: 22 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843903.792563:0:22706:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd10f7aec00/0xa762dfcbd58d2d8d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa762dfcbd58d2d86 expref: 22 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843903.792572:0:22706:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd10f7aec00, rc 0) 00000100:00100000:0.0:1788843903.792614:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0018b3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ce589ba-8334-438e-8f48-13932fcba8b1+22:25038:x1875738134577024:12345-0@lo:101:mount.lustre.0 Request processed in 129us (549us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843903.792620:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788843903.794352:0:25038:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd008620000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ce589ba-8334-438e-8f48-13932fcba8b1:25038:1875738134577024:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788843903.794382:0:25038:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.133@tcp lock: ffff9bd007946200/0xa762dfcbd58d2d86 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d2d8d expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843903.794410:0:25038:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.133@tcp lock: ffff9bd007946200/0xa762dfcbd58d2d86 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xa762dfcbd58d2d8d expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788843903.797163:0:25038:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000040:00080000:1.0:1788843903.798455:0:25038:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788843903.803582:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:1.0:1788843903.803639:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 128 off8544 00000040:00080000:1.0:1788843903.803660:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 112 off8656 00000040:00080000:1.0:1788843903.803675:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8880 00000040:00080000:1.0:1788843903.803690:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9104 00000040:00080000:1.0:1788843903.803708:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 80 off9184 00000040:00080000:1.0:1788843903.803721:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 224 off9408 00000040:00080000:1.0:1788843903.803733:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9632 00000040:00080000:1.0:1788843903.803746:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 120 off9752 00000040:00080000:1.0:1788843903.803772:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 224 off9976 00000040:00080000:1.0:1788843903.803778:0:25038:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 10 count 11 00000100:00100000:1.0:1788843903.803953:0:25038:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd008620000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ce589ba-8334-438e-8f48-13932fcba8b1:25038:1875738134577152:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788843903.804090:0:25038:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843903.804999:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134577152 00000100:00100000:0.0:1788843903.805019:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134577152 00000100:00100000:0.0:1788843903.805073:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1788843903.805083:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0018b2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ce589ba-8334-438e-8f48-13932fcba8b1+22:25038:x1875738134577152:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788843903.805279:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0018b2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ce589ba-8334-438e-8f48-13932fcba8b1+22:25038:x1875738134577152:12345-0@lo:501:mount.lustre.0 Request processed in 196us (1189us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843903.805299:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1788843903.805627:0:25038:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd104a35a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788843903.805655:0:25038:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd008620000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ce589ba-8334-438e-8f48-13932fcba8b1:25038:1875738134577152:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788843903.805703:0:25038:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd008620000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ce589ba-8334-438e-8f48-13932fcba8b1:25038:1875738134577280:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788843903.805758:0:25038:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843903.805826:0:25038:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd104a35a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788843903.807701:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134577280 00000100:00100000:2.0:1788843903.807728:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134577280 00000100:00100000:2.0:1788843903.807782:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1788843903.807792:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0018b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ce589ba-8334-438e-8f48-13932fcba8b1+22:25038:x1875738134577280:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788843903.816134:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0018b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ce589ba-8334-438e-8f48-13932fcba8b1+22:25038:x1875738134577280:12345-0@lo:503:mount.lustre.0 Request processed in 8319us (10352us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843903.816175:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788843903.816272:0:25038:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd008620000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ce589ba-8334-438e-8f48-13932fcba8b1:25038:1875738134577280:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788843903.816737:0:25038:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788843903.816822:0:25038:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd008620000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ce589ba-8334-438e-8f48-13932fcba8b1:25038:1875738134577408:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788843903.816919:0:25038:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843903.816965:0:25038:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd104a350c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788843903.817000:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134577408 00000100:00100000:3.0:1788843903.817011:0:22704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134577408 00000100:00100000:3.0:1788843903.817168:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1788843903.817182:0:22704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0018b3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ce589ba-8334-438e-8f48-13932fcba8b1+22:25038:x1875738134577408:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788843903.818389:0:22704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0018b3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ce589ba-8334-438e-8f48-13932fcba8b1+22:25038:x1875738134577408:12345-0@lo:502:mount.lustre.0 Request processed in 1202us (1462us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843903.818405:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788843903.818448:0:25038:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd008620000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ce589ba-8334-438e-8f48-13932fcba8b1:25038:1875738134577408:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788843903.818686:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:1.0:1788843903.818718:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 128 off8544 00000040:00080000:1.0:1788843903.818749:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 112 off8656 00000040:00080000:1.0:1788843903.818765:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8880 00000040:00080000:1.0:1788843903.818778:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9104 00000040:00080000:1.0:1788843903.818790:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 80 off9184 00000040:00080000:1.0:1788843903.818802:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 224 off9408 00000040:00080000:1.0:1788843903.818814:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9632 00000040:00080000:1.0:1788843903.818825:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 120 off9752 00000100:00100000:1.0:1788843903.818862:0:25038:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd008620000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ce589ba-8334-438e-8f48-13932fcba8b1:25038:1875738134577536:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788843903.819326:0:25038:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843903.819373:0:25038:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd104a350c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788843903.819492:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134577536 00000100:00100000:0.0:1788843903.819503:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134577536 00000100:00100000:0.0:1788843903.819579:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1788843903.819591:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0018b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ce589ba-8334-438e-8f48-13932fcba8b1+22:25038:x1875738134577536:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788843903.819752:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0018b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ce589ba-8334-438e-8f48-13932fcba8b1+22:25038:x1875738134577536:12345-0@lo:502:mount.lustre.0 Request processed in 163us (426us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843903.819760:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788843903.820085:0:25038:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd008620000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ce589ba-8334-438e-8f48-13932fcba8b1:25038:1875738134577536:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788843903.821131:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 224 off9976 00000040:00080000:0.0:1788843903.821175:0:25038:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 10 count 11 00000020:01000000:1.0:1788843903.823422:0:25042:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788843903.823434:0:25042:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:1.0:1788843903.823439:0:25042:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788843903.823442:0:25042:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1788843903.823449:0:25042:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788843903.823466:0:25042:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9bd13df34d28) 00000020:00000080:1.0:1788843903.823492:0:25042:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type obdfilter with refcount 2 00000020:00000080:1.0:1788843903.823499:0:25042:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788843903.823594:0:25042:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9bd007334800 from lustre-OST0001, refs=2 00080000:01000000:1.0:1788843903.823603:0:25042:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788843903.823610:0:25042:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xa762dfcbd58d2d9b 00010000:00010000:0.0:1788843903.837600:0:25042:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:00000004:0.0:1788843903.838098:0:25042:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 8589934594 00080000:10000000:0.0:1788843903.840460:0:25042:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/32) registered 00000020:00000080:3.0:1788843903.850351:0:25042:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:3.0:1788843903.850365:0:25042:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788843903.850372:0:25042:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788843903.850374:0:25042:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:3.0:1788843903.850377:0:25042:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788843903.850381:0:25042:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788843903.850382:0:25042:0:(obd_config.c:1563:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788843903.850385:0:25042:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788843903.850387:0:25042:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788843903.850390:0:25042:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788843903.850392:0:25042:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788843903.850393:0:25042:0:(obd_config.c:1563:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000020:01000000:3.0:1788843903.850395:0:25042:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788843903.850398:0:25042:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788843903.850400:0:25042:0:(obd_config.c:1563:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788843903.850403:0:25042:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1788843903.850460:0:25042:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788843903.850463:0:25042:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788843903.850465:0:25042:0:(obd_config.c:1563:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788843903.850468:0:25042:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 11 count 11 00000020:01000000:0.0:1788843903.852443:0:25038:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:0.0:1788843903.852490:0:25038:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.133@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1788843903.852510:0:25038:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd007946200/0xa762dfcbd58d2d86 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d2d8d expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843903.852523:0:25038:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.133@tcp lock: ffff9bd007946200/0xa762dfcbd58d2d86 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d2d8d expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788843903.852531:0:25038:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9bd007334800 from 1 10000000:01000000:0.0:1788843903.852533:0:25038:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788843903.852574:0:25038:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd10f7ae600/0xa762dfcbd58d2da2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843903.852583:0:25038:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.133@tcp lock: ffff9bd10f7ae600/0xa762dfcbd58d2da2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843903.852594:0:25038:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.133@tcp lock: ffff9bd10f7ae600/0xa762dfcbd58d2da2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843903.852621:0:25038:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd00723df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ce589ba-8334-438e-8f48-13932fcba8b1:25038:1875738134577664:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788843903.852695:0:25038:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843903.852735:0:25038:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd1012ed540 going to sleep for 11 seconds 00000100:00100000:1.0:1788843903.853385:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134577664 00000100:00100000:1.0:1788843903.853394:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134577664 00000100:00100000:1.0:1788843903.853466:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1788843903.853477:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0018b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ce589ba-8334-438e-8f48-13932fcba8b1+22:25038:x1875738134577664:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788843903.853492:0:22706:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788843903.853507:0:22706:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd007947c00/0xa762dfcbd58d2da9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xa762dfcbd58d2da2 expref: -99 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843903.853534:0:22706:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd007947c00/0xa762dfcbd58d2da9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa762dfcbd58d2da2 expref: 23 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843903.853545:0:22706:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd007947c00/0xa762dfcbd58d2da9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa762dfcbd58d2da2 expref: 23 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843903.853554:0:22706:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd007947c00, rc 0) 00000100:00100000:1.0:1788843903.853605:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0018b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ce589ba-8334-438e-8f48-13932fcba8b1+23:25038:x1875738134577664:12345-0@lo:101:mount.lustre.0 Request processed in 130us (910us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843903.853612:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1788843903.853663:0:25038:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd00723df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ce589ba-8334-438e-8f48-13932fcba8b1:25038:1875738134577664:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788843903.853678:0:25038:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.133@tcp lock: ffff9bd10f7ae600/0xa762dfcbd58d2da2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d2da9 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843903.853686:0:25038:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.133@tcp lock: ffff9bd10f7ae600/0xa762dfcbd58d2da2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xa762dfcbd58d2da9 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788843903.859392:0:25038:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000040:00080000:1.0:1788843903.859724:0:25038:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788843903.859935:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:1.0:1788843903.859961:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:1.0:1788843903.859975:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:1.0:1788843903.859989:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8976 00000040:00080000:1.0:1788843903.860014:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 112 off9088 00000040:00080000:1.0:1788843903.860026:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 224 off9312 00000040:00080000:1.0:1788843903.860038:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 224 off9536 00000040:00080000:1.0:1788843903.860050:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 128 off9664 00000040:00080000:1.0:1788843903.860062:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9888 00000040:00080000:1.0:1788843903.860074:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10112 00000040:00080000:1.0:1788843903.860087:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 128 off10240 00000040:00080000:1.0:1788843903.860103:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 224 off10464 00000040:00080000:1.0:1788843903.860108:0:25038:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 12 count 13 00000100:00100000:1.0:1788843903.860243:0:25038:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd008620000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ce589ba-8334-438e-8f48-13932fcba8b1:25038:1875738134577792:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788843903.860322:0:25038:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843903.860364:0:25038:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd104a35e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788843903.860815:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134577792 00000100:00100000:3.0:1788843903.860823:0:22704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134577792 00000100:00100000:3.0:1788843903.860880:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1788843903.860890:0:22704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0018b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ce589ba-8334-438e-8f48-13932fcba8b1+23:25038:x1875738134577792:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788843903.861006:0:22704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0018b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ce589ba-8334-438e-8f48-13932fcba8b1+23:25038:x1875738134577792:12345-0@lo:501:mount.lustre.0 Request processed in 117us (684us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843903.861013:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1788843903.861605:0:25038:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd008620000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ce589ba-8334-438e-8f48-13932fcba8b1:25038:1875738134577792:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788843903.861653:0:25038:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007ba2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ce589ba-8334-438e-8f48-13932fcba8b1:25038:1875738134577920:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788843903.861700:0:25038:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843903.861729:0:25038:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd1017d3000 going to sleep for 11 seconds 00000100:00100000:2.0:1788843903.861747:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134577920 00000100:00100000:2.0:1788843903.861752:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134577920 00000100:00100000:2.0:1788843903.861783:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788843903.861790:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd00702f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ce589ba-8334-438e-8f48-13932fcba8b1+23:25038:x1875738134577920:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788843903.861872:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd00702f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ce589ba-8334-438e-8f48-13932fcba8b1+23:25038:x1875738134577920:12345-0@lo:503:mount.lustre.0 Request processed in 82us (172us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843903.861879:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788843903.861925:0:25038:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007ba2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ce589ba-8334-438e-8f48-13932fcba8b1:25038:1875738134577920:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788843903.862336:0:25038:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788843903.862417:0:25038:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007ba2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ce589ba-8334-438e-8f48-13932fcba8b1:25038:1875738134578048:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788843903.862454:0:25038:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843903.862471:0:25038:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd1017d3000 going to sleep for 11 seconds 00000100:00100000:2.0:1788843903.862487:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134578048 00000100:00100000:2.0:1788843903.862491:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134578048 00000100:00100000:2.0:1788843903.862516:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788843903.862522:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd00702c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ce589ba-8334-438e-8f48-13932fcba8b1+23:25038:x1875738134578048:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788843903.862600:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd00702c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ce589ba-8334-438e-8f48-13932fcba8b1+23:25038:x1875738134578048:12345-0@lo:502:mount.lustre.0 Request processed in 78us (145us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843903.862616:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788843903.862658:0:25038:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007ba2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ce589ba-8334-438e-8f48-13932fcba8b1:25038:1875738134578048:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788843903.862839:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:2.0:1788843903.862865:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:2.0:1788843903.862880:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:2.0:1788843903.862894:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:2.0:1788843903.862906:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000040:00080000:2.0:1788843903.862918:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:2.0:1788843903.862931:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 224 off9536 00000040:00080000:2.0:1788843903.862944:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 128 off9664 00000040:00080000:2.0:1788843903.862958:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9888 00000040:00080000:2.0:1788843903.862973:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10112 00000040:00080000:2.0:1788843903.863001:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 128 off10240 00000100:00100000:2.0:1788843903.863025:0:25038:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007ba2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ce589ba-8334-438e-8f48-13932fcba8b1:25038:1875738134578176:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788843903.863061:0:25038:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843903.863075:0:25038:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd007bab240 going to sleep for 11 seconds 00000100:00100000:2.0:1788843903.863088:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134578176 00000100:00100000:2.0:1788843903.863092:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134578176 00000100:00100000:2.0:1788843903.863114:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788843903.863134:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd00702f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ce589ba-8334-438e-8f48-13932fcba8b1+23:25038:x1875738134578176:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788843903.863228:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd00702f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ce589ba-8334-438e-8f48-13932fcba8b1+23:25038:x1875738134578176:12345-0@lo:502:mount.lustre.0 Request processed in 108us (167us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843903.863235:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788843903.863276:0:25038:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007ba2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ce589ba-8334-438e-8f48-13932fcba8b1:25038:1875738134578176:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788843903.863311:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 224 off10464 00000040:00080000:2.0:1788843903.863319:0:25038:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:2.0:1788843903.863691:0:25046:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788843903.863704:0:25046:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788843903.863706:0:25046:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788843903.863713:0:25046:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9bd007334800 00000020:00000080:2.0:1788843903.863715:0:25046:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788843903.863722:0:25046:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788843903.863725:0:25046:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788843903.863726:0:25046:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1788843903.863729:0:25046:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788843903.863731:0:25046:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788843903.863733:0:25046:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788843903.863736:0:25046:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9bd007334800 00000020:00000080:2.0:1788843903.863738:0:25046:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788843903.863789:0:25046:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788843903.867412:0:25046:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788843903.867419:0:25046:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1788843903.867430:0:25046:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788843903.867437:0:25046:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788843903.867439:0:25046:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788843903.867445:0:25046:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9bd007334800 00000020:00000080:0.0:1788843903.867457:0:25046:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788843903.867507:0:25046:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788843903.867511:0:25046:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788843903.867512:0:25046:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788843903.867515:0:25046:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788843903.867518:0:25046:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788843903.867519:0:25046:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1788843903.867523:0:25046:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9bd007334800 00000020:00000080:0.0:1788843903.867525:0:25046:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788843903.867566:0:25046:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788843903.867570:0:25046:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788843903.867571:0:25046:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1788843903.867575:0:25046:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 13 count 13 00000020:01000000:3.0:1788843903.868937:0:25038:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:3.0:1788843903.868984:0:25038:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.133@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788843903.869023:0:25038:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd10f7ae600/0xa762dfcbd58d2da2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d2da9 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843903.869036:0:25038:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.133@tcp lock: ffff9bd10f7ae600/0xa762dfcbd58d2da2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d2da9 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788843903.869108:0:25038:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788843903.869112:0:25038:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9bd007334800 10000000:01000000:3.0:1788843903.869114:0:25038:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9bd007334800 10000000:01000000:3.0:1788843903.869130:0:25038:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788843903.869137:0:25038:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9bd007334800 from 1 10000000:01000000:3.0:1788843903.869159:0:25038:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788843903.869200:0:25038:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd007be2400/0xa762dfcbd58d2db0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843903.869208:0:25038:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.133@tcp lock: ffff9bd007be2400/0xa762dfcbd58d2db0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843903.869218:0:25038:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.133@tcp lock: ffff9bd007be2400/0xa762dfcbd58d2db0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843903.869244:0:25038:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd1074ff100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ce589ba-8334-438e-8f48-13932fcba8b1:25038:1875738134578304:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788843903.869319:0:25038:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843903.869361:0:25038:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd007b9dd80 going to sleep for 11 seconds 00000100:00100000:1.0:1788843903.869676:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134578304 00000100:00100000:1.0:1788843903.869684:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134578304 00000100:00100000:1.0:1788843903.869740:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788843903.869750:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd00702ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ce589ba-8334-438e-8f48-13932fcba8b1+23:25038:x1875738134578304:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788843903.869764:0:22705:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788843903.869777:0:22705:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd007946c00/0xa762dfcbd58d2db7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xa762dfcbd58d2db0 expref: -99 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843903.869800:0:22705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd007946c00/0xa762dfcbd58d2db7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa762dfcbd58d2db0 expref: 24 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843903.869811:0:22705:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd007946c00/0xa762dfcbd58d2db7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa762dfcbd58d2db0 expref: 24 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843903.869820:0:22705:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd007946c00, rc 0) 00000100:00100000:1.0:1788843903.869875:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd00702ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ce589ba-8334-438e-8f48-13932fcba8b1+24:25038:x1875738134578304:12345-0@lo:101:mount.lustre.0 Request processed in 127us (556us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843903.869882:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788843903.870040:0:25038:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd1074ff100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ce589ba-8334-438e-8f48-13932fcba8b1:25038:1875738134578304:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788843903.870056:0:25038:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.133@tcp lock: ffff9bd007be2400/0xa762dfcbd58d2db0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d2db7 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843903.870065:0:25038:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.133@tcp lock: ffff9bd007be2400/0xa762dfcbd58d2db0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xa762dfcbd58d2db7 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788843903.871942:0:25038:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000040:00080000:3.0:1788843903.876381:0:25038:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788843903.876708:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:3.0:1788843903.876736:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 120 off8536 00000040:00080000:3.0:1788843903.876751:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 168 off8704 00000040:00080000:3.0:1788843903.876774:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8928 00000040:00080000:3.0:1788843903.882595:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 224 off9152 00000040:00080000:3.0:1788843903.882686:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 120 off9272 00000040:00080000:3.0:1788843903.882815:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 168 off9440 00000040:00080000:3.0:1788843903.882836:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 224 off9664 00000040:00080000:3.0:1788843903.882854:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:3.0:1788843903.882872:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 120 off10008 00000040:00080000:3.0:1788843903.882897:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 224 off10232 00000040:00080000:3.0:1788843903.882914:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10456 00000040:00080000:3.0:1788843903.882928:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].13, 88 off10544 00000040:00080000:3.0:1788843903.882942:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].14, 128 off10672 00000040:00080000:3.0:1788843903.882956:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].15, 144 off10816 00000040:00080000:3.0:1788843903.882973:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].16, 160 off10976 00000040:00080000:3.0:1788843903.883000:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].17, 224 off11200 00000040:00080000:3.0:1788843903.883015:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].18, 224 off11424 00000040:00080000:3.0:1788843903.883029:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].19, 80 off11504 00000040:00080000:3.0:1788843903.883044:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].20, 224 off11728 00000040:00080000:3.0:1788843903.883059:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].21, 224 off11952 00000040:00080000:3.0:1788843903.883088:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].22, 88 off12040 00000040:00080000:3.0:1788843903.883106:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].23, 128 off12168 00000040:00080000:3.0:1788843903.883135:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].24, 144 off12312 00000040:00080000:3.0:1788843903.883170:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].25, 160 off12472 00000040:00080000:3.0:1788843903.883195:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].26, 224 off12696 00000040:00080000:3.0:1788843903.883210:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].27, 224 off12920 00000040:00080000:3.0:1788843903.883223:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].28, 80 off13000 00000040:00080000:3.0:1788843903.883693:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].29, 224 off13224 00000040:00080000:3.0:1788843903.883814:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].30, 224 off13448 00000040:00080000:3.0:1788843903.883829:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].31, 88 off13536 00000040:00080000:3.0:1788843903.883842:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].32, 128 off13664 00000040:00080000:3.0:1788843903.883855:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].33, 144 off13808 00000040:00080000:3.0:1788843903.883867:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].34, 128 off13936 00000040:00080000:3.0:1788843903.883879:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].35, 224 off14160 00000040:00080000:3.0:1788843903.883938:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].36, 224 off14384 00000040:00080000:3.0:1788843903.883963:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].37, 80 off14464 00000040:00080000:3.0:1788843903.884049:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].38, 224 off14688 00000040:00080000:3.0:1788843903.884065:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].39, 224 off14912 00000040:00080000:3.0:1788843903.884077:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].40, 88 off15000 00000040:00080000:3.0:1788843903.884090:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].41, 128 off15128 00000040:00080000:3.0:1788843903.884102:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].42, 144 off15272 00000040:00080000:3.0:1788843903.884114:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].43, 128 off15400 00000040:00080000:3.0:1788843903.884160:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].44, 224 off15624 00000040:00080000:3.0:1788843903.884177:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].45, 224 off15848 00000040:00080000:3.0:1788843903.884361:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].46, 80 off15928 00000040:00080000:3.0:1788843903.884374:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].47, 224 off16152 00000040:00080000:3.0:1788843903.884387:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].48, 232 off16384 00000040:00080000:3.0:1788843903.884700:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].49, 224 off16608 00000040:00080000:3.0:1788843903.884722:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].50, 120 off16728 00000040:00080000:3.0:1788843903.884742:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].51, 224 off16952 00000040:00080000:3.0:1788843903.884747:0:25038:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 51 count 51 00000100:00100000:3.0:1788843903.884969:0:25038:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd1074fe300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ce589ba-8334-438e-8f48-13932fcba8b1:25038:1875738134578432:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788843903.885098:0:25038:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843903.885187:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134578432 00000100:00100000:0.0:1788843903.885195:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134578432 00000100:00100000:0.0:1788843903.885241:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788843903.885250:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd00702fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ce589ba-8334-438e-8f48-13932fcba8b1+24:25038:x1875738134578432:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788843903.885257:0:25038:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd007b9de40 going to sleep for 11 seconds 00000100:00100000:0.0:1788843903.885594:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd00702fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ce589ba-8334-438e-8f48-13932fcba8b1+24:25038:x1875738134578432:12345-0@lo:501:mount.lustre.0 Request processed in 343us (494us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843903.885602:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1788843903.887340:0:25038:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd1074fe300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ce589ba-8334-438e-8f48-13932fcba8b1:25038:1875738134578432:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788843903.887391:0:25038:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd1074fe300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ce589ba-8334-438e-8f48-13932fcba8b1:25038:1875738134578560:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788843903.887451:0:25038:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843903.887489:0:25038:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd007b9de40 going to sleep for 11 seconds 00000100:00100000:1.0:1788843903.887610:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134578560 00000100:00100000:1.0:1788843903.887617:0:22704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134578560 00000100:00100000:1.0:1788843903.887666:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1788843903.887676:0:22704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd00702f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ce589ba-8334-438e-8f48-13932fcba8b1+24:25038:x1875738134578560:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788843903.887780:0:22704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd00702f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ce589ba-8334-438e-8f48-13932fcba8b1+24:25038:x1875738134578560:12345-0@lo:503:mount.lustre.0 Request processed in 105us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843903.887799:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1788843903.887854:0:25038:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd1074fe300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ce589ba-8334-438e-8f48-13932fcba8b1:25038:1875738134578560:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788843903.888312:0:25038:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788843903.888379:0:25038:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd008621180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ce589ba-8334-438e-8f48-13932fcba8b1:25038:1875738134578688:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788843903.888421:0:25038:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843903.888449:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134578688 00000100:00100000:1.0:1788843903.888454:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134578688 00000100:00100000:1.0:1788843903.888481:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1788843903.888488:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd00702d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ce589ba-8334-438e-8f48-13932fcba8b1+24:25038:x1875738134578688:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788843903.888564:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd00702d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ce589ba-8334-438e-8f48-13932fcba8b1+24:25038:x1875738134578688:12345-0@lo:502:mount.lustre.0 Request processed in 75us (143us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843903.888571:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1788843903.888602:0:25038:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd104a350c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788843903.888615:0:25038:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd008621180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ce589ba-8334-438e-8f48-13932fcba8b1:25038:1875738134578688:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788843903.888764:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:1.0:1788843903.888789:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 120 off8536 00000040:00080000:1.0:1788843903.888801:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 168 off8704 00000040:00080000:1.0:1788843903.888814:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8928 00000040:00080000:1.0:1788843903.888826:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 224 off9152 00000040:00080000:1.0:1788843903.888838:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 120 off9272 00000040:00080000:1.0:1788843903.888850:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 168 off9440 00000040:00080000:1.0:1788843903.888873:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 224 off9664 00000040:00080000:1.0:1788843903.888885:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:1.0:1788843903.888908:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 120 off10008 00000040:00080000:1.0:1788843903.888922:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 224 off10232 00000040:00080000:1.0:1788843903.888935:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10456 00000040:00080000:1.0:1788843903.888947:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].13, 88 off10544 00000040:00080000:1.0:1788843903.888959:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].14, 128 off10672 00000040:00080000:1.0:1788843903.888971:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].15, 144 off10816 00000040:00080000:1.0:1788843903.888984:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].16, 160 off10976 00000040:00080000:1.0:1788843903.888996:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].17, 224 off11200 00000040:00080000:1.0:1788843903.889007:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].18, 224 off11424 00000040:00080000:1.0:1788843903.889019:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].19, 80 off11504 00000040:00080000:1.0:1788843903.889032:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].20, 224 off11728 00000040:00080000:1.0:1788843903.889045:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].21, 224 off11952 00000040:00080000:1.0:1788843903.889056:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].22, 88 off12040 00000040:00080000:1.0:1788843903.889069:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].23, 128 off12168 00000040:00080000:1.0:1788843903.889081:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].24, 144 off12312 00000040:00080000:1.0:1788843903.889094:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].25, 160 off12472 00000040:00080000:1.0:1788843903.889132:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].26, 224 off12696 00000040:00080000:1.0:1788843903.889177:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].27, 224 off12920 00000040:00080000:1.0:1788843903.889191:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].28, 80 off13000 00000040:00080000:1.0:1788843903.889203:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].29, 224 off13224 00000040:00080000:1.0:1788843903.889215:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].30, 224 off13448 00000040:00080000:1.0:1788843903.889227:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].31, 88 off13536 00000040:00080000:1.0:1788843903.889239:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].32, 128 off13664 00000040:00080000:1.0:1788843903.889250:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].33, 144 off13808 00000040:00080000:1.0:1788843903.889263:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].34, 128 off13936 00000040:00080000:1.0:1788843903.889274:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].35, 224 off14160 00000040:00080000:1.0:1788843903.889287:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].36, 224 off14384 00000040:00080000:1.0:1788843903.889300:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].37, 80 off14464 00000040:00080000:1.0:1788843903.889312:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].38, 224 off14688 00000040:00080000:1.0:1788843903.889325:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].39, 224 off14912 00000040:00080000:1.0:1788843903.889339:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].40, 88 off15000 00000040:00080000:1.0:1788843903.889364:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].41, 128 off15128 00000040:00080000:1.0:1788843903.889389:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].42, 144 off15272 00000040:00080000:1.0:1788843903.889404:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].43, 128 off15400 00000040:00080000:1.0:1788843903.889417:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].44, 224 off15624 00000040:00080000:1.0:1788843903.889429:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].45, 224 off15848 00000040:00080000:1.0:1788843903.889441:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].46, 80 off15928 00000040:00080000:1.0:1788843903.889454:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].47, 224 off16152 00000040:00080000:1.0:1788843903.889465:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].48, 232 off16384 00000100:00100000:1.0:1788843903.889503:0:25038:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd008621180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ce589ba-8334-438e-8f48-13932fcba8b1:25038:1875738134578816:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788843903.889552:0:25038:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843903.889584:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134578816 00000100:00100000:1.0:1788843903.889589:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134578816 00000100:00100000:1.0:1788843903.889618:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788843903.889625:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd00702cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ce589ba-8334-438e-8f48-13932fcba8b1+24:25038:x1875738134578816:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788843903.889705:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd00702cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ce589ba-8334-438e-8f48-13932fcba8b1+24:25038:x1875738134578816:12345-0@lo:502:mount.lustre.0 Request processed in 80us (152us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843903.889712:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788843903.889746:0:25038:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd104a350c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788843903.889759:0:25038:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd008621180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ce589ba-8334-438e-8f48-13932fcba8b1:25038:1875738134578816:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788843903.889881:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].49, 224 off16608 00000040:00080000:1.0:1788843903.889900:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].50, 120 off16728 00000100:00100000:1.0:1788843903.889917:0:25038:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd008621180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ce589ba-8334-438e-8f48-13932fcba8b1:25038:1875738134578944:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788843903.889948:0:25038:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843903.889968:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134578944 00000100:00100000:1.0:1788843903.889972:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134578944 00000100:00100000:1.0:1788843903.889992:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788843903.889997:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd00702e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ce589ba-8334-438e-8f48-13932fcba8b1+24:25038:x1875738134578944:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788843903.890059:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd00702e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ce589ba-8334-438e-8f48-13932fcba8b1+24:25038:x1875738134578944:12345-0@lo:502:mount.lustre.0 Request processed in 61us (110us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843903.890065:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788843903.890094:0:25038:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd104a350c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788843903.890106:0:25038:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd008621180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ce589ba-8334-438e-8f48-13932fcba8b1:25038:1875738134578944:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788843903.890177:0:25038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].51, 224 off16952 00000040:00080000:1.0:1788843903.890185:0:25038:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:1.0:1788843903.896704:0:25049:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1788843903.896724:0:25049:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9bd13df319b8) 00000020:00000080:1.0:1788843903.896750:0:25049:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type lwp with refcount 2 00000020:01000004:1.0:1788843903.896858:0:25049:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9bd007334800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1788843903.896862:0:25049:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9bd007334800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1788843903.896865:0:25049:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9bd007334800 3 00010000:00080000:1.0:1788843903.903866:0:25049:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9bd140f91000@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.133@tcp at head 00010000:00010000:1.0:1788843903.909646:0:25049:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-11 is initialized 00000020:00000080:1.0:1788843903.909867:0:25049:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:1.0:1788843903.914989:0:25049:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788843903.915075:0:25049:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xa762dfcbd58d2dc5 00000100:00080000:1.0:1788843903.915089:0:25049:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788843903.915096:0:25049:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9bd140f91000 using connection 192.168.203.133@tcp/0@lo 00000100:00100000:1.0:1788843903.915169:0:25049:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bd008621180 x1875738134579072/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788843903.915201:0:25049:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788843903.915264:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788843903.915269:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788843903.915271:0:36:0:(import.c:65:import_set_state_nolock()) ffff9bd0059c6000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788843903.915276:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 679 00000100:00080000:1.0:1788843903.915354:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788843903.915360:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9bd0059c6000 using connection 192.168.203.133@tcp/0@lo 00000100:00100000:1.0:1788843903.915375:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bd008620a80 x1875738134579456/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788843903.915412:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788843903.915415:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788843903.915417:0:36:0:(import.c:65:import_set_state_nolock()) ffff9bd112389800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788843903.915420:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 679 00000100:00080000:1.0:1788843903.915423:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788843903.915426:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9bd112389800 using connection 192.168.203.133@tcp/0@lo 00000100:00100000:1.0:1788843903.915435:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bd1203d0a80 x1875738134579968/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788843903.915481:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd008620000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1875738134579200:0@lo:400:kworker.0 00000100:00100000:1.0:1788843903.915552:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843903.915589:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd1203d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1875738134579840:0@lo:400:kworker.0 00000100:00100000:1.0:1788843903.915613:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843903.915636:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788843903.915642:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd008621500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1875738134579328:0@lo:400:kworker.0 00000100:00100000:1.0:1788843903.915663:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843903.915678:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd1203d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3630:1875738134580096:0@lo:400:kworker.0 00000100:00100000:1.0:1788843903.915699:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843903.915730:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd008621880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3632:1875738134579584:0@lo:400:kworker.0 00000100:00100000:1.0:1788843903.915753:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843903.915769:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd1203d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3632:1875738134580224:0@lo:400:kworker.0 00000100:00100000:1.0:1788843903.915800:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843903.915819:0:3632:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788843903.915824:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd1203d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1875738134579712:0@lo:400:kworker.0 00000100:00100000:1.0:1788843903.915844:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843903.915860:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd1203d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3632:1875738134580352:0@lo:400:kworker.0 00000100:00100000:1.0:1788843903.915880:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843903.916187:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd008621180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3629:1875738134579072:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788843903.916226:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843903.916249:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd008620a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3629:1875738134579456:0@lo:8:kworker.0 00000100:00100000:2.0:1788843903.916273:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843903.916970:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd1203d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3629:1875738134579968:0@lo:8:kworker.0 00000100:00100000:2.0:1788843903.917003:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843903.917133:0:24225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134579840 00000100:00100000:2.0:1788843903.917160:0:24225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134579840 00000100:00100000:2.0:1788843903.917205:0:24225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134579328 00000100:00100000:2.0:1788843903.917209:0:24225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134579328 00000100:00100000:2.0:1788843903.917223:0:24225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134579456 00000100:00100000:2.0:1788843903.917225:0:24225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134579456 00000100:00100000:2.0:1788843903.917233:0:24225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134579968 00000100:00100000:2.0:1788843903.917235:0:24225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134579968 00000100:00100000:2.0:1788843903.917246:0:24225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788843903.917254:0:24225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1203d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3630:x1875738134579840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788843903.918003:0:24225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1203d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3630:x1875738134579840:12345-0@lo:400:kworker.0 Request processed in 746us (2385us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843903.918093:0:24225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788843903.919278:0:22717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134579200 00000100:00100000:2.0:1788843903.919420:0:24225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788843903.919438:0:24225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1203d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3630:x1875738134579328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788843903.919517:0:24225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1203d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3630:x1875738134579328:12345-0@lo:400:kworker.0 Request processed in 90us (3854us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843903.919524:0:24225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788843903.919546:0:24225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788843903.919550:0:24225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007ba3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3629:x1875738134579456:12345-0@lo:8:kworker.0 00000100:00100000:2.0:1788843903.919609:0:24225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007ba3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3629:x1875738134579456:12345-0@lo:8:kworker.0 Request processed in 56us (3334us total) trans 0 rc -11/-11 00000100:00100000:2.0:1788843903.919614:0:24225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788843903.919626:0:24225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788843903.919630:0:24225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007ba1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3629:x1875738134579968:12345-0@lo:8:kworker.0 00000100:00100000:2.0:1788843903.919662:0:24225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007ba1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3629:x1875738134579968:12345-0@lo:8:kworker.0 Request processed in 30us (2658us total) trans 0 rc -11/-11 00000100:00100000:2.0:1788843903.919668:0:24225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:2.0:1788843903.919694:0:22707:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788843903.919745:0:3629:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788843903.919754:0:3629:0:(import.c:65:import_set_state_nolock()) ffff9bd0059c6000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788843903.919759:0:3629:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1788843903.919763:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd008620a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3629:1875738134579456:0@lo:8:kworker.0 00000100:00100000:2.0:1788843903.919773:0:3629:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788843903.919776:0:3629:0:(import.c:65:import_set_state_nolock()) ffff9bd112389800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788843903.919778:0:3629:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1788843903.919780:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd1203d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3629:1875738134579968:0@lo:8:kworker.0 00000100:00100000:2.0:1788843903.919835:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd008621500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1875738134579328:0@lo:400:kworker.0 00000100:00100000:2.0:1788843903.919848:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd1203d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1875738134579840:0@lo:400:kworker.0 00000100:00100000:1.0:1788843903.919993:0:22717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134579200 00000100:00100000:1.0:1788843903.920132:0:22717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134579712 00000100:00100000:1.0:1788843903.920139:0:22717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134579712 00000100:00100000:1.0:1788843903.920178:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788843903.920185:0:22717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1203d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3630:x1875738134579200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843903.920236:0:22717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1203d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3630:x1875738134579200:12345-0@lo:400:kworker.0 Request processed in 52us (4685us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843903.920242:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788843903.920253:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788843903.920259:0:22717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1054e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3632:x1875738134579712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843903.922171:0:22717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1054e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3632:x1875738134579712:12345-0@lo:400:kworker.0 Request processed in 1901us (6315us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843903.922184:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788843903.922227:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134580096 00000100:00100000:1.0:1788843903.922236:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134580096 00000100:00100000:1.0:1788843903.922266:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134579584 00000100:00100000:1.0:1788843903.922269:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134579584 00000100:00100000:1.0:1788843903.922280:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134580224 00000100:00100000:1.0:1788843903.922283:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134580224 00000100:00100000:1.0:1788843903.923173:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134580352 00000100:00100000:1.0:1788843903.923178:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134580352 00000100:00100000:1.0:1788843903.923221:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134579072 00000100:00100000:1.0:1788843903.923225:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134579072 00000100:00100000:1.0:1788843903.923240:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788843903.923250:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1203d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3630:x1875738134580096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843903.923559:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1203d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3630:x1875738134580096:12345-0@lo:400:kworker.0 Request processed in 310us (7857us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843903.923567:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788843903.923585:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788843903.923591:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1203d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3632:x1875738134579584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843903.923622:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1203d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3632:x1875738134579584:12345-0@lo:400:kworker.0 Request processed in 31us (7868us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843903.923628:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788843903.923639:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788843903.923645:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1203d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3632:x1875738134580224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843903.923669:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1203d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3632:x1875738134580224:12345-0@lo:400:kworker.0 Request processed in 25us (7870us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843903.923675:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788843903.923685:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788843903.923691:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1054e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3632:x1875738134580352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843903.923715:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1054e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3632:x1875738134580352:12345-0@lo:400:kworker.0 Request processed in 25us (7835us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843903.923721:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788843903.923731:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788843903.923735:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007ba2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3629:x1875738134579072:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1788843903.923757:0:22712:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 681 last 0 00000020:00000080:1.0:1788843903.923795:0:22712:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xa762dfcbd58d2dcc 00000004:00100000:1.0:1788843903.923832:0:22712:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788843903.923869:0:22712:0:(import.c:65:import_set_state_nolock()) ffff9bd1181e8000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788843903.925501:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007ba2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3629:x1875738134579072:12345-0@lo:38:llog_process_th.0 Request processed in 1757us (9266us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843903.925513:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:1.0:1788843903.925576:0:22707:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788843903.925581:0:22707:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788843903.925622:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd1203d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1875738134579712:0@lo:400:kworker.0 00010000:00080000:1.0:1788843903.925640:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd1203d3480 x1875738134580352/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843919 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788843903.925651:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd1203d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3632:1875738134580352:0@lo:400:kworker.0 00010000:00080000:1.0:1788843903.925662:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd008621880 x1875738134579584/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843919 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788843903.925670:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd008621880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3632:1875738134579584:0@lo:400:kworker.0 00010000:00080000:1.0:1788843903.925681:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd1203d0380 x1875738134580224/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843919 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788843903.925688:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd1203d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3632:1875738134580224:0@lo:400:kworker.0 00010000:00080000:1.0:1788843903.925731:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd1203d0000 x1875738134580096/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843919 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788843903.925740:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd1203d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3630:1875738134580096:0@lo:400:kworker.0 00000100:00100000:1.0:1788843903.925753:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd008620000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1875738134579200:0@lo:400:kworker.0 00010000:00080000:2.0:1788843903.927051:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd008621180 x1875738134579072/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788843913 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788843903.927064:0:3629:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788843903.927073:0:3629:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 3 00000100:00080000:2.0:1788843903.927083:0:3629:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1788843903.927088:0:3629:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788843903.927092:0:3629:0:(import.c:65:import_set_state_nolock()) ffff9bd140f91000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788843903.927099:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd008621180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3629:1875738134579072:0@lo:38:llog_process_th.0 00000020:01000004:1.0:1788843903.933687:0:25049:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1788843903.933705:0:25049:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff9bd13df30000) 00000020:00000080:1.0:1788843903.933739:0:25049:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:1.0:1788843903.933835:0:25049:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9bd007334800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1788843903.933840:0:25049:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9bd007334800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1788843903.933842:0:25049:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9bd007334800 3 00010000:00080000:1.0:1788843903.933876:0:25049:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9bd00657b800@lustre-MDT0001-lwp-OST0001: add connection 192.168.203.133@tcp at head 00010000:00010000:1.0:1788843903.942575:0:25049:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-12 is initialized 00000020:00000080:1.0:1788843903.947493:0:25049:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:1.0:1788843903.947684:0:25049:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788843903.947698:0:25049:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0xa762dfcbd58d2dda 00000100:00080000:1.0:1788843903.947711:0:25049:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788843903.947718:0:25049:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff9bd00657b800 using connection 192.168.203.133@tcp/0@lo 00000100:00100000:1.0:1788843903.947760:0:25049:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bd1054e5f80 x1875738134580480/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788843903.947790:0:25049:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:3.0:1788843903.948389:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd1054e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3629:1875738134580480:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788843903.948462:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843903.949314:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134580480 00000100:00100000:1.0:1788843903.949326:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134580480 00000100:00100000:1.0:1788843903.949364:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788843903.949373:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1074fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3629:x1875738134580480:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1788843903.949404:0:22712:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 682 last 0 00000020:00000080:1.0:1788843903.949438:0:22712:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0xa762dfcbd58d2de1 00000004:00100000:1.0:1788843903.949456:0:22712:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788843903.949487:0:22712:0:(import.c:65:import_set_state_nolock()) ffff9bd006578000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788843903.949553:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1074fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3629:x1875738134580480:12345-0@lo:38:llog_process_th.0 Request processed in 179us (1090us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843903.949561:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000040:00080000:1.0:1788843903.949628:0:25049:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 52 count 51 00000020:01000000:1.0:1788843903.949689:0:25038:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:1.0:1788843903.949723:0:25038:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.133@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788843903.949750:0:25038:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd007be2400/0xa762dfcbd58d2db0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d2db7 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843903.949762:0:25038:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.133@tcp lock: ffff9bd007be2400/0xa762dfcbd58d2db0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d2db7 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788843903.949815:0:25038:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788843903.949818:0:25038:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788843903.949820:0:25038:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788843903.949821:0:25038:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788843903.949823:0:25038:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788843903.949824:0:25038:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788843903.949825:0:25038:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788843903.949828:0:25038:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788843903.949829:0:25038:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788843903.949833:0:25038:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:1.0:1788843903.949836:0:25038:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788843903.949837:0:25038:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788843903.949838:0:25038:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788843903.949839:0:25038:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788843903.949840:0:25038:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788843903.949842:0:25038:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788843903.949842:0:25038:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788843903.949844:0:25038:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788843903.949845:0:25038:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788843903.949866:0:25038:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1788843903.949881:0:25038:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd1054e4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ce589ba-8334-438e-8f48-13932fcba8b1:25038:1875738134580608:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788843903.949924:0:25038:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843903.949944:0:25038:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd1012ed240 going to sleep for 11 seconds 00000100:00100000:1.0:1788843903.949962:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134580608 00000100:00100000:1.0:1788843903.949966:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134580608 00000100:00100000:1.0:1788843903.949996:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1788843903.950003:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd00702dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ce589ba-8334-438e-8f48-13932fcba8b1+24:25038:x1875738134580608:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788843903.950025:0:22705:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1788843903.950043:0:22705:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00010000:00080000:3.0:1788843903.951021:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd1054e5f80 x1875738134580480/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788843913 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788843903.951033:0:3629:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788843903.951052:0:3629:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 3 00000100:00080000:3.0:1788843903.951062:0:3629:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1788843903.951067:0:3629:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1788843903.951070:0:3629:0:(import.c:65:import_set_state_nolock()) ffff9bd00657b800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788843903.951077:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd1054e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3629:1875738134580480:0@lo:38:llog_process_th.0 20000000:01000000:1.0:1788843903.974732:0:22705:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788843903.974750:0:22705:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:1.0:1788843903.974870:0:22727:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788843903.974875:0:22727:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788843903.974897:0:22727:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9bd007947400/0xa762dfcbd58d2de8 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843903.974917:0:22727:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bd1153e7e00/0xa762dfcbd58d2c7c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa762dfcbd58d2c75 expref: 24 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843903.974924:0:22727:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bd1153e6200/0xa762dfcbd58d2c8a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa762dfcbd58d2c83 expref: 24 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843903.974932:0:22727:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9bd007947400/0xa762dfcbd58d2de8 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843903.974974:0:22727:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bd1153e6200/0xa762dfcbd58d2c8a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa762dfcbd58d2c83 expref: 24 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843903.974989:0:22727:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9bd1153e6200/0xa762dfcbd58d2c8a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa762dfcbd58d2c83 expref: 24 pid: 22706 timeout: 782 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843903.975004:0:22727:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd1054e4380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22727:1875738134580736:0@lo:104: 00000100:00100000:1.0:1788843903.975075:0:22727:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788843903.975167:0:22727:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bd1153e7e00/0xa762dfcbd58d2c7c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa762dfcbd58d2c75 expref: 24 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843903.975175:0:22727:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9bd1153e7e00/0xa762dfcbd58d2c7c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa762dfcbd58d2c75 expref: 24 pid: 22704 timeout: 782 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843903.975183:0:22727:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd1054e4700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22727:1875738134580864:0@lo:104: 00000100:00100000:1.0:1788843903.975215:0:22727:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843903.975234:0:22727:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd13e936180 going to sleep for 11 seconds 00000100:00100000:1.0:1788843903.975261:0:22694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134580736 00000100:00100000:1.0:1788843903.975268:0:22694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134580736 00000100:00100000:1.0:1788843903.975314:0:22694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134580864 00000100:00100000:1.0:1788843903.975318:0:22694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134580864 00000100:00100000:1.0:1788843903.975333:0:22694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788843903.975341:0:22694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1054e5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0ce589ba-8334-438e-8f48-13932fcba8b1+4:22727:x1875738134580736:12345-0@lo:104: 00010000:00010000:1.0:1788843903.975354:0:22694:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.133@tcp lock: ffff9bd10f7afc00/0xa762dfcbd58d2c83 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa762dfcbd58d2c8a expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843903.975404:0:22694:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788843903.975410:0:22694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1054e5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0ce589ba-8334-438e-8f48-13932fcba8b1+4:22727:x1875738134580736:12345-0@lo:104: Request processed in 69us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843903.975417:0:22694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788843903.975435:0:22694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788843903.975441:0:22694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1054e7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0ce589ba-8334-438e-8f48-13932fcba8b1+3:22727:x1875738134580864:12345-0@lo:104: 00010000:00010000:1.0:1788843903.975448:0:22694:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.133@tcp lock: ffff9bd10f7ae400/0xa762dfcbd58d2c75 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa762dfcbd58d2c7c expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843903.975480:0:22694:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788843903.975484:0:22694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1054e7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0ce589ba-8334-438e-8f48-13932fcba8b1+3:22727:x1875738134580864:12345-0@lo:104: Request processed in 44us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843903.975489:0:22694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:1.0:1788843903.975507:0:23471:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788843903.975513:0:23471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.133@tcp lock: ffff9bd10f7afc00/0xa762dfcbd58d2c83 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa762dfcbd58d2c8a expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843903.975520:0:23471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd10f7afc00 already unused, calling callback (ffffffffc12a7c20) 10000000:00010000:1.0:1788843903.975529:0:23471:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.133@tcp lock: ffff9bd10f7afc00/0xa762dfcbd58d2c83 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xa762dfcbd58d2c8a expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843903.975538:0:23471:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.133@tcp lock: ffff9bd10f7afc00/0xa762dfcbd58d2c83 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xa762dfcbd58d2c8a expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788843903.975544:0:23471:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.133@tcp lock: ffff9bd10f7afc00/0xa762dfcbd58d2c83 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xa762dfcbd58d2c8a expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788843903.975550:0:23471:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788843903.975575:0:23471:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.133@tcp lock: ffff9bd10f7afc00/0xa762dfcbd58d2c83 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa762dfcbd58d2c8a expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843903.975582:0:23471:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788843903.975601:0:23471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.133@tcp lock: ffff9bd10f7afc00/0xa762dfcbd58d2c83 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa762dfcbd58d2c8a expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843903.975608:0:23471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.133@tcp lock: ffff9bd10f7afc00/0xa762dfcbd58d2c83 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa762dfcbd58d2c8a expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843903.975620:0:23471:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788843903.975623:0:23471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.133@tcp lock: ffff9bd10f7ae400/0xa762dfcbd58d2c75 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa762dfcbd58d2c7c expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843903.975630:0:23471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd10f7ae400 already unused, calling callback (ffffffffc12a7c20) 10000000:00010000:1.0:1788843903.975632:0:23471:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.133@tcp lock: ffff9bd10f7ae400/0xa762dfcbd58d2c75 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa762dfcbd58d2c7c expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843903.975638:0:23471:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.133@tcp lock: ffff9bd10f7ae400/0xa762dfcbd58d2c75 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa762dfcbd58d2c7c expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788843903.975654:0:23471:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.133@tcp lock: ffff9bd10f7ae400/0xa762dfcbd58d2c75 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa762dfcbd58d2c7c expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788843903.975658:0:23471:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788843903.975671:0:23471:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.133@tcp lock: ffff9bd10f7ae400/0xa762dfcbd58d2c75 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa762dfcbd58d2c7c expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843903.975676:0:23471:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788843903.975682:0:23471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.133@tcp lock: ffff9bd10f7ae400/0xa762dfcbd58d2c75 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa762dfcbd58d2c7c expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843903.975688:0:23471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.133@tcp lock: ffff9bd10f7ae400/0xa762dfcbd58d2c75 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa762dfcbd58d2c7c expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843903.975699:0:23471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843903.975701:0:23471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843903.975702:0:23471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843903.975708:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788843903.975725:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd1054e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0ce589ba-8334-438e-8f48-13932fcba8b1:3630:1875738134580992:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788843903.975751:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843903.975771:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788843903.975777:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd1054e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0ce589ba-8334-438e-8f48-13932fcba8b1:3630:1875738134581120:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788843903.975796:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843903.975826:0:22696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134580992 00000100:00100000:1.0:1788843903.975830:0:22696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134580992 00010000:00010000:1.0:1788843903.975846:0:22696:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bd1153e6200/0xa762dfcbd58d2c8a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa762dfcbd58d2c83 expref: 25 pid: 22706 timeout: 782 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843903.975866:0:22696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134581120 00000100:00100000:1.0:1788843903.975874:0:22696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134581120 00010000:00010000:1.0:1788843903.975887:0:22696:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bd1153e7e00/0xa762dfcbd58d2c7c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa762dfcbd58d2c75 expref: 26 pid: 22704 timeout: 782 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843903.975904:0:22696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788843903.975913:0:22696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1054e5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0ce589ba-8334-438e-8f48-13932fcba8b1+26:3630:x1875738134580992:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788843903.975922:0:22696:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788843903.975927:0:22696:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bd1153e6200/0xa762dfcbd58d2c8a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa762dfcbd58d2c83 expref: 26 pid: 22706 timeout: 782 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843903.975937:0:22696:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bd1153e6200/0xa762dfcbd58d2c8a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa762dfcbd58d2c83 expref: 26 pid: 22706 timeout: 782 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843903.975952:0:22696:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788843903.975979:0:22696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1054e5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0ce589ba-8334-438e-8f48-13932fcba8b1+26:3630:x1875738134580992:12345-0@lo:103:ldlm_bl.0 Request processed in 68us (226us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843903.975985:0:22696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788843903.975997:0:22696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788843903.976003:0:22696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1054e6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0ce589ba-8334-438e-8f48-13932fcba8b1+25:3630:x1875738134581120:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788843903.976011:0:22696:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788843903.976015:0:22696:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bd1153e7e00/0xa762dfcbd58d2c7c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa762dfcbd58d2c75 expref: 25 pid: 22704 timeout: 782 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843903.976023:0:22696:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bd1153e7e00/0xa762dfcbd58d2c7c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa762dfcbd58d2c75 expref: 25 pid: 22704 timeout: 782 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843903.976034:0:22696:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9bd007947400/0xa762dfcbd58d2de8 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843903.976042:0:22696:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd007947400/0xa762dfcbd58d2de8 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788843903.976059:0:22696:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.016777481s 00010000:00010000:1.0:1788843903.976063:0:22696:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9bd007947400/0xa762dfcbd58d2de8 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843903.976069:0:22696:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9bd007947400/0xa762dfcbd58d2de8 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843903.976075:0:22696:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9bd007947400/0xa762dfcbd58d2de8 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843903.976081:0:22696:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9bd007947400/0xa762dfcbd58d2de8 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843903.976087:0:22696:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd007947400 already unused, calling callback (ffffffffc0cb1420) 00010000:00010000:1.0:1788843903.976090:0:22696:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9bd007947400/0xa762dfcbd58d2de8 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843903.976097:0:22696:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9bd007947400/0xa762dfcbd58d2de8 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843903.976106:0:22696:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9bd007947400/0xa762dfcbd58d2de8 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843903.976113:0:22696:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788843903.976172:0:22696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1054e6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0ce589ba-8334-438e-8f48-13932fcba8b1+25:3630:x1875738134581120:12345-0@lo:103:ldlm_bl.0 Request processed in 168us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843903.976179:0:22696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788843903.976233:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd1054e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0ce589ba-8334-438e-8f48-13932fcba8b1:3630:1875738134581120:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788843903.976241:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd1054e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0ce589ba-8334-438e-8f48-13932fcba8b1:3630:1875738134580992:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788843903.976279:0:22727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd1153e6200/0xa762dfcbd58d2c8a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa762dfcbd58d2c83 expref: 24 pid: 22706 timeout: 782 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843903.976288:0:22727:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd1054e4380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22727:1875738134580736:0@lo:104: 00010000:00010000:1.0:1788843903.976295:0:22727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd1153e7e00/0xa762dfcbd58d2c7c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa762dfcbd58d2c75 expref: 23 pid: 22704 timeout: 782 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843903.976303:0:22727:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd1054e4700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22727:1875738134580864:0@lo:104: 00010000:00010000:1.0:1788843903.976314:0:22727:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9bd007947400/0xa762dfcbd58d2de8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843903.976322:0:22727:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9bd007947400/0xa762dfcbd58d2de8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843903.976328:0:22727:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9bd007947400/0xa762dfcbd58d2de8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843903.976334:0:22727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd007947400/0xa762dfcbd58d2de8 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843903.977980:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd00702dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ce589ba-8334-438e-8f48-13932fcba8b1+22:25038:x1875738134580608:12345-0@lo:253:mount.lustre.0 Request processed in 27969us (28048us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843903.977992:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1788843903.978052:0:25038:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd1054e4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ce589ba-8334-438e-8f48-13932fcba8b1:25038:1875738134580608:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788843903.978066:0:25038:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1788843903.978069:0:25038:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788843903.978071:0:25038:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788843903.978073:0:25038:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788843903.978074:0:25038:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788843903.978084:0:25038:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788843903.978085:0:25038:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788843903.978087:0:25038:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788843903.978089:0:25038:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788843903.978090:0:25038:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788843903.978107:0:25038:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00000001:00000004:1.0:1788843903.990939:0:25038:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 12884901888 00002000:00080000:1.0:1788843903.998048:0:25038:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:1.0:1788843903.998058:0:25038:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:1.0:1788843903.998099:0:25038:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788843903.998174:0:25038:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.133@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788843903.998196:0:25038:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=50 00000080:00000004:1.0:1788843903.998214:0:25038:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:0.0:1788843904.010427:0:25038:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788843904.010744:0:25038:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788843904.614896:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788843904.988943:0:25105:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788843904.989418:0:25105:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788843905.630250:0:23471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788843905.630369:0:22708:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788843905.630391:0:22708:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9bd007394000 from 14 10000000:01000000:0.0:1788843905.630396:0:22708:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788843905.630445:0:22708:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd10f7afc00/0xa762dfcbd58d2def lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843905.630457:0:22708:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.133@tcp lock: ffff9bd10f7afc00/0xa762dfcbd58d2def lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843905.630468:0:22708:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.133@tcp lock: ffff9bd10f7afc00/0xa762dfcbd58d2def lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843905.630495:0:22708:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd00723e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ce589ba-8334-438e-8f48-13932fcba8b1:22708:1875738134581248:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788843905.630572:0:22708:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843905.630678:0:22708:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd10556acc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788843905.630726:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134581248 00000100:00100000:3.0:1788843905.630734:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134581248 00000100:00100000:3.0:1788843905.630839:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1788843905.630850:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd00702e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ce589ba-8334-438e-8f48-13932fcba8b1+22:22708:x1875738134581248:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788843905.630866:0:22706:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788843905.630880:0:22706:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd007be3e00/0xa762dfcbd58d2df6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa762dfcbd58d2def expref: -99 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843905.630905:0:22706:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd007be3e00/0xa762dfcbd58d2df6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa762dfcbd58d2def expref: 23 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843905.630916:0:22706:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd007be3e00/0xa762dfcbd58d2df6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa762dfcbd58d2def expref: 23 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843905.630924:0:22706:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd007be3e00, rc 0) 00000100:00100000:3.0:1788843905.630974:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd00702e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ce589ba-8334-438e-8f48-13932fcba8b1+23:22708:x1875738134581248:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 126us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843905.630982:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788843905.631062:0:22708:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd00723e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ce589ba-8334-438e-8f48-13932fcba8b1:22708:1875738134581248:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788843905.631079:0:22708:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.133@tcp lock: ffff9bd10f7afc00/0xa762dfcbd58d2def lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d2df6 expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843905.631088:0:22708:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.133@tcp lock: ffff9bd10f7afc00/0xa762dfcbd58d2def lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa762dfcbd58d2df6 expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843905.631181:0:22708:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd00723e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ce589ba-8334-438e-8f48-13932fcba8b1:22708:1875738134581376:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788843905.631212:0:22708:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843905.631378:0:22708:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd10556acc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788843905.631447:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134581376 00000100:00100000:1.0:1788843905.631451:0:22704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134581376 00000100:00100000:1.0:1788843905.631481:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1788843905.631487:0:22704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd00702c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ce589ba-8334-438e-8f48-13932fcba8b1+23:22708:x1875738134581376:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1788843905.631504:0:22704:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788843905.631525:0:22704:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788843905.631528:0:22704:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 14 00000100:00100000:1.0:1788843905.631623:0:22704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd00702c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ce589ba-8334-438e-8f48-13932fcba8b1+23:22708:x1875738134581376:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 135us (409us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843905.631631:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788843905.631713:0:22708:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd00723e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ce589ba-8334-438e-8f48-13932fcba8b1:22708:1875738134581376:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788843905.631784:0:22708:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.133@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788843905.631792:0:22708:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd10f7afc00/0xa762dfcbd58d2def lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d2df6 expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843905.631811:0:22708:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.133@tcp lock: ffff9bd10f7afc00/0xa762dfcbd58d2def lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d2df6 expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788843905.631822:0:22708:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788843905.631824:0:22708:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9bd127b94800 from 14 10000000:01000000:0.0:1788843905.631827:0:22708:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788843905.631846:0:22708:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd10f7ae800/0xa762dfcbd58d2dfd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843905.631853:0:22708:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.133@tcp lock: ffff9bd10f7ae800/0xa762dfcbd58d2dfd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843905.631860:0:22708:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.133@tcp lock: ffff9bd10f7ae800/0xa762dfcbd58d2dfd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843905.631876:0:22708:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd00723e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ce589ba-8334-438e-8f48-13932fcba8b1:22708:1875738134581504:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788843905.631902:0:22708:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843905.631922:0:22708:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd10556acc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788843905.631975:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134581504 00000100:00100000:1.0:1788843905.631979:0:22704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134581504 00000100:00100000:1.0:1788843905.631996:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1788843905.632002:0:22704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd00702e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ce589ba-8334-438e-8f48-13932fcba8b1+23:22708:x1875738134581504:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788843905.632011:0:22704:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788843905.632027:0:22704:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd007947400/0xa762dfcbd58d2e04 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa762dfcbd58d2dfd expref: -99 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843905.632049:0:22704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd007947400/0xa762dfcbd58d2e04 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa762dfcbd58d2dfd expref: 24 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843905.632058:0:22704:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd007947400/0xa762dfcbd58d2e04 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa762dfcbd58d2dfd expref: 24 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843905.632064:0:22704:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd007947400, rc 0) 00000100:00100000:1.0:1788843905.632102:0:22704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd00702e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ce589ba-8334-438e-8f48-13932fcba8b1+24:22708:x1875738134581504:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 99us (199us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843905.632116:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788843905.632214:0:22708:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd00723e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ce589ba-8334-438e-8f48-13932fcba8b1:22708:1875738134581504:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788843905.632225:0:22708:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.133@tcp lock: ffff9bd10f7ae800/0xa762dfcbd58d2dfd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d2e04 expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843905.632232:0:22708:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.133@tcp lock: ffff9bd10f7ae800/0xa762dfcbd58d2dfd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa762dfcbd58d2e04 expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843905.632270:0:22708:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd00723e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ce589ba-8334-438e-8f48-13932fcba8b1:22708:1875738134581632:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788843905.632299:0:22708:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843905.632333:0:22708:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd10556acc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788843905.632381:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134581632 00000100:00100000:1.0:1788843905.632385:0:22704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134581632 00000100:00100000:1.0:1788843905.632403:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1788843905.632408:0:22704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd00702d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ce589ba-8334-438e-8f48-13932fcba8b1+24:22708:x1875738134581632:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1788843905.632418:0:22704:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788843905.632429:0:22704:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788843905.632432:0:22704:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 14 00000100:00100000:1.0:1788843905.632502:0:22704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd00702d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ce589ba-8334-438e-8f48-13932fcba8b1+24:22708:x1875738134581632:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 92us (201us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843905.632508:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788843905.632576:0:22708:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd00723e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ce589ba-8334-438e-8f48-13932fcba8b1:22708:1875738134581632:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788843905.632615:0:22708:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.133@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788843905.632621:0:22708:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd10f7ae800/0xa762dfcbd58d2dfd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d2e04 expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843905.632628:0:22708:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.133@tcp lock: ffff9bd10f7ae800/0xa762dfcbd58d2dfd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d2e04 expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843906.458451:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd00723e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1875738134581760:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788843906.458529:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843906.461313:0:24226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134581760 00000100:00100000:3.0:1788843906.461327:0:24226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134581760 00000100:00100000:3.0:1788843906.461514:0:24226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788843906.461527:0:24226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1054e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3632:x1875738134581760:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788843906.461565:0:24226:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915857920 avail 3684335616 00000100:00100000:3.0:1788843906.461710:0:24226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1054e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3632:x1875738134581760:12345-0@lo:13:osp-pre-0-0.0 Request processed in 186us (3179us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843906.461717:0:24226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788843906.461749:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007ba0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1875738134581888:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788843906.461776:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd00723e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1875738134581760:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788843906.461798:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843906.461838:0:24226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134581888 00000100:00100000:3.0:1788843906.461841:0:24226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134581888 00000100:00100000:3.0:1788843906.461861:0:24226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788843906.461867:0:24226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007ba1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1875738134581888:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788843906.461877:0:24226:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915857920 avail 3684335616 00000100:00100000:3.0:1788843906.461915:0:24226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007ba1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1875738134581888:12345-0@lo:13:osp-pre-0-1.0 Request processed in 48us (116us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843906.461921:0:24226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:1.0:1788843906.462038:0:22707:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788843906.464486:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007ba0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1875738134581888:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1788843906.650254:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788843907.484477:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd00723c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1875738134582016:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788843907.484753:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843907.484808:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788843907.484814:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd00723f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1875738134582144:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788843907.484838:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843907.484869:0:23743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134582016 00000100:00100000:2.0:1788843907.484877:0:23743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134582016 00000100:00100000:2.0:1788843907.484924:0:23743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134582144 00000100:00100000:2.0:1788843907.484927:0:23743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134582144 00000100:00100000:2.0:1788843907.484943:0:23743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788843907.484962:0:23743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007ba0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3630:x1875738134582016:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788843907.484999:0:23743:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1788843907.485046:0:23743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007ba0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3630:x1875738134582016:12345-0@lo:41:osp-pre-0-1.0 Request processed in 84us (293us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843907.485053:0:23743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788843907.485071:0:23743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788843907.485078:0:23743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007ba2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3630:x1875738134582144:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788843907.485107:0:23743:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788843907.485134:0:23743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007ba2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3630:x1875738134582144:12345-0@lo:41:osp-pre-1-0.0 Request processed in 57us (295us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843907.485165:0:23743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788843907.485209:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd00723f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1875738134582144:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788843907.485221:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd00723c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1875738134582016:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1788843907.675992:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843908.704949:0:23471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788843909.018362:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788843909.018370:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788843909.018375:0:8:0:(import.c:65:import_set_state_nolock()) ffff9bd0059c6000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788843909.018391:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9bd0059c6000 using connection 192.168.203.133@tcp/0@lo 00000100:00100000:3.0:1788843909.018419:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bd1074fd500 x1875738134582656/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788843909.018458:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788843909.018462:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788843909.018464:0:8:0:(import.c:65:import_set_state_nolock()) ffff9bd112389800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788843909.018469:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9bd112389800 using connection 192.168.203.133@tcp/0@lo 00000100:00100000:3.0:1788843909.018480:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bd007769500 x1875738134583168/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788843909.018557:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd1074fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0ce589ba-8334-438e-8f48-13932fcba8b1:3632:1875738134582272:0@lo:400:kworker.0 00000100:00100000:3.0:1788843909.018664:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843909.018713:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd00776bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1875738134582912:0@lo:400:kworker.0 00000100:00100000:3.0:1788843909.018741:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843909.018758:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007768380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3632:1875738134583552:0@lo:400:kworker.0 00000100:00100000:3.0:1788843909.018782:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843909.018807:0:3632:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1788843909.018812:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd1074fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1875738134582400:0@lo:400:kworker.0 00000100:00100000:3.0:1788843909.018832:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843909.018849:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd00776a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1875738134583040:0@lo:400:kworker.0 00000100:00100000:3.0:1788843909.018870:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843909.018883:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007769880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3632:1875738134583680:0@lo:400:kworker.0 00000100:00100000:3.0:1788843909.018908:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843909.018936:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd1074ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1875738134582528:0@lo:400:kworker.0 00000100:00100000:3.0:1788843909.018961:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843909.018975:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007768000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3630:1875738134583296:0@lo:400:kworker.0 00000100:00100000:3.0:1788843909.018993:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843909.019009:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007769c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3630:1875738134583808:0@lo:400:kworker.0 00000100:00100000:3.0:1788843909.019027:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843909.019036:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788843909.019041:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd1074ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3630:1875738134582784:0@lo:400:kworker.0 00000100:00100000:3.0:1788843909.019060:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843909.019070:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007768e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3630:1875738134583424:0@lo:400:kworker.0 00000100:00100000:3.0:1788843909.019108:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843909.019132:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd1074fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3629:1875738134582656:0@lo:8:kworker.0 00000100:00100000:3.0:1788843909.019194:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843909.019211:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007769500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3629:1875738134583168:0@lo:8:kworker.0 00000100:00100000:3.0:1788843909.019236:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843909.019269:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134582272 00000100:00100000:3.0:1788843909.019278:0:22704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134582272 00000100:00100000:3.0:1788843909.019330:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1788843909.019339:0:22704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd00702d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ce589ba-8334-438e-8f48-13932fcba8b1+24:3632:x1875738134582272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788843909.019389:0:22704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd00702d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ce589ba-8334-438e-8f48-13932fcba8b1+24:3632:x1875738134582272:12345-0@lo:400:kworker.0 Request processed in 50us (724us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843909.019397:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1788843909.019436:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134583552 00000100:00100000:3.0:1788843909.019440:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134583552 00000100:00100000:3.0:1788843909.019471:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134583680 00000100:00100000:3.0:1788843909.019474:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134583680 00000100:00100000:3.0:1788843909.019489:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134583296 00000100:00100000:3.0:1788843909.019492:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134583296 00000100:00100000:3.0:1788843909.019505:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134583808 00000100:00100000:3.0:1788843909.019508:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134583808 00000100:00100000:3.0:1788843909.019519:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134582784 00000100:00100000:3.0:1788843909.019521:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134582784 00000100:00100000:3.0:1788843909.019532:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134583424 00000100:00100000:3.0:1788843909.019534:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134583424 00000100:00100000:3.0:1788843909.019548:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788843909.019555:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007768700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3632:x1875738134583552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788843909.019587:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007768700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3632:x1875738134583552:12345-0@lo:400:kworker.0 Request processed in 33us (804us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843909.019593:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788843909.019618:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788843909.019624:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd00776a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3632:x1875738134583680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788843909.019671:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd00776a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3632:x1875738134583680:12345-0@lo:400:kworker.0 Request processed in 48us (762us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843909.019678:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788843909.019690:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788843909.019695:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd00776ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3630:x1875738134583296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788843909.019722:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd00776ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3630:x1875738134583296:12345-0@lo:400:kworker.0 Request processed in 27us (728us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843909.019727:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788843909.019738:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788843909.019743:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007768a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3630:x1875738134583808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788843909.019764:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007768a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3630:x1875738134583808:12345-0@lo:400:kworker.0 Request processed in 22us (737us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843909.019770:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788843909.019780:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788843909.019785:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd00776b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3630:x1875738134582784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788843909.019807:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd00776b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3630:x1875738134582784:12345-0@lo:400:kworker.0 Request processed in 22us (746us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843909.019813:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788843909.019822:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788843909.019828:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007769f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3630:x1875738134583424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788843909.019849:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007769f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3630:x1875738134583424:12345-0@lo:400:kworker.0 Request processed in 22us (743us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843909.019855:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788843909.019874:0:22717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134582912 00000100:00100000:3.0:1788843909.019878:0:22717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134582912 00000100:00100000:3.0:1788843909.019910:0:22717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134582400 00000100:00100000:3.0:1788843909.019912:0:22717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134582400 00000100:00100000:3.0:1788843909.019924:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788843909.019930:0:22717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd00776b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3632:x1875738134582912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788843909.019960:0:22717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd00776b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3632:x1875738134582912:12345-0@lo:400:kworker.0 Request processed in 31us (1219us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843909.019967:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788843909.019976:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788843909.019982:0:22717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007769180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3632:x1875738134582400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788843909.020005:0:22717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007769180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3632:x1875738134582400:12345-0@lo:400:kworker.0 Request processed in 24us (1172us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843909.020011:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788843909.020035:0:24686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134583040 00000100:00100000:3.0:1788843909.020038:0:24686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134583040 00000100:00100000:3.0:1788843909.020055:0:24686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134582528 00000100:00100000:3.0:1788843909.020058:0:24686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134582528 00000100:00100000:3.0:1788843909.020067:0:24686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134582656 00000100:00100000:3.0:1788843909.020070:0:24686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134582656 00000100:00100000:3.0:1788843909.020077:0:24686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134583168 00000100:00100000:3.0:1788843909.020079:0:24686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134583168 00000100:00100000:3.0:1788843909.020102:0:24686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788843909.020109:0:24686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd00776b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3632:x1875738134583040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788843909.020138:0:24686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd00776b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3632:x1875738134583040:12345-0@lo:400:kworker.0 Request processed in 30us (1267us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843909.020167:0:24686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788843909.020178:0:24686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788843909.020184:0:24686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd00776aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3630:x1875738134582528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788843909.020211:0:24686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd00776aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3630:x1875738134582528:12345-0@lo:400:kworker.0 Request processed in 28us (1250us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843909.020222:0:24686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788843909.020234:0:24686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788843909.020238:0:24686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f986d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3629:x1875738134582656:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1788843909.020269:0:24686:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 687 last 0 00000020:00000080:3.0:1788843909.020304:0:24686:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa762dfcbd58d2e0b 00002000:00100000:3.0:1788843909.020321:0:24686:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9bd001793000 ocd_connect_flags: 0xa044401443000026 ocd_version: 211396f ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:3.0:1788843909.020325:0:24686:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:3.0:1788843909.020329:0:24686:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1788843909.020543:0:24686:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788843909.020571:0:24686:0:(import.c:65:import_set_state_nolock()) ffff9bd001794000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788843909.020615:0:24686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f986d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3629:x1875738134582656:12345-0@lo:8:kworker.0 Request processed in 376us (1420us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843909.020623:0:24686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788843909.020636:0:24686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788843909.020640:0:24686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f984380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3629:x1875738134583168:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1788843909.020655:0:24686:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 687 last 0 00000020:00000080:3.0:1788843909.020671:0:24686:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xa762dfcbd58d2e12 00002000:00100000:3.0:1788843909.020676:0:24686:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff9bd001792800 ocd_connect_flags: 0xa044401443000026 ocd_version: 211396f ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:3.0:1788843909.020679:0:24686:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00002000:00100000:3.0:1788843909.020681:0:24686:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1788843909.020702:0:24686:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:3.0:1788843909.020715:0:24686:0:(import.c:65:import_set_state_nolock()) ffff9bd001791000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788843909.020740:0:24686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f984380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:3629:x1875738134583168:12345-0@lo:8:kworker.0 Request processed in 100us (1505us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843909.020746:0:24686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:3.0:1788843909.020775:0:22707:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788843909.020780:0:22707:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788843909.020782:0:22707:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1788843909.020817:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd1074fd500 x1875738134582656/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788843934 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788843909.020834:0:3629:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 3 00000100:00080000:3.0:1788843909.020842:0:3629:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1788843909.020848:0:3629:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1788843909.020850:0:3629:0:(import.c:65:import_set_state_nolock()) ffff9bd0059c6000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1788843909.020866:0:3629:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1788843909.020872:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd1074fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3629:1875738134582656:0@lo:8:kworker.0 00010000:00080000:3.0:1788843909.020885:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd007769500 x1875738134583168/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788843934 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788843909.020910:0:3629:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 3 00000100:00080000:3.0:1788843909.020916:0:3629:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1788843909.020919:0:3629:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1788843909.020921:0:3629:0:(import.c:65:import_set_state_nolock()) ffff9bd112389800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1788843909.020932:0:3629:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1788843909.020936:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007769500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3629:1875738134583168:0@lo:8:kworker.0 00000004:00080000:3.0:1788843909.020992:0:22739:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x6:0x0] 00000100:00100000:3.0:1788843909.021011:0:22739:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f986300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22739:1875738134584064:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1788843909.021039:0:22739:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843909.021056:0:22739:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd12e003c00 going to sleep for 11 seconds 00000004:00080000:3.0:1788843909.021072:0:22738:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:2.0:1788843909.021243:0:24225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134584064 00000100:00100000:2.0:1788843909.021249:0:24225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134584064 00000100:00100000:2.0:1788843909.021281:0:24225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788843909.021288:0:24225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f985f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:22739:x1875738134584064:12345-0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1788843909.021567:0:23457:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:2.0:1788843909.021583:0:23457:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007ba3b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23457:1875738134584320:0@lo:7:osp-pre-1-1.0 00000100:00100000:2.0:1788843909.021617:0:23457:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843909.021644:0:23457:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd007b9d3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788843909.021656:0:24224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134584320 00000100:00100000:2.0:1788843909.021659:0:24224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134584320 00000100:00100000:2.0:1788843909.021685:0:24224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788843909.021691:0:24224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1203d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:23457:x1875738134584320:12345-0@lo:7:osp-pre-1-1.0 00000004:00080000:0.0:1788843909.023469:0:23456:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1788843909.023590:0:23456:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 687076448446ns, next at 0ns, rc = 0 00080000:00080000:0.0:1788843909.023599:0:23456:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000004:00080000:2.0:1788843909.025943:0:23446:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00002000:00080000:0.0:1788843909.026823:0:24225:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:0.0:1788843909.026836:0:24225:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = -59 00002000:02000040:0.0:1788843909.026842:0:24225:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:7 to 0x2c0000401:65) 00000100:00100000:3.0:1788843909.028027:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788843909.028066:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007ba3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1875738134584192:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788843909.028199:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843909.028261:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f985880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1875738134583936:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788843909.028291:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788843909.028325:0:22707:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1788843909.028367:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd1074ff480 x1875738134582784/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843925 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788843909.028383:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd1074ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3630:1875738134582784:0@lo:400:kworker.0 00010000:00080000:3.0:1788843909.028398:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd007768e00 x1875738134583424/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843925 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788843909.028406:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007768e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3630:1875738134583424:0@lo:400:kworker.0 00000100:00100000:3.0:1788843909.028420:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd1074ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1875738134582528:0@lo:400:kworker.0 00010000:00080000:3.0:1788843909.028432:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd007768000 x1875738134583296/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843925 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788843909.028442:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007768000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3630:1875738134583296:0@lo:400:kworker.0 00010000:00080000:3.0:1788843909.028454:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd007769c00 x1875738134583808/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843925 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788843909.028461:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007769c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3630:1875738134583808:0@lo:400:kworker.0 00000100:00100000:3.0:1788843909.028509:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd1074fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1875738134582400:0@lo:400:kworker.0 00000100:00100000:3.0:1788843909.028522:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd00776a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1875738134583040:0@lo:400:kworker.0 00010000:00080000:3.0:1788843909.028534:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd007769880 x1875738134583680/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843925 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788843909.028544:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007769880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3632:1875738134583680:0@lo:400:kworker.0 00000100:00100000:3.0:1788843909.028555:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd1074fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0ce589ba-8334-438e-8f48-13932fcba8b1:3632:1875738134582272:0@lo:400:kworker.0 00000100:00100000:3.0:1788843909.028578:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd00776bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1875738134582912:0@lo:400:kworker.0 00010000:00080000:3.0:1788843909.028590:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd007768380 x1875738134583552/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843925 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788843909.028597:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007768380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3632:1875738134583552:0@lo:400:kworker.0 00000004:00080000:3.0:1788843909.029379:0:22738:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 687082235073ns, next at 0ns, rc = 0 00080000:00080000:3.0:1788843909.029391:0:22738:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:1.0:1788843909.029495:0:24226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134584192 00000100:00100000:1.0:1788843909.029506:0:24226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134584192 00000100:00100000:1.0:1788843909.029558:0:24226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134583936 00000100:00100000:1.0:1788843909.029562:0:24226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134583936 00000100:00100000:1.0:1788843909.029580:0:24226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788843909.029591:0:24226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f985500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3633:x1875738134584192:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788843909.029628:0:24226:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788843909.029782:0:24226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f985500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3633:x1875738134584192:12345-0@lo:13:osp-pre-1-1.0 Request processed in 192us (1582us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843909.029790:0:24226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788843909.029809:0:24226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788843909.029815:0:24226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f984a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3631:x1875738134583936:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788843909.029825:0:24226:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788843909.029855:0:24226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f984a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3631:x1875738134583936:12345-0@lo:13:osp-pre-1-0.0 Request processed in 41us (1564us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843909.029861:0:24226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1788843909.030999:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd007ba3480 x1875738134584192/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788843925 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788843909.031023:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007ba3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1875738134584192:0@lo:13:osp-pre-1-1.0 00010000:00080000:3.0:1788843909.031069:0:3631:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd10f985880 x1875738134583936/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788843925 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788843909.031112:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f985880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1875738134583936:0@lo:13:osp-pre-1-0.0 00000004:00080000:3.0:1788843909.039289:0:22691:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00002000:00080000:0.0:1788843909.049569:0:24224:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:0.0:1788843909.049583:0:24224:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x41:0x0] 00000100:00100000:0.0:1788843909.049791:0:24224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1203d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:23457:x1875738134584320:12345-0@lo:7:osp-pre-1-1.0 Request processed in 28094us (28167us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843909.049804:0:24224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:0.0:1788843909.049877:0:23457:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd007ba3b80 x1875738134584320/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788843925 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788843909.049894:0:23457:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007ba3b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23457:1875738134584320:0@lo:7:osp-pre-1-1.0 00000004:00080000:0.0:1788843909.049912:0:23457:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x41:0x0] 00000100:00100000:0.0:1788843909.049976:0:23457:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd00723ed80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23457:1875738134584448:0@lo:5:osp-pre-1-1.0 00000100:00100000:0.0:1788843909.050381:0:23457:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843909.050417:0:23457:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd10556a300 going to sleep for 11 seconds 00000100:00100000:0.0:1788843909.050440:0:24222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134584448 00000100:00100000:0.0:1788843909.050447:0:24222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134584448 00000100:00100000:0.0:1788843909.050494:0:24222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788843909.050503:0:24222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd00723dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:23457:x1875738134584448:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:0.0:1788843909.050534:0:24222:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = 0 00000100:00100000:0.0:1788843909.050573:0:24222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd00723dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:23457:x1875738134584448:12345-0@lo:5:osp-pre-1-1.0 Request processed in 71us (192us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843909.050580:0:24222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:0.0:1788843909.050608:0:23457:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd00723ed80 x1875738134584448/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788843925 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788843909.050618:0:23457:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd00723ed80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23457:1875738134584448:0@lo:5:osp-pre-1-1.0 00000004:00080000:0.0:1788843909.050629:0:23457:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x41:0x0] from OST, last_created [0x2c0000400:0x41:0x0]last_used is [0x2c0000400:0x41:0x0] 00000100:00100000:0.0:1788843909.050670:0:23457:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd00723ed80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23457:1875738134584576:0@lo:5:osp-pre-1-1.0 00000100:00100000:0.0:1788843909.050693:0:23457:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843909.050707:0:23457:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd10556a300 going to sleep for 11 seconds 00000100:00100000:0.0:1788843909.050720:0:24686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134584576 00000100:00100000:0.0:1788843909.050724:0:24686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134584576 00000100:00100000:0.0:1788843909.050743:0:24686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788843909.050864:0:24686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd00723fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:23457:x1875738134584576:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:0.0:1788843909.050895:0:24686:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 66 00002000:00010000:1.0:1788843909.053270:0:24225:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788843909.053287:0:24225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000feef1e72/0xa762dfcbd58d2e19 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843909.053309:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x41:0x0].0x0 since=687s v=(0 0) 00010000:00010000:1.0:1788843909.053314:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x41:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788843909.053322:0:24225:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000feef1e72/0xa762dfcbd58d2e19 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843909.053343:0:24225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000feef1e72/0xa762dfcbd58d2e19 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843909.053355:0:24225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000feef1e72/0xa762dfcbd58d2e19 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843909.053372:0:24225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000feef1e72/0xa762dfcbd58d2e19 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843909.053392:0:24225:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788843909.053407:0:22699:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788843909.053413:0:22699:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000feef1e72/0xa762dfcbd58d2e19 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843909.053421:0:22699:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd1420e4200 already unused, calling callback (ffffffffc0cb1420) 00010000:00010000:1.0:1788843909.053426:0:22699:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000feef1e72/0xa762dfcbd58d2e19 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843909.053435:0:22699:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000feef1e72/0xa762dfcbd58d2e19 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843909.053454:0:22699:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000feef1e72/0xa762dfcbd58d2e19 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843909.053462:0:22699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000feef1e72/0xa762dfcbd58d2e19 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843909.053483:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843909.053484:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843909.053486:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788843909.056072:0:24225:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788843909.056107:0:24225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003ea6c0d6/0xa762dfcbd58d2e20 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843909.056127:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x40:0x0].0x0 since=687s v=(0 0) 00010000:00010000:1.0:1788843909.056132:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788843909.056158:0:24225:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003ea6c0d6/0xa762dfcbd58d2e20 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843909.056176:0:24225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003ea6c0d6/0xa762dfcbd58d2e20 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843909.056187:0:24225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003ea6c0d6/0xa762dfcbd58d2e20 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843909.056195:0:24225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003ea6c0d6/0xa762dfcbd58d2e20 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843909.056220:0:24225:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788843909.056233:0:22700:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788843909.056241:0:22700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003ea6c0d6/0xa762dfcbd58d2e20 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843909.056250:0:22700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd1420e4400 already unused, calling callback (ffffffffc0cb1420) 00010000:00010000:1.0:1788843909.056255:0:22700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003ea6c0d6/0xa762dfcbd58d2e20 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843909.056264:0:22700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003ea6c0d6/0xa762dfcbd58d2e20 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843909.056292:0:22700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003ea6c0d6/0xa762dfcbd58d2e20 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843909.056301:0:22700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003ea6c0d6/0xa762dfcbd58d2e20 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843909.056323:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843909.056325:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843909.056327:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788843909.061842:0:24225:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788843909.061860:0:24225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000feef1e72/0xa762dfcbd58d2e27 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843909.061883:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3f:0x0].0x0 since=687s v=(0 0) 00010000:00010000:1.0:1788843909.061889:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788843909.061896:0:24225:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000feef1e72/0xa762dfcbd58d2e27 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843909.061914:0:24225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000feef1e72/0xa762dfcbd58d2e27 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843909.061927:0:24225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000feef1e72/0xa762dfcbd58d2e27 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843909.061936:0:24225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000feef1e72/0xa762dfcbd58d2e27 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843909.062000:0:24225:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788843909.062274:0:23471:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788843909.062284:0:23471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000feef1e72/0xa762dfcbd58d2e27 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843909.062296:0:23471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd1420e4200 already unused, calling callback (ffffffffc0cb1420) 00010000:00010000:3.0:1788843909.062301:0:23471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000feef1e72/0xa762dfcbd58d2e27 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843909.062312:0:23471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000feef1e72/0xa762dfcbd58d2e27 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843909.062345:0:23471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000feef1e72/0xa762dfcbd58d2e27 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843909.062354:0:23471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000feef1e72/0xa762dfcbd58d2e27 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843909.062374:0:23471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788843909.062377:0:23471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788843909.062379:0:23471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788843909.062647:0:24225:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788843909.062653:0:24225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000050a2c32f/0xa762dfcbd58d2e2e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843909.062663:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3e:0x0].0x0 since=687s v=(0 0) 00010000:00010000:1.0:1788843909.062667:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788843909.062672:0:24225:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000050a2c32f/0xa762dfcbd58d2e2e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843909.062680:0:24225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000050a2c32f/0xa762dfcbd58d2e2e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843909.062688:0:24225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000050a2c32f/0xa762dfcbd58d2e2e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843909.062695:0:24225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000050a2c32f/0xa762dfcbd58d2e2e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843909.062709:0:24225:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788843909.062718:0:22699:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788843909.062722:0:22699:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000050a2c32f/0xa762dfcbd58d2e2e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843909.062730:0:22699:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd1420e4600 already unused, calling callback (ffffffffc0cb1420) 00010000:00010000:1.0:1788843909.062738:0:22699:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000050a2c32f/0xa762dfcbd58d2e2e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843909.062746:0:22699:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000050a2c32f/0xa762dfcbd58d2e2e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843909.062772:0:22699:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000050a2c32f/0xa762dfcbd58d2e2e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843909.062780:0:22699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000050a2c32f/0xa762dfcbd58d2e2e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843909.062794:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843909.062795:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843909.062797:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788843909.063101:0:24225:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788843909.063107:0:24225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007a71fe12/0xa762dfcbd58d2e35 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843909.063117:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3d:0x0].0x0 since=687s v=(0 0) 00010000:00010000:1.0:1788843909.063120:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788843909.063125:0:24225:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007a71fe12/0xa762dfcbd58d2e35 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843909.063135:0:24225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007a71fe12/0xa762dfcbd58d2e35 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843909.063170:0:24225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007a71fe12/0xa762dfcbd58d2e35 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843909.063187:0:24225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007a71fe12/0xa762dfcbd58d2e35 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843909.063203:0:24225:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788843909.063213:0:22700:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788843909.063219:0:22700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007a71fe12/0xa762dfcbd58d2e35 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843909.063227:0:22700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd13fbeae00 already unused, calling callback (ffffffffc0cb1420) 00010000:00010000:1.0:1788843909.063231:0:22700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007a71fe12/0xa762dfcbd58d2e35 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843909.063239:0:22700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007a71fe12/0xa762dfcbd58d2e35 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843909.063251:0:22700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007a71fe12/0xa762dfcbd58d2e35 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843909.063259:0:22700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007a71fe12/0xa762dfcbd58d2e35 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843909.063275:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843909.063277:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843909.063280:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788843909.063773:0:24225:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788843909.063788:0:24225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008940daf1/0xa762dfcbd58d2e3c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843909.063799:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3c:0x0].0x0 since=687s v=(0 0) 00010000:00010000:1.0:1788843909.063803:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788843909.063808:0:24225:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008940daf1/0xa762dfcbd58d2e3c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843909.063820:0:24225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008940daf1/0xa762dfcbd58d2e3c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843909.063829:0:24225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008940daf1/0xa762dfcbd58d2e3c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843909.063837:0:24225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008940daf1/0xa762dfcbd58d2e3c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843909.063855:0:24225:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788843909.063865:0:23471:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788843909.063868:0:23471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008940daf1/0xa762dfcbd58d2e3c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843909.063874:0:23471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd13fbea200 already unused, calling callback (ffffffffc0cb1420) 00010000:00010000:1.0:1788843909.063877:0:23471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008940daf1/0xa762dfcbd58d2e3c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843909.063882:0:23471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008940daf1/0xa762dfcbd58d2e3c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843909.063897:0:23471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008940daf1/0xa762dfcbd58d2e3c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843909.063903:0:23471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008940daf1/0xa762dfcbd58d2e3c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843909.063913:0:23471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843909.063915:0:23471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843909.063917:0:23471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788843909.064240:0:24225:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788843909.064246:0:24225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b11d7803/0xa762dfcbd58d2e43 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843909.064253:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3b:0x0].0x0 since=687s v=(0 0) 00010000:00010000:1.0:1788843909.064256:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788843909.064259:0:24225:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b11d7803/0xa762dfcbd58d2e43 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843909.064266:0:24225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b11d7803/0xa762dfcbd58d2e43 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843909.064270:0:24225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b11d7803/0xa762dfcbd58d2e43 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843909.064276:0:24225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b11d7803/0xa762dfcbd58d2e43 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843909.064306:0:24225:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788843909.064725:0:24225:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788843909.064733:0:24225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000017de66bd/0xa762dfcbd58d2e4a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843909.064743:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3a:0x0].0x0 since=687s v=(0 0) 00010000:00010000:1.0:1788843909.064747:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788843909.064751:0:24225:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000017de66bd/0xa762dfcbd58d2e4a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843909.064760:0:24225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000017de66bd/0xa762dfcbd58d2e4a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843909.064768:0:24225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000017de66bd/0xa762dfcbd58d2e4a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843909.064775:0:24225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000017de66bd/0xa762dfcbd58d2e4a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843909.064789:0:24225:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788843909.064799:0:22700:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788843909.064804:0:22700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b11d7803/0xa762dfcbd58d2e43 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843909.064812:0:22700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd13fbeb200 already unused, calling callback (ffffffffc0cb1420) 00010000:00010000:1.0:1788843909.064823:0:22700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b11d7803/0xa762dfcbd58d2e43 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843909.064832:0:22700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b11d7803/0xa762dfcbd58d2e43 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843909.064847:0:22700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b11d7803/0xa762dfcbd58d2e43 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843909.064855:0:22700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b11d7803/0xa762dfcbd58d2e43 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843909.064870:0:22700:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788843909.064873:0:22700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000017de66bd/0xa762dfcbd58d2e4a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843909.064880:0:22700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd13fbeaa00 already unused, calling callback (ffffffffc0cb1420) 00010000:00010000:1.0:1788843909.064883:0:22700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000017de66bd/0xa762dfcbd58d2e4a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843909.064889:0:22700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000017de66bd/0xa762dfcbd58d2e4a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843909.064898:0:22700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000017de66bd/0xa762dfcbd58d2e4a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843909.064906:0:22700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000017de66bd/0xa762dfcbd58d2e4a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843909.064927:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843909.064928:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843909.064930:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788843909.065294:0:24225:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788843909.065301:0:24225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000063bbee92/0xa762dfcbd58d2e51 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843909.065311:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x39:0x0].0x0 since=687s v=(0 0) 00010000:00010000:1.0:1788843909.065315:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788843909.065320:0:24225:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000063bbee92/0xa762dfcbd58d2e51 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843909.065330:0:24225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000063bbee92/0xa762dfcbd58d2e51 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843909.065339:0:24225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000063bbee92/0xa762dfcbd58d2e51 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843909.065346:0:24225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000063bbee92/0xa762dfcbd58d2e51 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843909.065360:0:24225:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788843909.065367:0:23471:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788843909.065371:0:23471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000063bbee92/0xa762dfcbd58d2e51 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843909.065392:0:23471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd13fbeb600 already unused, calling callback (ffffffffc0cb1420) 00010000:00010000:1.0:1788843909.065395:0:23471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000063bbee92/0xa762dfcbd58d2e51 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843909.065403:0:23471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000063bbee92/0xa762dfcbd58d2e51 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843909.065415:0:23471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000063bbee92/0xa762dfcbd58d2e51 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843909.065423:0:23471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000063bbee92/0xa762dfcbd58d2e51 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843909.065437:0:23471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843909.065439:0:23471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843909.065441:0:23471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843909.065876:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788843909.065879:0:24225:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788843909.065886:0:24225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004ec913a5/0xa762dfcbd58d2e58 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843909.065895:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x38:0x0].0x0 since=687s v=(0 0) 00010000:00010000:1.0:1788843909.065898:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788843909.065903:0:24225:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004ec913a5/0xa762dfcbd58d2e58 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843909.065913:0:24225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004ec913a5/0xa762dfcbd58d2e58 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843909.065928:0:24225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004ec913a5/0xa762dfcbd58d2e58 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843909.065935:0:24225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004ec913a5/0xa762dfcbd58d2e58 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843909.066074:0:24225:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788843909.066385:0:24225:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788843909.066391:0:24225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000be6f09ac/0xa762dfcbd58d2e5f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843909.066401:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x37:0x0].0x0 since=687s v=(0 0) 00010000:00010000:1.0:1788843909.066404:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788843909.066409:0:24225:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000be6f09ac/0xa762dfcbd58d2e5f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843909.066419:0:24225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000be6f09ac/0xa762dfcbd58d2e5f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843909.066428:0:24225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000be6f09ac/0xa762dfcbd58d2e5f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843909.066436:0:24225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000be6f09ac/0xa762dfcbd58d2e5f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843909.073504:0:24225:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788843909.073530:0:23471:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788843909.073541:0:23471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004ec913a5/0xa762dfcbd58d2e58 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843909.073557:0:23471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd13fbeb800 already unused, calling callback (ffffffffc0cb1420) 00010000:00010000:1.0:1788843909.073563:0:23471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004ec913a5/0xa762dfcbd58d2e58 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843909.073574:0:23471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004ec913a5/0xa762dfcbd58d2e58 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843909.073600:0:23471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004ec913a5/0xa762dfcbd58d2e58 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843909.073608:0:23471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004ec913a5/0xa762dfcbd58d2e58 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843909.073636:0:23471:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788843909.073639:0:23471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000be6f09ac/0xa762dfcbd58d2e5f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843909.073645:0:23471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd13fbea600 already unused, calling callback (ffffffffc0cb1420) 00010000:00010000:1.0:1788843909.073648:0:23471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000be6f09ac/0xa762dfcbd58d2e5f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843909.073669:0:23471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000be6f09ac/0xa762dfcbd58d2e5f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843909.073681:0:23471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000be6f09ac/0xa762dfcbd58d2e5f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843909.073688:0:23471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000be6f09ac/0xa762dfcbd58d2e5f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843909.073704:0:23471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843909.073706:0:23471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843909.073707:0:23471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843909.074915:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788843909.077856:0:25039:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901889 is committed 00000001:00100000:2.0:1788843909.077893:0:25039:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:2.0:1788843909.077897:0:25039:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1788843909.078484:0:24686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd00723fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:23457:x1875738134584576:12345-0@lo:5:osp-pre-1-1.0 Request processed in 27729us (27783us total) trans 12884901889 rc 0/0 00000100:00100000:3.0:1788843909.078497:0:24686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788843909.078584:0:23457:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 12884901889 gen 2 00000100:00100000:2.0:1788843909.078593:0:23457:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd00723ed80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23457:1875738134584576:0@lo:5:osp-pre-1-1.0 00000004:00080000:2.0:1788843909.078609:0:23457:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x41:0x0]-[0x2c0000400:0x61:0x0] 00000100:00100000:2.0:1788843909.078664:0:23457:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd1203d0380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:23457:1875738134584704:0@lo:900:osp-pre-1-1.0 00000100:00100000:2.0:1788843909.078715:0:23457:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843909.078743:0:23457:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd007b9d6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788843909.078987:0:22722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134584704 00000100:00100000:3.0:1788843909.078995:0:22722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134584704 00000100:00100000:3.0:1788843909.079036:0:22722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788843909.079044:0:22722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1203d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23457:x1875738134584704:12345-0@lo:900:osp-pre-1-1.0 00000100:00100000:3.0:1788843909.079357:0:22722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1203d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23457:x1875738134584704:12345-0@lo:900:osp-pre-1-1.0 Request processed in 311us (651us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843909.079364:0:22722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1788843909.079400:0:23457:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd1203d0380 x1875738134584704/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788843925 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788843909.079412:0:23457:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd1203d0380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:23457:1875738134584704:0@lo:900:osp-pre-1-1.0 00002000:00010000:0.0:1788843909.081841:0:24225:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788843909.081855:0:24225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001794e17a/0xa762dfcbd58d2e66 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843909.081889:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x36:0x0].0x0 since=687s v=(0 0) 00010000:00010000:0.0:1788843909.081894:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788843909.081901:0:24225:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001794e17a/0xa762dfcbd58d2e66 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843909.081916:0:24225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001794e17a/0xa762dfcbd58d2e66 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843909.081927:0:24225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001794e17a/0xa762dfcbd58d2e66 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843909.081935:0:24225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001794e17a/0xa762dfcbd58d2e66 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843909.081962:0:24225:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788843909.081994:0:22699:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788843909.082004:0:22699:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001794e17a/0xa762dfcbd58d2e66 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843909.082016:0:22699:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd10f7afe00 already unused, calling callback (ffffffffc0cb1420) 00010000:00010000:2.0:1788843909.082022:0:22699:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001794e17a/0xa762dfcbd58d2e66 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843909.082035:0:22699:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001794e17a/0xa762dfcbd58d2e66 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843909.082058:0:22699:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001794e17a/0xa762dfcbd58d2e66 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788843909.082506:0:24225:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788843909.082513:0:24225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000061736d92/0xa762dfcbd58d2e6d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843909.082522:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x35:0x0].0x0 since=687s v=(0 0) 00010000:00010000:0.0:1788843909.082526:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788843909.082531:0:24225:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000061736d92/0xa762dfcbd58d2e6d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843909.082541:0:24225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000061736d92/0xa762dfcbd58d2e6d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843909.082559:0:22699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001794e17a/0xa762dfcbd58d2e66 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843909.082561:0:24225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000061736d92/0xa762dfcbd58d2e6d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843909.082570:0:24225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000061736d92/0xa762dfcbd58d2e6d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843909.082597:0:24225:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788843909.082600:0:22699:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788843909.082606:0:22699:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000061736d92/0xa762dfcbd58d2e6d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843909.082607:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788843909.082616:0:22699:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd10f7af400 already unused, calling callback (ffffffffc0cb1420) 00010000:00010000:2.0:1788843909.082620:0:22699:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000061736d92/0xa762dfcbd58d2e6d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843909.082628:0:22699:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000061736d92/0xa762dfcbd58d2e6d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843909.082642:0:22699:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000061736d92/0xa762dfcbd58d2e6d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843909.082824:0:22699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000061736d92/0xa762dfcbd58d2e6d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843909.082841:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788843909.082843:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788843909.082845:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788843909.082893:0:24225:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788843909.082899:0:24225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c326052e/0xa762dfcbd58d2e74 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843909.082908:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x34:0x0].0x0 since=687s v=(0 0) 00010000:00010000:0.0:1788843909.082911:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788843909.082915:0:24225:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c326052e/0xa762dfcbd58d2e74 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843909.082924:0:24225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c326052e/0xa762dfcbd58d2e74 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843909.082933:0:24225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c326052e/0xa762dfcbd58d2e74 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843909.082941:0:24225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c326052e/0xa762dfcbd58d2e74 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843909.082972:0:24225:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788843909.083167:0:23471:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788843909.083173:0:23471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c326052e/0xa762dfcbd58d2e74 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843909.083181:0:23471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd10f7aee00 already unused, calling callback (ffffffffc0cb1420) 00010000:00010000:2.0:1788843909.083190:0:23471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c326052e/0xa762dfcbd58d2e74 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843909.083198:0:23471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c326052e/0xa762dfcbd58d2e74 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843909.083209:0:23471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c326052e/0xa762dfcbd58d2e74 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843909.083216:0:23471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c326052e/0xa762dfcbd58d2e74 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843909.083228:0:23471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788843909.083230:0:23471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788843909.083232:0:23471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788843909.083565:0:24225:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788843909.083572:0:24225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aeda8cb3/0xa762dfcbd58d2e7b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843909.083582:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x33:0x0].0x0 since=687s v=(0 0) 00010000:00010000:0.0:1788843909.083586:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788843909.083591:0:24225:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000aeda8cb3/0xa762dfcbd58d2e7b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843909.083601:0:24225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000aeda8cb3/0xa762dfcbd58d2e7b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843909.083610:0:24225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aeda8cb3/0xa762dfcbd58d2e7b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843909.083618:0:24225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000aeda8cb3/0xa762dfcbd58d2e7b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843909.083638:0:24225:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788843909.083778:0:22700:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788843909.083784:0:22700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000aeda8cb3/0xa762dfcbd58d2e7b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843909.083793:0:22700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd10f7ae200 already unused, calling callback (ffffffffc0cb1420) 00010000:00010000:2.0:1788843909.083796:0:22700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000aeda8cb3/0xa762dfcbd58d2e7b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843909.083804:0:22700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000aeda8cb3/0xa762dfcbd58d2e7b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843909.083816:0:22700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000aeda8cb3/0xa762dfcbd58d2e7b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843909.083830:0:22700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000aeda8cb3/0xa762dfcbd58d2e7b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843909.083845:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788843909.083847:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788843909.083849:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788843909.084543:0:24225:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788843909.084553:0:24225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e9414993/0xa762dfcbd58d2e82 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843909.084566:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x32:0x0].0x0 since=687s v=(0 0) 00010000:00010000:0.0:1788843909.084576:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788843909.084582:0:24225:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e9414993/0xa762dfcbd58d2e82 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843909.084594:0:24225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e9414993/0xa762dfcbd58d2e82 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843909.084604:0:24225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e9414993/0xa762dfcbd58d2e82 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843909.084611:0:24225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e9414993/0xa762dfcbd58d2e82 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843909.084631:0:24225:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788843909.084824:0:22699:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788843909.084831:0:22699:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e9414993/0xa762dfcbd58d2e82 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843909.084839:0:22699:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd10f7af000 already unused, calling callback (ffffffffc0cb1420) 00010000:00010000:2.0:1788843909.084842:0:22699:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e9414993/0xa762dfcbd58d2e82 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843909.084850:0:22699:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e9414993/0xa762dfcbd58d2e82 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843909.084865:0:22699:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e9414993/0xa762dfcbd58d2e82 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843909.084872:0:22699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e9414993/0xa762dfcbd58d2e82 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843909.084889:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788843909.084891:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788843909.084893:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788843909.085117:0:24225:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788843909.085123:0:24225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002abb15b7/0xa762dfcbd58d2e89 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843909.085131:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x31:0x0].0x0 since=687s v=(0 0) 00010000:00010000:0.0:1788843909.085134:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788843909.085161:0:24225:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002abb15b7/0xa762dfcbd58d2e89 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843909.085173:0:24225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002abb15b7/0xa762dfcbd58d2e89 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843909.085182:0:24225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002abb15b7/0xa762dfcbd58d2e89 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843909.085197:0:24225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002abb15b7/0xa762dfcbd58d2e89 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843909.085217:0:24225:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788843909.085333:0:23471:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788843909.085339:0:23471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002abb15b7/0xa762dfcbd58d2e89 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843909.085347:0:23471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd10f7ae400 already unused, calling callback (ffffffffc0cb1420) 00010000:00010000:2.0:1788843909.085350:0:23471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002abb15b7/0xa762dfcbd58d2e89 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843909.085358:0:23471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002abb15b7/0xa762dfcbd58d2e89 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788843909.085503:0:24225:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788843909.085509:0:24225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009e5d1031/0xa762dfcbd58d2e90 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843909.085519:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x30:0x0].0x0 since=687s v=(0 0) 00010000:00010000:0.0:1788843909.085522:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788843909.085526:0:24225:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009e5d1031/0xa762dfcbd58d2e90 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843909.085535:0:24225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009e5d1031/0xa762dfcbd58d2e90 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843909.085543:0:24225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009e5d1031/0xa762dfcbd58d2e90 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843909.085551:0:24225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009e5d1031/0xa762dfcbd58d2e90 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843909.085561:0:23471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002abb15b7/0xa762dfcbd58d2e89 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843909.085569:0:24225:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788843909.085572:0:23471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002abb15b7/0xa762dfcbd58d2e89 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843909.085578:0:22700:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788843909.085584:0:22700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009e5d1031/0xa762dfcbd58d2e90 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843909.085592:0:23471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788843909.085595:0:23471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788843909.085598:0:23471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843909.085602:0:22700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd10f7aea00 already unused, calling callback (ffffffffc0cb1420) 00010000:00010000:0.0:1788843909.085607:0:22700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009e5d1031/0xa762dfcbd58d2e90 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843909.085616:0:22700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009e5d1031/0xa762dfcbd58d2e90 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843909.085628:0:22700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009e5d1031/0xa762dfcbd58d2e90 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843909.085635:0:22700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009e5d1031/0xa762dfcbd58d2e90 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843909.085648:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843909.085650:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843909.085652:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788843909.086457:0:24225:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788843909.086468:0:24225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006629ff7a/0xa762dfcbd58d2e97 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843909.086482:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f:0x0].0x0 since=687s v=(0 0) 00010000:00010000:0.0:1788843909.086486:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788843909.086491:0:24225:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006629ff7a/0xa762dfcbd58d2e97 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843909.086503:0:24225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006629ff7a/0xa762dfcbd58d2e97 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843909.086519:0:24225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006629ff7a/0xa762dfcbd58d2e97 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843909.086527:0:24225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006629ff7a/0xa762dfcbd58d2e97 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843909.086549:0:24225:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788843909.086572:0:22699:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788843909.086580:0:22699:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006629ff7a/0xa762dfcbd58d2e97 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843909.086589:0:22699:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd10f7af200 already unused, calling callback (ffffffffc0cb1420) 00010000:00010000:2.0:1788843909.086593:0:22699:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006629ff7a/0xa762dfcbd58d2e97 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843909.086615:0:22699:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006629ff7a/0xa762dfcbd58d2e97 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843909.086629:0:22699:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006629ff7a/0xa762dfcbd58d2e97 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843909.086637:0:22699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006629ff7a/0xa762dfcbd58d2e97 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788843909.086826:0:24225:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788843909.086832:0:24225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005cdfebb5/0xa762dfcbd58d2e9e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843909.086840:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e:0x0].0x0 since=687s v=(0 0) 00010000:00010000:0.0:1788843909.086843:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788843909.086846:0:24225:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005cdfebb5/0xa762dfcbd58d2e9e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843909.086855:0:24225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005cdfebb5/0xa762dfcbd58d2e9e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843909.086863:0:24225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005cdfebb5/0xa762dfcbd58d2e9e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843909.086871:0:24225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005cdfebb5/0xa762dfcbd58d2e9e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843909.086903:0:24225:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788843909.086912:0:23471:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788843909.086916:0:23471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005cdfebb5/0xa762dfcbd58d2e9e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843909.086922:0:23471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd10f7af600 already unused, calling callback (ffffffffc0cb1420) 00010000:00010000:0.0:1788843909.086925:0:23471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005cdfebb5/0xa762dfcbd58d2e9e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843909.086934:0:23471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005cdfebb5/0xa762dfcbd58d2e9e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843909.087012:0:23471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005cdfebb5/0xa762dfcbd58d2e9e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843909.087019:0:23471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005cdfebb5/0xa762dfcbd58d2e9e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843909.087329:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788843909.087332:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788843909.087334:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843909.087540:0:23471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843909.087543:0:23471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843909.087545:0:23471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788843909.088389:0:24225:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788843909.088399:0:24225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000092bcb600/0xa762dfcbd58d2ea5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843909.088415:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d:0x0].0x0 since=687s v=(0 0) 00010000:00010000:0.0:1788843909.088428:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788843909.088435:0:24225:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000092bcb600/0xa762dfcbd58d2ea5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843909.088448:0:24225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000092bcb600/0xa762dfcbd58d2ea5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843909.088458:0:24225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000092bcb600/0xa762dfcbd58d2ea5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843909.088465:0:24225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000092bcb600/0xa762dfcbd58d2ea5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843909.088484:0:24225:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788843909.088871:0:24225:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788843909.088878:0:24225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ac962e58/0xa762dfcbd58d2eac lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843909.088887:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c:0x0].0x0 since=687s v=(0 0) 00010000:00010000:0.0:1788843909.088890:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788843909.088895:0:24225:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ac962e58/0xa762dfcbd58d2eac lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843909.088906:0:24225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ac962e58/0xa762dfcbd58d2eac lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843909.088914:0:24225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ac962e58/0xa762dfcbd58d2eac lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843909.088928:0:24225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ac962e58/0xa762dfcbd58d2eac lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843909.088972:0:22700:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788843909.088977:0:24225:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788843909.088981:0:22700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000092bcb600/0xa762dfcbd58d2ea5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843909.088993:0:22700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd118f71000 already unused, calling callback (ffffffffc0cb1420) 00010000:00010000:2.0:1788843909.088999:0:22700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000092bcb600/0xa762dfcbd58d2ea5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843909.089010:0:22700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000092bcb600/0xa762dfcbd58d2ea5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843909.089032:0:22700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000092bcb600/0xa762dfcbd58d2ea5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843909.089054:0:22700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000092bcb600/0xa762dfcbd58d2ea5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843909.089596:0:22700:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788843909.089604:0:22700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ac962e58/0xa762dfcbd58d2eac lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843909.089613:0:22700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd118f70600 already unused, calling callback (ffffffffc0cb1420) 00010000:00010000:2.0:1788843909.089616:0:22700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ac962e58/0xa762dfcbd58d2eac lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843909.089625:0:22700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ac962e58/0xa762dfcbd58d2eac lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788843909.089635:0:24225:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788843909.089637:0:22700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ac962e58/0xa762dfcbd58d2eac lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843909.089643:0:24225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000054283b65/0xa762dfcbd58d2eb3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843909.089655:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b:0x0].0x0 since=687s v=(0 0) 00010000:00010000:0.0:1788843909.089659:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788843909.089664:0:24225:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000054283b65/0xa762dfcbd58d2eb3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843909.089674:0:24225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000054283b65/0xa762dfcbd58d2eb3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843909.089681:0:24225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000054283b65/0xa762dfcbd58d2eb3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843909.089687:0:24225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000054283b65/0xa762dfcbd58d2eb3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843909.089711:0:24225:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788843909.090056:0:24225:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788843909.090063:0:24225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d4d90106/0xa762dfcbd58d2eba lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843909.090235:0:22700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ac962e58/0xa762dfcbd58d2eac lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843909.090258:0:22700:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788843909.090262:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a:0x0].0x0 since=687s v=(0 0) 00010000:00010000:2.0:1788843909.090264:0:22700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000054283b65/0xa762dfcbd58d2eb3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843909.090268:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788843909.090277:0:24225:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d4d90106/0xa762dfcbd58d2eba lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843909.090278:0:22700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd118f70000 already unused, calling callback (ffffffffc0cb1420) 00010000:00010000:0.0:1788843909.090293:0:24225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d4d90106/0xa762dfcbd58d2eba lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843909.090294:0:22700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000054283b65/0xa762dfcbd58d2eb3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843909.090309:0:24225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d4d90106/0xa762dfcbd58d2eba lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843909.090321:0:24225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d4d90106/0xa762dfcbd58d2eba lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843909.090325:0:22700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000054283b65/0xa762dfcbd58d2eb3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843909.090334:0:24225:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788843909.090343:0:22700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000054283b65/0xa762dfcbd58d2eb3 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843909.090352:0:22700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000054283b65/0xa762dfcbd58d2eb3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788843909.090689:0:24225:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788843909.090695:0:24225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004705980c/0xa762dfcbd58d2ec1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843909.090704:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x29:0x0].0x0 since=687s v=(0 0) 00010000:00010000:0.0:1788843909.090707:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788843909.090711:0:24225:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004705980c/0xa762dfcbd58d2ec1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843909.090720:0:24225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004705980c/0xa762dfcbd58d2ec1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843909.090739:0:24225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004705980c/0xa762dfcbd58d2ec1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843909.090746:0:24225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004705980c/0xa762dfcbd58d2ec1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843909.090811:0:24225:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788843909.091015:0:23471:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788843909.091023:0:23471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d4d90106/0xa762dfcbd58d2eba lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843909.091044:0:23471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd00873b800 already unused, calling callback (ffffffffc0cb1420) 00010000:00010000:3.0:1788843909.091048:0:23471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d4d90106/0xa762dfcbd58d2eba lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843909.091057:0:23471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d4d90106/0xa762dfcbd58d2eba lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788843909.091060:0:24225:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788843909.091071:0:23471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d4d90106/0xa762dfcbd58d2eba lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843909.091079:0:23471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d4d90106/0xa762dfcbd58d2eba lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843909.091107:0:23471:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788843909.091110:0:23471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004705980c/0xa762dfcbd58d2ec1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843909.091117:0:23471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd00873ae00 already unused, calling callback (ffffffffc0cb1420) 00010000:00010000:3.0:1788843909.091120:0:23471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004705980c/0xa762dfcbd58d2ec1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843909.091128:0:23471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004705980c/0xa762dfcbd58d2ec1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843909.091137:0:23471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004705980c/0xa762dfcbd58d2ec1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843909.091179:0:23471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004705980c/0xa762dfcbd58d2ec1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843909.091193:0:23471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788843909.091195:0:23471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788843909.091197:0:23471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843909.091321:0:24225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008636324f/0xa762dfcbd58d2ec8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843909.091333:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x28:0x0].0x0 since=687s v=(0 0) 00010000:00010000:0.0:1788843909.091336:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788843909.091342:0:24225:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008636324f/0xa762dfcbd58d2ec8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843909.091353:0:24225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008636324f/0xa762dfcbd58d2ec8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843909.091362:0:24225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008636324f/0xa762dfcbd58d2ec8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843909.091369:0:24225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008636324f/0xa762dfcbd58d2ec8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843909.091403:0:24225:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788843909.091661:0:24225:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788843909.091667:0:24225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d72bd7f3/0xa762dfcbd58d2ecf lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843909.091676:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x27:0x0].0x0 since=687s v=(0 0) 00010000:00010000:0.0:1788843909.091680:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788843909.091684:0:24225:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d72bd7f3/0xa762dfcbd58d2ecf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843909.091695:0:24225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d72bd7f3/0xa762dfcbd58d2ecf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843909.091703:0:24225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d72bd7f3/0xa762dfcbd58d2ecf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843909.091711:0:24225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d72bd7f3/0xa762dfcbd58d2ecf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843909.091722:0:24225:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788843909.091727:0:22700:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788843909.091734:0:22700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008636324f/0xa762dfcbd58d2ec8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843909.091744:0:22700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd00873b400 already unused, calling callback (ffffffffc0cb1420) 00010000:00010000:2.0:1788843909.091749:0:22700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008636324f/0xa762dfcbd58d2ec8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843909.091758:0:22700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008636324f/0xa762dfcbd58d2ec8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843909.091773:0:22700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008636324f/0xa762dfcbd58d2ec8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843909.091781:0:22700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008636324f/0xa762dfcbd58d2ec8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843909.091807:0:22700:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788843909.091811:0:22700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d72bd7f3/0xa762dfcbd58d2ecf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843909.091819:0:22700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd00873b600 already unused, calling callback (ffffffffc0cb1420) 00010000:00010000:2.0:1788843909.091822:0:22700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d72bd7f3/0xa762dfcbd58d2ecf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843909.091830:0:22700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d72bd7f3/0xa762dfcbd58d2ecf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843909.091842:0:22700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d72bd7f3/0xa762dfcbd58d2ecf lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843909.091851:0:22700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d72bd7f3/0xa762dfcbd58d2ecf lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843909.091872:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788843909.091874:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788843909.091876:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788843909.091888:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788843909.091979:0:24225:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788843909.091985:0:24225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001f0b1992/0xa762dfcbd58d2ed6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843909.091994:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x26:0x0].0x0 since=687s v=(0 0) 00010000:00010000:0.0:1788843909.092001:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788843909.092006:0:24225:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001f0b1992/0xa762dfcbd58d2ed6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843909.092016:0:24225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001f0b1992/0xa762dfcbd58d2ed6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843909.092025:0:24225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001f0b1992/0xa762dfcbd58d2ed6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843909.092032:0:24225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001f0b1992/0xa762dfcbd58d2ed6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843909.092053:0:24225:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788843909.092266:0:22700:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788843909.092271:0:22700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001f0b1992/0xa762dfcbd58d2ed6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843909.092280:0:22700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd00873be00 already unused, calling callback (ffffffffc0cb1420) 00010000:00010000:2.0:1788843909.092290:0:22700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001f0b1992/0xa762dfcbd58d2ed6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843909.092299:0:22700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001f0b1992/0xa762dfcbd58d2ed6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843909.092311:0:22700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001f0b1992/0xa762dfcbd58d2ed6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843909.092318:0:22700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001f0b1992/0xa762dfcbd58d2ed6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843909.092331:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788843909.092333:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788843909.092335:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788843909.092451:0:24225:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788843909.092457:0:24225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b1229ace/0xa762dfcbd58d2edd lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843909.092466:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x25:0x0].0x0 since=687s v=(0 0) 00010000:00010000:0.0:1788843909.092469:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788843909.092474:0:24225:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b1229ace/0xa762dfcbd58d2edd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843909.092484:0:24225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b1229ace/0xa762dfcbd58d2edd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843909.092491:0:24225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b1229ace/0xa762dfcbd58d2edd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843909.092505:0:24225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b1229ace/0xa762dfcbd58d2edd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843909.092523:0:24225:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788843909.092728:0:24225:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788843909.092734:0:24225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000092c2699b/0xa762dfcbd58d2ee4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843909.092743:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x24:0x0].0x0 since=687s v=(0 0) 00010000:00010000:0.0:1788843909.092746:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788843909.092796:0:22699:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788843909.092801:0:24225:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000092c2699b/0xa762dfcbd58d2ee4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843909.092804:0:22699:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b1229ace/0xa762dfcbd58d2edd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843909.092819:0:22699:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd00873a000 already unused, calling callback (ffffffffc0cb1420) 00010000:00010000:0.0:1788843909.092819:0:24225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000092c2699b/0xa762dfcbd58d2ee4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843909.092825:0:22699:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b1229ace/0xa762dfcbd58d2edd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843909.092835:0:24225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000092c2699b/0xa762dfcbd58d2ee4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843909.092840:0:22699:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b1229ace/0xa762dfcbd58d2edd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843909.092846:0:24225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000092c2699b/0xa762dfcbd58d2ee4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843909.092862:0:22699:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b1229ace/0xa762dfcbd58d2edd lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843909.092870:0:24225:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788843909.092881:0:22700:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788843909.092883:0:22699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b1229ace/0xa762dfcbd58d2edd lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843909.092886:0:22700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000092c2699b/0xa762dfcbd58d2ee4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843909.092902:0:22700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd00873ba00 already unused, calling callback (ffffffffc0cb1420) 00010000:00010000:0.0:1788843909.092906:0:22700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000092c2699b/0xa762dfcbd58d2ee4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843909.092914:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843909.092916:0:22700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000092c2699b/0xa762dfcbd58d2ee4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843909.092918:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788843909.092921:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843909.092932:0:22700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000092c2699b/0xa762dfcbd58d2ee4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843909.092941:0:22700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000092c2699b/0xa762dfcbd58d2ee4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843909.092953:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843909.092954:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843909.092956:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788843909.093334:0:24225:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788843909.093341:0:24225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000056e1478f/0xa762dfcbd58d2eeb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843909.093351:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x23:0x0].0x0 since=687s v=(0 0) 00010000:00010000:0.0:1788843909.093354:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788843909.093359:0:24225:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000056e1478f/0xa762dfcbd58d2eeb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843909.093370:0:24225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000056e1478f/0xa762dfcbd58d2eeb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843909.093384:0:24225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000056e1478f/0xa762dfcbd58d2eeb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843909.093392:0:24225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000056e1478f/0xa762dfcbd58d2eeb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843909.093408:0:24225:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788843909.093597:0:22699:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788843909.093604:0:22699:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000056e1478f/0xa762dfcbd58d2eeb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843909.093613:0:22699:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd00873a600 already unused, calling callback (ffffffffc0cb1420) 00010000:00010000:2.0:1788843909.093617:0:22699:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000056e1478f/0xa762dfcbd58d2eeb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788843909.093626:0:24225:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788843909.093628:0:22699:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000056e1478f/0xa762dfcbd58d2eeb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843909.093634:0:24225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006c12b6d7/0xa762dfcbd58d2ef2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843909.093646:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=687s v=(0 0) 00010000:00010000:0.0:1788843909.093649:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788843909.093653:0:24225:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006c12b6d7/0xa762dfcbd58d2ef2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843909.093655:0:22699:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000056e1478f/0xa762dfcbd58d2eeb lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843909.093669:0:24225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006c12b6d7/0xa762dfcbd58d2ef2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843909.093671:0:22699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000056e1478f/0xa762dfcbd58d2eeb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843909.093687:0:24225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006c12b6d7/0xa762dfcbd58d2ef2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843909.093696:0:24225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006c12b6d7/0xa762dfcbd58d2ef2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843909.093709:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788843909.093713:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788843909.093716:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843909.093724:0:24225:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788843909.093734:0:22700:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788843909.093739:0:22700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006c12b6d7/0xa762dfcbd58d2ef2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843909.093746:0:22700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd00873a400 already unused, calling callback (ffffffffc0cb1420) 00010000:00010000:0.0:1788843909.093802:0:22700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006c12b6d7/0xa762dfcbd58d2ef2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843909.093812:0:22700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006c12b6d7/0xa762dfcbd58d2ef2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843909.093824:0:22700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006c12b6d7/0xa762dfcbd58d2ef2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843909.093832:0:22700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006c12b6d7/0xa762dfcbd58d2ef2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843909.093844:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843909.093846:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843909.093847:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:0.0:1788843909.094316:0:24225:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:6 00000100:00100000:0.0:1788843909.094424:0:24225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f985f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:22739:x1875738134584064:12345-0@lo:5:osp-pre-1-0.0 Request processed in 73133us (73380us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843909.094435:0:24225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788843909.094636:0:22739:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f986300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22739:1875738134584064:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1788843909.094668:0:22739:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x41:0x0] from OST, last_created [0x2c0000401:0x41:0x0]last_used is [0x2c0000401:0x6:0x0] 00000100:00100000:2.0:1788843909.094734:0:22739:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd1203d1f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22739:1875738134584832:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1788843909.094780:0:22739:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843909.094816:0:22739:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd007b9d6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788843909.094839:0:24222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134584832 00000100:00100000:0.0:1788843909.094848:0:24222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134584832 00000100:00100000:0.0:1788843909.094895:0:24222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788843909.094904:0:24222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1203d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:22739:x1875738134584832:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:0.0:1788843909.094939:0:24222:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 66 00010000:00010000:3.0:1788843909.095528:0:23471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788843909.097464:0:24222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1203d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:22739:x1875738134584832:12345-0@lo:5:osp-pre-1-0.0 Request processed in 2552us (2675us total) trans 12884901890 rc 0/0 00000100:00100000:0.0:1788843909.097478:0:24222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788843909.097850:0:22739:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd1203d1f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22739:1875738134584832:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1788843909.097870:0:22739:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x41:0x0]-[0x2c0000401:0x61:0x0] 00000040:00080000:0.0:1788843909.280845:0:22748:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788843909.722458:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788843910.363644:0:25395:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg333-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1788843910.748210:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788843911.274925:0:25447:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788843911.275499:0:25447:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1788843911.587683:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f985880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1875738134584960:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788843911.587786:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843911.587852:0:24226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134584960 00000100:00100000:3.0:1788843911.587861:0:24226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134584960 00000100:00100000:3.0:1788843911.587924:0:24226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788843911.587936:0:24226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f984000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3633:x1875738134584960:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788843911.587969:0:24226:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915857920 avail 3684335616 00000100:00100000:3.0:1788843911.588018:0:24226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f984000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3633:x1875738134584960:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (233us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843911.588025:0:24226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:3.0:1788843911.588048:0:22707:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788843911.588099:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f985880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1875738134584960:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788843911.599867:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd1203d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1875738134585088:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788843911.599961:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843911.600026:0:24226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134585088 00000100:00100000:2.0:1788843911.600035:0:24226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134585088 00000100:00100000:2.0:1788843911.600111:0:24226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788843911.600121:0:24226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1203d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3630:x1875738134585088:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788843911.600182:0:24226:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915857920 avail 3684335616 00000100:00100000:2.0:1788843911.600229:0:24226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1203d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3630:x1875738134585088:12345-0@lo:13:osp-pre-0-1.0 Request processed in 108us (267us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843911.600237:0:24226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:2.0:1788843911.600260:0:22707:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788843911.600314:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd1203d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1875738134585088:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1788843911.771078:0:23471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788843912.548576:0:25497:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788843912.549965:0:25497:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1788843912.602508:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd1203d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1875738134585216:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788843912.602585:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843912.604493:0:22717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134585216 00000100:00100000:3.0:1788843912.604507:0:22717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134585216 00000100:00100000:3.0:1788843912.604571:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788843912.604581:0:22717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd008621180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3631:x1875738134585216:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788843912.604622:0:22717:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788843912.604698:0:22717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd008621180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3631:x1875738134585216:12345-0@lo:41:osp-pre-1-0.0 Request processed in 119us (2113us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843912.604706:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788843912.605508:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd1203d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1875738134585216:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788843912.610857:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd00723ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1875738134585344:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788843912.610934:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843912.611085:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134585344 00000100:00100000:2.0:1788843912.611095:0:22716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134585344 00000100:00100000:2.0:1788843912.611165:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788843912.611176:0:22716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd00723d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3632:x1875738134585344:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788843912.611211:0:22716:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1788843912.611269:0:22716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd00723d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3632:x1875738134585344:12345-0@lo:41:osp-pre-0-1.0 Request processed in 95us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843912.611276:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788843912.611474:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd00723ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1875738134585344:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1788843912.796168:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788843912.953913:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843912.954594:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116637696 00000100:00100000:2.0:1788843912.954606:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116637696 00000100:00100000:2.0:1788843912.954701:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 114 00000100:00100000:2.0:1788843912.954710:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd00702c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2386:x1875738116637696:12345-192.168.203.33@tcp:250:mount.lustre.0 00010000:00080000:2.0:1788843912.954751:0:22705:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from efb31ab2-ab0a-4b00-9471-3fc304e37c6a@192.168.203.33@tcp t0 exp 0000000000000000 cur 691 last 0 00000020:00000080:2.0:1788843912.954787:0:22705:0:(genops.c:1385:class_connect()) connect: client efb31ab2-ab0a-4b00-9471-3fc304e37c6a, cookie 0xa762dfcbd58d2ef9 00000100:00080000:2.0:1788843912.954929:0:22705:0:(import.c:65:import_set_state_nolock()) ffff9bd00178c800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788843912.955014:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd00702c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efb31ab2-ab0a-4b00-9471-3fc304e37c6a+5:2386:x1875738116637696:12345-192.168.203.33@tcp:250:mount.lustre.0 Request processed in 304us (1111us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843912.955023:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 114 00000100:00100000:1.0:1788843912.965982:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843912.966964:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116637824 00000100:00100000:2.0:1788843912.966975:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116637824 00000100:00100000:2.0:1788843912.967046:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 115 00000100:00100000:2.0:1788843912.967067:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd102883c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efb31ab2-ab0a-4b00-9471-3fc304e37c6a+5:18061:x1875738116637824:12345-192.168.203.33@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788843912.967087:0:22706:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788843912.967106:0:22706:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd1153e6200/0xa762dfcbd58d2f00 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xaf24d95f22490e52 expref: -99 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843912.967136:0:22706:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd1153e6200/0xa762dfcbd58d2f00 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490e52 expref: 6 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843912.967180:0:22706:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd1153e6200/0xa762dfcbd58d2f00 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490e52 expref: 6 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843912.967190:0:22706:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd1153e6200, rc 0) 00000100:00100000:2.0:1788843912.967260:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd102883c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efb31ab2-ab0a-4b00-9471-3fc304e37c6a+6:18061:x1875738116637824:12345-192.168.203.33@tcp:101:mount.lustre.0 Request processed in 205us (1287us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843912.967268:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 115 00000100:00100000:0.0:1788843912.974862:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1788843912.975027:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116637952 00000100:00100000:1.0:1788843912.975037:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116637952 00000100:00100000:1.0:1788843912.975107:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 116 00000100:00100000:1.0:1788843912.975119:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd102881450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efb31ab2-ab0a-4b00-9471-3fc304e37c6a+6:18061:x1875738116637952:12345-192.168.203.33@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788843912.975279:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd102881450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efb31ab2-ab0a-4b00-9471-3fc304e37c6a+6:18061:x1875738116637952:12345-192.168.203.33@tcp:501:mount.lustre.0 Request processed in 161us (426us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788843912.975287:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 116 00000100:00100000:1.0:1788843912.987025:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843912.987195:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116638080 00000100:00100000:3.0:1788843912.987206:0:22704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116638080 00000100:00100000:3.0:1788843912.987266:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 117 00000100:00100000:3.0:1788843912.987277:0:22704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd102883850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efb31ab2-ab0a-4b00-9471-3fc304e37c6a+6:18061:x1875738116638080:12345-192.168.203.33@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788843912.987296:0:22704:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788843912.987314:0:22704:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd007be2c00/0xa762dfcbd58d2f07 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xaf24d95f22490e59 expref: -99 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843912.987343:0:22704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd007be2c00/0xa762dfcbd58d2f07 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490e59 expref: 7 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843912.987356:0:22704:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd007be2c00/0xa762dfcbd58d2f07 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490e59 expref: 7 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843912.987366:0:22704:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd007be2c00, rc 0) 00000100:00100000:3.0:1788843912.987427:0:22704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd102883850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efb31ab2-ab0a-4b00-9471-3fc304e37c6a+7:18061:x1875738116638080:12345-192.168.203.33@tcp:101:mount.lustre.0 Request processed in 151us (411us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843912.987435:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 117 00000100:00100000:0.0:1788843912.990219:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843912.990337:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116638208 00000100:00100000:3.0:1788843912.990348:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116638208 00000100:00100000:3.0:1788843912.990398:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 118 00000100:00100000:3.0:1788843912.990408:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd102883050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efb31ab2-ab0a-4b00-9471-3fc304e37c6a+7:18061:x1875738116638208:12345-192.168.203.33@tcp:501:mount.lustre.0 00000100:00100000:3.0:1788843912.990712:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd102883050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efb31ab2-ab0a-4b00-9471-3fc304e37c6a+8:18061:x1875738116638208:12345-192.168.203.33@tcp:501:mount.lustre.0 Request processed in 304us (501us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843912.990720:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 118 00000100:00100000:0.0:1788843913.008540:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1788843913.008681:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116638336 00000100:00100000:1.0:1788843913.008692:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116638336 00000100:00100000:1.0:1788843913.008756:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 119 00000100:00100000:1.0:1788843913.008767:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd124fdb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efb31ab2-ab0a-4b00-9471-3fc304e37c6a+8:18061:x1875738116638336:12345-192.168.203.33@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788843913.008921:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd124fdb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efb31ab2-ab0a-4b00-9471-3fc304e37c6a+8:18061:x1875738116638336:12345-192.168.203.33@tcp:503:mount.lustre.0 Request processed in 155us (402us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843913.008930:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 119 00000100:00100000:1.0:1788843913.019442:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843913.019708:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116638464 00000100:00100000:3.0:1788843913.019719:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116638464 00000100:00100000:3.0:1788843913.019785:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 120 00000100:00100000:3.0:1788843913.019796:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd124fd8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efb31ab2-ab0a-4b00-9471-3fc304e37c6a+8:18079:x1875738116638464:12345-192.168.203.33@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788843913.019978:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd124fd8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efb31ab2-ab0a-4b00-9471-3fc304e37c6a+8:18079:x1875738116638464:12345-192.168.203.33@tcp:502:llog_process_th.0 Request processed in 182us (545us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843913.019986:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 120 00000100:00100000:0.0:1788843913.076045:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843913.076635:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116638592 00000100:00100000:3.0:1788843913.076647:0:22704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116638592 00000100:00100000:3.0:1788843913.076708:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 121 00000100:00100000:3.0:1788843913.076720:0:22704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd124fd9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efb31ab2-ab0a-4b00-9471-3fc304e37c6a+8:18079:x1875738116638592:12345-192.168.203.33@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788843913.076890:0:22704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd124fd9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efb31ab2-ab0a-4b00-9471-3fc304e37c6a+8:18079:x1875738116638592:12345-192.168.203.33@tcp:502:llog_process_th.0 Request processed in 172us (855us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843913.076899:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 121 00000100:00100000:0.0:1788843913.096295:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1788843913.096851:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116638720 00000100:00100000:1.0:1788843913.096862:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116638720 00000100:00100000:1.0:1788843913.096971:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 122 00000100:00100000:1.0:1788843913.096982:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd124fdb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efb31ab2-ab0a-4b00-9471-3fc304e37c6a+8:18079:x1875738116638720:12345-192.168.203.33@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788843913.097257:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd124fdb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efb31ab2-ab0a-4b00-9471-3fc304e37c6a+8:18079:x1875738116638720:12345-192.168.203.33@tcp:502:llog_process_th.0 Request processed in 275us (972us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843913.097266:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 122 00000100:00100000:2.0:1788843913.101680:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843913.101835:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116638848 00000100:00100000:3.0:1788843913.101846:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116638848 00000100:00100000:3.0:1788843913.101947:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 123 00000100:00100000:3.0:1788843913.101959:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd124fd9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efb31ab2-ab0a-4b00-9471-3fc304e37c6a+8:18061:x1875738116638848:12345-192.168.203.33@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788843913.101994:0:22706:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788843913.102014:0:22706:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd007be2e00/0xa762dfcbd58d2f0e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xaf24d95f22490e8a expref: -99 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843913.102045:0:22706:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd007be2e00/0xa762dfcbd58d2f0e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490e8a expref: 9 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843913.102070:0:22706:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd007be2e00/0xa762dfcbd58d2f0e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490e8a expref: 9 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843913.102080:0:22706:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd007be2e00, rc 0) 00000100:00100000:3.0:1788843913.102170:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd124fd9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efb31ab2-ab0a-4b00-9471-3fc304e37c6a+9:18061:x1875738116638848:12345-192.168.203.33@tcp:101:mount.lustre.0 Request processed in 185us (685us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843913.102178:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 123 00000100:00100000:0.0:1788843913.111430:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1788843913.111647:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116638976 00000100:00100000:1.0:1788843913.111658:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116638976 00000100:00100000:1.0:1788843913.111849:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 124 00000100:00100000:1.0:1788843913.111861:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd124fd8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efb31ab2-ab0a-4b00-9471-3fc304e37c6a+9:18061:x1875738116638976:12345-192.168.203.33@tcp:256:mount.lustre.0 20000000:01000000:1.0:1788843913.111889:0:22705:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1788843913.111913:0:22705:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1788843913.111916:0:22705:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1788843913.111919:0:22705:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1788843913.111922:0:22705:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:1.0:1788843913.111925:0:22705:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 14 00000100:00100000:1.0:1788843913.116314:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd124fd8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efb31ab2-ab0a-4b00-9471-3fc304e37c6a+9:18061:x1875738116638976:12345-192.168.203.33@tcp:256:mount.lustre.0 Request processed in 4444us (4884us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843913.116344:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 124 00000100:00100000:2.0:1788843913.121221:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843913.121313:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116639104 00000100:00100000:3.0:1788843913.121324:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116639104 00000100:00100000:3.0:1788843913.121385:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 125 00000100:00100000:3.0:1788843913.121397:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd124fd9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efb31ab2-ab0a-4b00-9471-3fc304e37c6a+9:18061:x1875738116639104:12345-192.168.203.33@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788843913.121415:0:22706:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788843913.121434:0:22706:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd007be3c00/0xa762dfcbd58d2f15 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xaf24d95f22490e91 expref: -99 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843913.121463:0:22706:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd007be3c00/0xa762dfcbd58d2f15 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490e91 expref: 10 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843913.121476:0:22706:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd007be3c00/0xa762dfcbd58d2f15 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490e91 expref: 10 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843913.121503:0:22706:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd007be3c00, rc 0) 00000100:00100000:3.0:1788843913.121568:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd124fd9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efb31ab2-ab0a-4b00-9471-3fc304e37c6a+10:18061:x1875738116639104:12345-192.168.203.33@tcp:101:mount.lustre.0 Request processed in 173us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843913.121575:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 125 00000100:00100000:0.0:1788843913.124621:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1788843913.124872:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116639232 00000100:00100000:1.0:1788843913.124883:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116639232 00000100:00100000:1.0:1788843913.124953:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 126 00000100:00100000:1.0:1788843913.124965:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd124fd8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efb31ab2-ab0a-4b00-9471-3fc304e37c6a+10:18061:x1875738116639232:12345-192.168.203.33@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788843913.125173:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd124fd8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efb31ab2-ab0a-4b00-9471-3fc304e37c6a+10:18061:x1875738116639232:12345-192.168.203.33@tcp:501:mount.lustre.0 Request processed in 177us (529us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843913.125182:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 126 00000100:00100000:0.0:1788843913.127980:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1788843913.128185:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116639360 00000100:00100000:1.0:1788843913.128195:0:22704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116639360 00000100:00100000:1.0:1788843913.128256:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 127 00000100:00100000:1.0:1788843913.128267:0:22704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd124fd8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efb31ab2-ab0a-4b00-9471-3fc304e37c6a+10:18061:x1875738116639360:12345-192.168.203.33@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788843913.128414:0:22704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd124fd8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efb31ab2-ab0a-4b00-9471-3fc304e37c6a+10:18061:x1875738116639360:12345-192.168.203.33@tcp:503:mount.lustre.0 Request processed in 147us (443us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843913.128422:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 127 00000100:00100000:2.0:1788843913.132769:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843913.133009:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116639488 00000100:00100000:3.0:1788843913.133020:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116639488 00000100:00100000:3.0:1788843913.133084:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 128 00000100:00100000:3.0:1788843913.133099:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0059e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efb31ab2-ab0a-4b00-9471-3fc304e37c6a+10:18082:x1875738116639488:12345-192.168.203.33@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788843913.133283:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0059e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efb31ab2-ab0a-4b00-9471-3fc304e37c6a+10:18082:x1875738116639488:12345-192.168.203.33@tcp:502:llog_process_th.0 Request processed in 185us (523us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843913.133292:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 128 00000100:00100000:0.0:1788843913.141306:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843913.141451:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116639616 00000100:00100000:2.0:1788843913.141462:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116639616 00000100:00100000:2.0:1788843913.141525:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 129 00000100:00100000:2.0:1788843913.141544:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0059e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efb31ab2-ab0a-4b00-9471-3fc304e37c6a+10:18082:x1875738116639616:12345-192.168.203.33@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788843913.142913:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0059e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efb31ab2-ab0a-4b00-9471-3fc304e37c6a+10:18082:x1875738116639616:12345-192.168.203.33@tcp:502:llog_process_th.0 Request processed in 1361us (1608us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843913.142937:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 129 00000100:00100000:0.0:1788843913.168285:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1788843913.168337:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1788843913.168602:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116639744 00000100:00100000:1.0:1788843913.168613:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116639744 00000100:00100000:1.0:1788843913.168666:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116640000 00000100:00100000:1.0:1788843913.168670:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116640000 00000100:00100000:1.0:1788843913.168687:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7 00000100:00100000:1.0:1788843913.168695:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd00723ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2386:x1875738116639744:12345-192.168.203.33@tcp:38:mount.lustre.0 00010000:00080000:1.0:1788843913.168734:0:22712:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from a6e673fb-9566-47bf-b86a-d710f4950716@192.168.203.33@tcp t0 exp 0000000000000000 cur 691 last 0 00000020:00000080:1.0:1788843913.168798:0:22712:0:(genops.c:1385:class_connect()) connect: client a6e673fb-9566-47bf-b86a-d710f4950716, cookie 0xa762dfcbd58d2f1c 00000004:00100000:1.0:1788843913.168837:0:22712:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1788843913.169044:0:22712:0:(import.c:65:import_set_state_nolock()) ffff9bd00657e000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788843913.169173:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd00723ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a6e673fb-9566-47bf-b86a-d710f4950716+6:2386:x1875738116639744:12345-192.168.203.33@tcp:38:mount.lustre.0 Request processed in 476us (898us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843913.169182:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7 00000100:00100000:1.0:1788843913.169202:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 8 00000100:00100000:1.0:1788843913.169207:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd00723f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2386:x1875738116640000:12345-192.168.203.33@tcp:38:mount.lustre.0 00010000:00080000:1.0:1788843913.169223:0:22712:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from a6e673fb-9566-47bf-b86a-d710f4950716@192.168.203.33@tcp t0 exp 0000000000000000 cur 691 last 0 00000020:00000080:1.0:1788843913.169251:0:22712:0:(genops.c:1385:class_connect()) connect: client a6e673fb-9566-47bf-b86a-d710f4950716, cookie 0xa762dfcbd58d2f23 00000004:00100000:1.0:1788843913.169264:0:22712:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:1.0:1788843913.169404:0:22712:0:(import.c:65:import_set_state_nolock()) ffff9bd00657f000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788843913.169429:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd00723f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a6e673fb-9566-47bf-b86a-d710f4950716+6:2386:x1875738116640000:12345-192.168.203.33@tcp:38:mount.lustre.0 Request processed in 221us (1092us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843913.169436:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 8 00000100:00100000:2.0:1788843913.174265:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1788843913.174371:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116640256 00000100:00100000:1.0:1788843913.174382:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116640256 00000100:00100000:1.0:1788843913.174500:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 9 00000100:00100000:1.0:1788843913.174511:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd008620000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a6e673fb-9566-47bf-b86a-d710f4950716+6:18061:x1875738116640256:12345-192.168.203.33@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788843913.174564:0:22712:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1788843913.174671:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd008620000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a6e673fb-9566-47bf-b86a-d710f4950716+6:18061:x1875738116640256:12345-192.168.203.33@tcp:41:mount.lustre.0 Request processed in 161us (414us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843913.174679:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 9 00000100:00080000:2.0:1788843913.181470:0:22707:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788843913.186925:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1788843913.186987:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843913.187244:0:22713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116640128 00000100:00100000:3.0:1788843913.187262:0:22713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116640128 00000100:00100000:3.0:1788843913.187396:0:22713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116639872 00000100:00100000:3.0:1788843913.187400:0:22713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116639872 00000100:00100000:3.0:1788843913.187423:0:22713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 10 00000100:00100000:3.0:1788843913.187433:0:22713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd00723c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a6e673fb-9566-47bf-b86a-d710f4950716+6:0:x1875738116640128:12345-192.168.203.33@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788843913.187474:0:22713:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788843913.187579:0:22713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd00723c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a6e673fb-9566-47bf-b86a-d710f4950716+6:0:x1875738116640128:12345-192.168.203.33@tcp:41:mount.lustre.0 Request processed in 147us (671us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843913.187588:0:22713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 10 00000100:00100000:1.0:1788843913.187610:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 11 00000100:00100000:1.0:1788843913.187626:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd00723c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a6e673fb-9566-47bf-b86a-d710f4950716+6:0:x1875738116639872:12345-192.168.203.33@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788843913.187643:0:22712:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1788843913.187678:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd00723c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a6e673fb-9566-47bf-b86a-d710f4950716+6:0:x1875738116639872:12345-192.168.203.33@tcp:41:mount.lustre.0 Request processed in 60us (690us total) trans 0 rc 0/0 00000100:00080000:0.0:1788843913.188078:0:22707:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788843913.192894:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 11 00000100:00100000:0.0:1788843913.192994:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843913.193091:0:22713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116640384 00000100:00100000:3.0:1788843913.193102:0:22713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116640384 00000100:00100000:3.0:1788843913.193811:0:22713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 12 00000100:00100000:3.0:1788843913.193826:0:22713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd00723f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a6e673fb-9566-47bf-b86a-d710f4950716+6:18061:x1875738116640384:12345-192.168.203.33@tcp:40:mount.lustre.0 00000100:00100000:3.0:1788843913.193942:0:22713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd00723f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a6e673fb-9566-47bf-b86a-d710f4950716+6:18061:x1875738116640384:12345-192.168.203.33@tcp:40:mount.lustre.0 Request processed in 120us (949us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843913.193951:0:22713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 12 00000100:00100000:2.0:1788843913.197786:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843913.197826:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843913.197862:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843913.197902:0:22722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116640768 00000100:00100000:2.0:1788843913.197914:0:22722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116640768 00000100:00100000:2.0:1788843913.197966:0:22722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 3 00000100:00100000:2.0:1788843913.197977:0:22722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd008620a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:a6e673fb-9566-47bf-b86a-d710f4950716+6:18061:x1875738116640768:12345-192.168.203.33@tcp:900:mount.lustre.0 00000100:00100000:2.0:1788843913.198074:0:22722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd008620a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:a6e673fb-9566-47bf-b86a-d710f4950716+6:18061:x1875738116640768:12345-192.168.203.33@tcp:900:mount.lustre.0 Request processed in 98us (209us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843913.198081:0:22722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 3 00000100:00100000:3.0:1788843913.198236:0:24686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116640512 00000100:00100000:3.0:1788843913.198242:0:24686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116640512 00000100:00100000:3.0:1788843913.198267:0:24686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116640640 00000100:00100000:3.0:1788843913.198270:0:24686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116640640 00000100:00100000:3.0:1788843913.198300:0:24686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 19 00000100:00100000:3.0:1788843913.198306:0:24686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd008621880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2386:x1875738116640512:12345-192.168.203.33@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788843913.198355:0:24686:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from a6e673fb-9566-47bf-b86a-d710f4950716@192.168.203.33@tcp t0 exp 0000000000000000 cur 691 last 0 00000020:00000080:3.0:1788843913.198387:0:24686:0:(genops.c:1385:class_connect()) connect: client a6e673fb-9566-47bf-b86a-d710f4950716, cookie 0xa762dfcbd58d2f2a 00002000:00100000:3.0:1788843913.198399:0:24686:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli a6e673fb-9566-47bf-b86a-d710f4950716/ffff9bd001795000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211396f ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788843913.198420:0:24686:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788843913.198593:0:24686:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00100000:1.0:1788843913.198608:0:24222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 20 00000100:00100000:1.0:1788843913.198616:0:24222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd008621500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2386:x1875738116640640:12345-192.168.203.33@tcp:8:mount.lustre.0 00000100:00080000:3.0:1788843913.198625:0:24686:0:(import.c:65:import_set_state_nolock()) ffff9bd001793800 : changing import state from RECOVER to FULL 00010000:00080000:1.0:1788843913.198637:0:24222:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from a6e673fb-9566-47bf-b86a-d710f4950716@192.168.203.33@tcp t0 exp 0000000000000000 cur 691 last 0 00000020:00000080:1.0:1788843913.198662:0:24222:0:(genops.c:1385:class_connect()) connect: client a6e673fb-9566-47bf-b86a-d710f4950716, cookie 0xa762dfcbd58d2f31 00000100:00100000:3.0:1788843913.198663:0:24686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd008621880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a6e673fb-9566-47bf-b86a-d710f4950716+6:2386:x1875738116640512:12345-192.168.203.33@tcp:8:mount.lustre.0 Request processed in 354us (886us total) trans 0 rc 0/0 00002000:00100000:1.0:1788843913.198671:0:24222:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli a6e673fb-9566-47bf-b86a-d710f4950716/ffff9bd10f7be800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211396f ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00000100:00100000:3.0:1788843913.198675:0:24686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 19 00002000:00100000:1.0:1788843913.198689:0:24222:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788843913.198800:0:24222:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788843913.198819:0:24222:0:(import.c:65:import_set_state_nolock()) ffff9bd007707000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788843913.198850:0:24222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd008621500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a6e673fb-9566-47bf-b86a-d710f4950716+6:2386:x1875738116640640:12345-192.168.203.33@tcp:8:mount.lustre.0 Request processed in 233us (1022us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843913.198859:0:24222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 20 00000100:00100000:0.0:1788843913.201499:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1788843913.201593:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116640896 00000100:00100000:1.0:1788843913.201603:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116640896 00000100:00100000:1.0:1788843913.201652:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 0 00000100:00100000:1.0:1788843913.201662:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd00723ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a6e673fb-9566-47bf-b86a-d710f4950716+6:18061:x1875738116640896:12345-192.168.203.33@tcp:33:mount.lustre.0 00000004:00080000:1.0:1788843913.214783:0:22714:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 13040us 00000004:00200000:1.0:1788843913.245749:0:22714:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:1.0:1788843913.245884:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd00723ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a6e673fb-9566-47bf-b86a-d710f4950716+6:18061:x1875738116640896:12345-192.168.203.33@tcp:33:mount.lustre.0 Request processed in 44216us (44387us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843913.245895:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 0 00000100:00100000:0.0:1788843913.425482:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1788843913.425670:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116641024 00000100:00100000:1.0:1788843913.425681:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116641024 00000100:00100000:1.0:1788843913.425750:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 13 00000100:00100000:1.0:1788843913.425773:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd00723ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a6e673fb-9566-47bf-b86a-d710f4950716+6:18105:x1875738116641024:12345-192.168.203.33@tcp:101:mkdir.0 00010000:00010000:1.0:1788843913.425794:0:22712:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788843913.425821:0:22712:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbeac00/0xa762dfcbd58d2f38 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf24d95f22490ec2 expref: -99 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843913.425888:0:22712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbebe00/0xa762dfcbd58d2f3f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843913.425903:0:22712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbebe00/0xa762dfcbd58d2f3f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843913.425921:0:22712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbebe00/0xa762dfcbd58d2f3f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788843913.425984:0:22712:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788843913.425988:0:22712:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788843913.426025:0:22712:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbebe00/0xa762dfcbd58d2f3f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843913.426391:0:22712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbeac00/0xa762dfcbd58d2f38 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490ec2 expref: 8 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843913.426410:0:22712:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbebe00/0xa762dfcbd58d2f3f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490ec2 expref: 7 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843913.426418:0:22712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bd00746b600) 00010000:00010000:1.0:1788843913.426421:0:22712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788843913.426425:0:22712:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd13fbebe00, rc 0) 00000100:00100000:1.0:1788843913.426478:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd00723ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a6e673fb-9566-47bf-b86a-d710f4950716+7:18105:x1875738116641024:12345-192.168.203.33@tcp:101:mkdir.0 Request processed in 708us (1007us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843913.426508:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 13 00000040:00080000:2.0:1788843913.563137:0:23469:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788843913.818438:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788843914.138656:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd00723c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1875738134585472:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788843914.138730:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843914.138871:0:24226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134585472 00000100:00100000:2.0:1788843914.138879:0:24226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134585472 00000100:00100000:2.0:1788843914.138932:0:24226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788843914.138942:0:24226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f8d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1875738134585472:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788843914.138966:0:24226:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1788843914.139030:0:24226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f8d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1875738134585472:12345-0@lo:13:osp-pre-1-1.0 Request processed in 89us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843914.139038:0:24226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788843914.139097:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd00723c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1875738134585472:0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1788843914.139136:0:22707:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788843914.142496:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd1054e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0ce589ba-8334-438e-8f48-13932fcba8b1:3630:1875738134585600:0@lo:400:kworker.0 00000100:00100000:2.0:1788843914.142580:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843914.142619:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd1054e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3630:1875738134586112:0@lo:400:kworker.0 00000100:00100000:2.0:1788843914.142649:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843914.142666:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd1054e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3630:1875738134586624:0@lo:400:kworker.0 00000100:00100000:1.0:1788843914.142687:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd1054e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1875738134585856:0@lo:400:kworker.0 00000100:00100000:2.0:1788843914.142690:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843914.142718:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843914.142726:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1788843914.142732:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd1054e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1875738134585728:0@lo:400:kworker.0 00000100:00100000:1.0:1788843914.142736:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd1054e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1875738134586368:0@lo:400:kworker.0 00000100:00100000:2.0:1788843914.142754:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843914.142754:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843914.142768:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd1054e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1875738134586240:0@lo:400:kworker.0 00000100:00100000:2.0:1788843914.142788:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843914.142803:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd1054e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3630:1875738134586752:0@lo:400:kworker.0 00000100:00100000:2.0:1788843914.142827:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843914.142872:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134586112 00000100:00100000:2.0:1788843914.142880:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134586112 00000100:00100000:2.0:1788843914.142918:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134586624 00000100:00100000:2.0:1788843914.142921:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134586624 00000100:00100000:2.0:1788843914.142941:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134586752 00000100:00100000:2.0:1788843914.142944:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134586752 00000100:00100000:2.0:1788843914.142961:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788843914.142970:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f8d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3630:x1875738134586112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843914.142998:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd1054e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3632:1875738134586880:0@lo:400:kworker.0 00000100:00100000:1.0:1788843914.143022:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843914.143031:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f8d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3630:x1875738134586112:12345-0@lo:400:kworker.0 Request processed in 63us (382us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843914.143039:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788843914.143070:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134586880 00000100:00100000:2.0:1788843914.143074:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134586880 00000100:00100000:2.0:1788843914.143092:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788843914.143097:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f8d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3630:x1875738134586624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788843914.143126:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f8d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3630:x1875738134586624:12345-0@lo:400:kworker.0 Request processed in 28us (434us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843914.143131:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788843914.143163:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788843914.143170:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f8d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3630:x1875738134586752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788843914.143196:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f8d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3630:x1875738134586752:12345-0@lo:400:kworker.0 Request processed in 28us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843914.143203:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788843914.143214:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788843914.143218:0:3632:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1788843914.143220:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1054e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3632:x1875738134586880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843914.143225:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd1054e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1875738134585984:0@lo:400:kworker.0 00000100:00100000:2.0:1788843914.143368:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1054e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3632:x1875738134586880:12345-0@lo:400:kworker.0 Request processed in 146us (343us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843914.143383:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788843914.143403:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134585728 00000100:00100000:2.0:1788843914.143406:0:22716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134585728 00000100:00100000:2.0:1788843914.143434:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134586240 00000100:00100000:2.0:1788843914.143437:0:22716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134586240 00000100:00100000:2.0:1788843914.143448:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788843914.143453:0:22716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f8d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3630:x1875738134585728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788843914.143486:0:22716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f8d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3630:x1875738134585728:12345-0@lo:400:kworker.0 Request processed in 33us (731us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843914.143492:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788843914.143503:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788843914.143507:0:22716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f8d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3630:x1875738134586240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788843914.143530:0:22716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f8d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3630:x1875738134586240:12345-0@lo:400:kworker.0 Request processed in 23us (742us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843914.143535:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00080000:2.0:1788843914.143594:0:22707:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788843914.143598:0:22707:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788843914.143626:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd1054e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1875738134585728:0@lo:400:kworker.0 00000100:00100000:2.0:1788843914.143636:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd1054e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1875738134586240:0@lo:400:kworker.0 00010000:00080000:2.0:1788843914.143646:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd1054e4e00 x1875738134586752/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843930 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788843914.143656:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd1054e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3630:1875738134586752:0@lo:400:kworker.0 00000100:00100000:2.0:1788843914.143665:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd1054e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3630:1875738134586112:0@lo:400:kworker.0 00000100:00100000:2.0:1788843914.143673:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd1054e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3630:1875738134586624:0@lo:400:kworker.0 00000100:00100000:2.0:1788843914.143724:0:24686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134585856 00000100:00100000:2.0:1788843914.143728:0:24686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134585856 00000100:00100000:2.0:1788843914.143755:0:24686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134586368 00000100:00100000:2.0:1788843914.143758:0:24686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134586368 00000100:00100000:2.0:1788843914.143776:0:24686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788843914.143783:0:24686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1054e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3632:x1875738134585856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788843914.143813:0:24686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1054e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3632:x1875738134585856:12345-0@lo:400:kworker.0 Request processed in 31us (1094us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843914.143819:0:24686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788843914.143830:0:24686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788843914.143836:0:24686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1054e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3632:x1875738134586368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788843914.143861:0:24686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1054e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3632:x1875738134586368:12345-0@lo:400:kworker.0 Request processed in 26us (1107us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843914.143867:0:24686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788843914.143883:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134585600 00000100:00100000:2.0:1788843914.143887:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134585600 00000100:00100000:2.0:1788843914.143911:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1788843914.143917:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0059e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ce589ba-8334-438e-8f48-13932fcba8b1+24:3630:x1875738134585600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788843914.143950:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0059e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ce589ba-8334-438e-8f48-13932fcba8b1+24:3630:x1875738134585600:12345-0@lo:400:kworker.0 Request processed in 34us (1371us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843914.143956:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00080000:2.0:1788843914.144127:0:22707:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788843914.144165:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd1054e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0ce589ba-8334-438e-8f48-13932fcba8b1:3630:1875738134585600:0@lo:400:kworker.0 00000100:00100000:0.0:1788843914.144914:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f985880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1875738134587136:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788843914.144955:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843914.145220:0:24226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134587136 00000100:00100000:3.0:1788843914.145226:0:24226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134587136 00000100:00100000:3.0:1788843914.145268:0:24226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788843914.145276:0:24226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd00723f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3630:x1875738134587136:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788843914.145294:0:24226:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1788843914.145331:0:24226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd00723f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3630:x1875738134587136:12345-0@lo:13:osp-pre-1-0.0 Request processed in 56us (376us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843914.145349:0:24226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:3.0:1788843914.145369:0:22707:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788843914.146288:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f985880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1875738134587136:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788843914.148217:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843914.148275:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd1054e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3632:1875738134586496:0@lo:400:kworker.0 00000100:00100000:2.0:1788843914.148276:0:24686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134585984 00000100:00100000:2.0:1788843914.148283:0:24686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134585984 00000100:00100000:1.0:1788843914.148318:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843914.148341:0:24686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788843914.148352:0:24686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1054e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3632:x1875738134585984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843914.148380:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd1054e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3632:1875738134587008:0@lo:400:kworker.0 00000100:00100000:1.0:1788843914.148406:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843914.148474:0:24686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1054e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3632:x1875738134585984:12345-0@lo:400:kworker.0 Request processed in 65us (660us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843914.148483:0:24686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788843914.153697:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd1054e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1875738134585856:0@lo:400:kworker.0 00000100:00100000:1.0:1788843914.153716:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd1054e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1875738134586368:0@lo:400:kworker.0 00000100:00100000:1.0:1788843914.153728:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd1054e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3632:1875738134586880:0@lo:400:kworker.0 00000100:00100000:1.0:1788843914.153773:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd1054e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1875738134585984:0@lo:400:kworker.0 00000100:00100000:0.0:1788843914.166749:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134586496 00000100:00100000:0.0:1788843914.166773:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134586496 00000100:00100000:0.0:1788843914.167449:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134587008 00000100:00100000:0.0:1788843914.167456:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134587008 00000100:00100000:1.0:1788843914.168168:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788843914.168185:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1054e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3632:x1875738134586496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788843914.168380:0:22711:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1788843914.168388:0:22711:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:2.0:1788843914.168511:0:22713:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1788843914.168522:0:22713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788843914.168530:0:22713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1054e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3632:x1875738134587008:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1788843914.175549:0:22707:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788843914.175981:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1054e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3632:x1875738134586496:12345-0@lo:400:kworker.0 Request processed in 7795us (27655us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843914.176008:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788843914.183204:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd1054e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3632:1875738134586496:0@lo:400:kworker.0 00000100:00100000:2.0:1788843914.188018:0:22713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1054e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3632:x1875738134587008:12345-0@lo:400:kworker.0 Request processed in 19478us (39600us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843914.188036:0:22713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:3.0:1788843914.188815:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd1054e0a80 x1875738134587008/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843930 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788843914.188834:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd1054e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3632:1875738134587008:0@lo:400:kworker.0 00000001:00100000:2.0:1788843914.655677:0:25039:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of a6e673fb-9566-47bf-b86a-d710f4950716 00000001:00080000:2.0:1788843914.655695:0:25039:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901890 is committed 00010000:00010000:3.0:1788843914.842498:0:23471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788843915.420751:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1788843915.420872:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116641152 00000100:00100000:0.0:1788843915.420884:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116641152 00000100:00100000:0.0:1788843915.420975:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 14 00000100:00100000:0.0:1788843915.420984:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f8d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a6e673fb-9566-47bf-b86a-d710f4950716+7:18158:x1875738116641152:12345-192.168.203.33@tcp:41:lfs.0 00000004:00000024:0.0:1788843915.421022:0:22711:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1788843915.421128:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f8d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a6e673fb-9566-47bf-b86a-d710f4950716+7:18158:x1875738116641152:12345-192.168.203.33@tcp:41:lfs.0 Request processed in 144us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843915.421136:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 14 00000100:00080000:1.0:1788843915.421794:0:22707:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788843915.423900:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1788843915.424415:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116641280 00000100:00100000:1.0:1788843915.424426:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116641280 00000100:00080000:0.0:1788843915.424600:0:22707:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788843915.424656:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 15 00000100:00100000:1.0:1788843915.424669:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd00723e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a6e673fb-9566-47bf-b86a-d710f4950716+6:18158:x1875738116641280:12345-192.168.203.33@tcp:41:lfs.0 00000004:00000024:1.0:1788843915.424720:0:22712:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788843915.424946:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd00723e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a6e673fb-9566-47bf-b86a-d710f4950716+6:18158:x1875738116641280:12345-192.168.203.33@tcp:41:lfs.0 Request processed in 279us (1056us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843915.424955:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 15 00000100:00100000:0.0:1788843915.427342:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843915.427497:0:24226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116641408 00000100:00100000:3.0:1788843915.427510:0:24226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116641408 00000100:00100000:3.0:1788843915.427674:0:24226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 11 00000100:00100000:3.0:1788843915.427686:0:24226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd00723df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:a6e673fb-9566-47bf-b86a-d710f4950716+6:18158:x1875738116641408:12345-192.168.203.33@tcp:13:lfs.0 00002000:00000024:3.0:1788843915.427732:0:24226:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3915857920 avail 3684335616 00000100:00100000:3.0:1788843915.427834:0:24226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd00723df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:a6e673fb-9566-47bf-b86a-d710f4950716+6:18158:x1875738116641408:12345-192.168.203.33@tcp:13:lfs.0 Request processed in 150us (502us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843915.427842:0:24226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 11 00000100:00080000:0.0:1788843915.428443:0:22707:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788843915.430251:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843915.430466:0:24226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116641536 00000100:00100000:3.0:1788843915.430479:0:24226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116641536 00000100:00100000:3.0:1788843915.430659:0:24226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 12 00000100:00100000:3.0:1788843915.430673:0:24226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f8d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:a6e673fb-9566-47bf-b86a-d710f4950716+5:18158:x1875738116641536:12345-192.168.203.33@tcp:13:lfs.0 00002000:00000024:3.0:1788843915.430721:0:24226:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1788843915.430821:0:24226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f8d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:a6e673fb-9566-47bf-b86a-d710f4950716+5:18158:x1875738116641536:12345-192.168.203.33@tcp:13:lfs.0 Request processed in 151us (584us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843915.430828:0:24226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 12 00000100:00080000:0.0:1788843915.431657:0:22707:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788843915.554304:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843915.554422:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116641664 00000100:00100000:2.0:1788843915.554435:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116641664 00000100:00100000:2.0:1788843915.555904:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 131 00000100:00100000:2.0:1788843915.555922:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007355450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efb31ab2-ab0a-4b00-9471-3fc304e37c6a+10:18191:x1875738116641664:12345-192.168.203.33@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788843915.555941:0:22705:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788843915.555965:0:22705:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd1153e7200/0xa762dfcbd58d2f46 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0xaf24d95f22490ec9 expref: -99 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843915.556003:0:22705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd1153e7200/0xa762dfcbd58d2f46 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490ec9 expref: 11 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843915.556016:0:22705:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd1153e7200/0xa762dfcbd58d2f46 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490ec9 expref: 11 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843915.556064:0:22705:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd1153e7200, rc 0) 00000100:00100000:2.0:1788843915.556184:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007355450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efb31ab2-ab0a-4b00-9471-3fc304e37c6a+11:18191:x1875738116641664:12345-192.168.203.33@tcp:101:mount.lustre.0 Request processed in 266us (1894us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843915.556192:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 131 00000100:00100000:1.0:1788843915.561541:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1788843915.564541:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116641792 00000100:00100000:0.0:1788843915.564560:0:22704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116641792 00000100:00100000:0.0:1788843915.564658:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 132 00000100:00100000:0.0:1788843915.564689:0:22704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007354c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efb31ab2-ab0a-4b00-9471-3fc304e37c6a+11:18191:x1875738116641792:12345-192.168.203.33@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788843915.565255:0:22704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007354c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efb31ab2-ab0a-4b00-9471-3fc304e37c6a+11:18191:x1875738116641792:12345-192.168.203.33@tcp:501:mount.lustre.0 Request processed in 566us (3723us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843915.565265:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 132 00000100:00100000:0.0:1788843915.570578:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843915.576075:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116641920 00000100:00100000:3.0:1788843915.576121:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116641920 00000100:00100000:3.0:1788843915.576239:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 133 00000100:00100000:3.0:1788843915.576253:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007356450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efb31ab2-ab0a-4b00-9471-3fc304e37c6a+11:18191:x1875738116641920:12345-192.168.203.33@tcp:503:mount.lustre.0 00000100:00100000:3.0:1788843915.576444:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007356450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efb31ab2-ab0a-4b00-9471-3fc304e37c6a+11:18191:x1875738116641920:12345-192.168.203.33@tcp:503:mount.lustre.0 Request processed in 194us (5880us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843915.576462:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 133 00000100:00100000:1.0:1788843915.585344:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1788843915.585469:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116642048 00000100:00100000:0.0:1788843915.585482:0:22704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116642048 00000100:00100000:0.0:1788843915.585545:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 134 00000100:00100000:0.0:1788843915.585556:0:22704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007355c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efb31ab2-ab0a-4b00-9471-3fc304e37c6a+11:18197:x1875738116642048:12345-192.168.203.33@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788843915.585744:0:22704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007355c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efb31ab2-ab0a-4b00-9471-3fc304e37c6a+11:18197:x1875738116642048:12345-192.168.203.33@tcp:502:llog_process_th.0 Request processed in 188us (413us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843915.585752:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 134 00000100:00100000:1.0:1788843915.602358:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843915.602472:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116642176 00000100:00100000:2.0:1788843915.602485:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116642176 00000100:00100000:2.0:1788843915.602561:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 135 00000100:00100000:2.0:1788843915.602574:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007356050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efb31ab2-ab0a-4b00-9471-3fc304e37c6a+11:18197:x1875738116642176:12345-192.168.203.33@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788843915.602784:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007356050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efb31ab2-ab0a-4b00-9471-3fc304e37c6a+11:18197:x1875738116642176:12345-192.168.203.33@tcp:502:llog_process_th.0 Request processed in 212us (438us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843915.602918:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 135 00000100:00100000:2.0:1788843915.608585:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843915.608726:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116642304 00000100:00100000:3.0:1788843915.608739:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116642304 00000100:00100000:3.0:1788843915.608804:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 136 00000100:00100000:3.0:1788843915.608814:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007354450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efb31ab2-ab0a-4b00-9471-3fc304e37c6a+11:18197:x1875738116642304:12345-192.168.203.33@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788843915.609002:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007354450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efb31ab2-ab0a-4b00-9471-3fc304e37c6a+11:18197:x1875738116642304:12345-192.168.203.33@tcp:502:llog_process_th.0 Request processed in 188us (430us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843915.609010:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 136 00000100:00100000:1.0:1788843915.613414:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1788843915.613531:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116642432 00000100:00100000:0.0:1788843915.613544:0:22704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116642432 00000100:00100000:0.0:1788843915.613611:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 137 00000100:00100000:0.0:1788843915.613623:0:22704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007356850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efb31ab2-ab0a-4b00-9471-3fc304e37c6a+11:18191:x1875738116642432:12345-192.168.203.33@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788843915.613642:0:22704:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788843915.613666:0:22704:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd00873ae00/0xa762dfcbd58d2f4d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xaf24d95f22490efa expref: -99 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843915.613703:0:22704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd00873ae00/0xa762dfcbd58d2f4d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490efa expref: 12 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843915.613726:0:22704:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd00873ae00/0xa762dfcbd58d2f4d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490efa expref: 12 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843915.613754:0:22704:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd00873ae00, rc 0) 00000100:00100000:0.0:1788843915.613942:0:22704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007356850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efb31ab2-ab0a-4b00-9471-3fc304e37c6a+12:18191:x1875738116642432:12345-192.168.203.33@tcp:101:mount.lustre.0 Request processed in 320us (541us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843915.613950:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 137 00000100:00100000:1.0:1788843915.622944:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843915.623067:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116642560 00000100:00100000:2.0:1788843915.623080:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116642560 00000100:00100000:2.0:1788843915.623184:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 138 00000100:00100000:2.0:1788843915.623196:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007355850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efb31ab2-ab0a-4b00-9471-3fc304e37c6a+12:18191:x1875738116642560:12345-192.168.203.33@tcp:256:mount.lustre.0 20000000:01000000:2.0:1788843915.623228:0:22705:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1788843915.623260:0:22705:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1788843915.623265:0:22705:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1788843915.623269:0:22705:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1788843915.623272:0:22705:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:2.0:1788843915.623274:0:22705:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 14 00000100:00100000:1.0:1788843915.626049:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007355850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efb31ab2-ab0a-4b00-9471-3fc304e37c6a+12:18191:x1875738116642560:12345-192.168.203.33@tcp:256:mount.lustre.0 Request processed in 2833us (3097us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843915.626068:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 138 00000100:00100000:1.0:1788843915.629707:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843915.629949:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116642688 00000100:00100000:3.0:1788843915.629961:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116642688 00000100:00100000:3.0:1788843915.630085:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 139 00000100:00100000:3.0:1788843915.630098:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007354050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efb31ab2-ab0a-4b00-9471-3fc304e37c6a+12:18191:x1875738116642688:12345-192.168.203.33@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788843915.630118:0:22706:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788843915.630185:0:22706:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd007be3400/0xa762dfcbd58d2f54 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xaf24d95f22490f01 expref: -99 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843915.630222:0:22706:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd007be3400/0xa762dfcbd58d2f54 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490f01 expref: 13 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843915.630234:0:22706:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd007be3400/0xa762dfcbd58d2f54 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490f01 expref: 13 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843915.630268:0:22706:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd007be3400, rc 0) 00000100:00100000:3.0:1788843915.630339:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007354050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efb31ab2-ab0a-4b00-9471-3fc304e37c6a+13:18191:x1875738116642688:12345-192.168.203.33@tcp:101:mount.lustre.0 Request processed in 242us (644us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843915.630346:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 139 00000100:00100000:0.0:1788843915.633256:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1788843915.633362:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116642816 00000100:00100000:1.0:1788843915.633374:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116642816 00000100:00100000:1.0:1788843915.633440:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 140 00000100:00100000:1.0:1788843915.633452:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007357450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efb31ab2-ab0a-4b00-9471-3fc304e37c6a+13:18191:x1875738116642816:12345-192.168.203.33@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788843915.633664:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007357450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efb31ab2-ab0a-4b00-9471-3fc304e37c6a+13:18191:x1875738116642816:12345-192.168.203.33@tcp:501:mount.lustre.0 Request processed in 214us (419us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843915.633692:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 140 00000100:00100000:2.0:1788843915.637322:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843915.637430:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116642944 00000100:00100000:3.0:1788843915.637445:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116642944 00000100:00100000:3.0:1788843915.637520:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 141 00000100:00100000:3.0:1788843915.637532:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007355050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efb31ab2-ab0a-4b00-9471-3fc304e37c6a+13:18191:x1875738116642944:12345-192.168.203.33@tcp:503:mount.lustre.0 00000100:00100000:3.0:1788843915.638031:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007355050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efb31ab2-ab0a-4b00-9471-3fc304e37c6a+13:18191:x1875738116642944:12345-192.168.203.33@tcp:503:mount.lustre.0 Request processed in 500us (722us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843915.638047:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 141 00000100:00100000:2.0:1788843915.644984:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1788843915.647190:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116643072 00000100:00100000:0.0:1788843915.647209:0:22704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116643072 00000100:00100000:0.0:1788843915.647362:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 142 00000100:00100000:0.0:1788843915.647375:0:22704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007354850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efb31ab2-ab0a-4b00-9471-3fc304e37c6a+13:18204:x1875738116643072:12345-192.168.203.33@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788843915.647729:0:22704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007354850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efb31ab2-ab0a-4b00-9471-3fc304e37c6a+13:18204:x1875738116643072:12345-192.168.203.33@tcp:502:llog_process_th.0 Request processed in 356us (2758us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843915.647739:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 142 00000100:00100000:0.0:1788843915.659983:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843915.660575:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116643200 00000100:00100000:3.0:1788843915.660590:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116643200 00000100:00100000:3.0:1788843915.660731:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 143 00000100:00100000:3.0:1788843915.660743:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007357050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efb31ab2-ab0a-4b00-9471-3fc304e37c6a+13:18204:x1875738116643200:12345-192.168.203.33@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788843915.660952:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007357050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efb31ab2-ab0a-4b00-9471-3fc304e37c6a+13:18204:x1875738116643200:12345-192.168.203.33@tcp:502:llog_process_th.0 Request processed in 210us (983us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843915.660962:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 143 00000100:00100000:0.0:1788843915.675239:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1788843915.675284:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1788843915.675406:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116643328 00000100:00100000:1.0:1788843915.675418:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116643328 00000100:00100000:1.0:1788843915.675470:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116643584 00000100:00100000:1.0:1788843915.675474:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116643584 00000100:00100000:1.0:1788843915.675498:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 16 00000100:00100000:1.0:1788843915.675507:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd00723c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2386:x1875738116643328:12345-192.168.203.33@tcp:38:mount.lustre.0 00010000:00080000:1.0:1788843915.675552:0:22711:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from d1bbae83-8212-4d8d-abaf-75a84733a0c2@192.168.203.33@tcp t0 exp 0000000000000000 cur 693 last 0 00000020:00000080:1.0:1788843915.675624:0:22711:0:(genops.c:1385:class_connect()) connect: client d1bbae83-8212-4d8d-abaf-75a84733a0c2, cookie 0xa762dfcbd58d2f5b 00000004:00100000:1.0:1788843915.675653:0:22711:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1788843915.675765:0:22711:0:(import.c:65:import_set_state_nolock()) ffff9bd140f97000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788843915.675854:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd00723c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1bbae83-8212-4d8d-abaf-75a84733a0c2+6:2386:x1875738116643328:12345-192.168.203.33@tcp:38:mount.lustre.0 Request processed in 344us (628us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843915.675862:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 16 00000100:00100000:1.0:1788843915.675883:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 17 00000100:00100000:1.0:1788843915.675888:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f955f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2386:x1875738116643584:12345-192.168.203.33@tcp:38:mount.lustre.0 00010000:00080000:1.0:1788843915.675906:0:22711:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from d1bbae83-8212-4d8d-abaf-75a84733a0c2@192.168.203.33@tcp t0 exp 0000000000000000 cur 693 last 0 00000020:00000080:1.0:1788843915.675940:0:22711:0:(genops.c:1385:class_connect()) connect: client d1bbae83-8212-4d8d-abaf-75a84733a0c2, cookie 0xa762dfcbd58d2f62 00000004:00100000:1.0:1788843915.675955:0:22711:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:1.0:1788843915.675999:0:22711:0:(import.c:65:import_set_state_nolock()) ffff9bd140f6d800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788843915.676025:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f955f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1bbae83-8212-4d8d-abaf-75a84733a0c2+6:2386:x1875738116643584:12345-192.168.203.33@tcp:38:mount.lustre.0 Request processed in 135us (740us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843915.676032:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 17 00000100:00100000:2.0:1788843915.684181:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843915.684255:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843915.684360:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843915.684730:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116643712 00000100:00100000:3.0:1788843915.684743:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116643712 00000100:00100000:3.0:1788843915.684835:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116643456 00000100:00100000:3.0:1788843915.684839:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116643456 00000100:00100000:3.0:1788843915.684856:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116643840 00000100:00100000:3.0:1788843915.684860:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116643840 00000100:00100000:3.0:1788843915.684879:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 18 00000100:00100000:3.0:1788843915.684900:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f8d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1bbae83-8212-4d8d-abaf-75a84733a0c2+6:0:x1875738116643712:12345-192.168.203.33@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788843915.684942:0:22712:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788843915.685021:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f8d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1bbae83-8212-4d8d-abaf-75a84733a0c2+6:0:x1875738116643712:12345-192.168.203.33@tcp:41:mount.lustre.0 Request processed in 124us (889us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843915.685030:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 18 00000100:00100000:3.0:1788843915.685060:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 19 00000100:00100000:3.0:1788843915.685068:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f8d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1bbae83-8212-4d8d-abaf-75a84733a0c2+7:0:x1875738116643456:12345-192.168.203.33@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788843915.685079:0:22712:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1788843915.685109:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f8d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1bbae83-8212-4d8d-abaf-75a84733a0c2+7:0:x1875738116643456:12345-192.168.203.33@tcp:41:mount.lustre.0 Request processed in 42us (853us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843915.685115:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 19 00000100:00100000:3.0:1788843915.685126:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 20 00000100:00100000:3.0:1788843915.685133:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1054e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1bbae83-8212-4d8d-abaf-75a84733a0c2+6:18191:x1875738116643840:12345-192.168.203.33@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788843915.685205:0:22712:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1788843915.685228:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1054e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1bbae83-8212-4d8d-abaf-75a84733a0c2+6:18191:x1875738116643840:12345-192.168.203.33@tcp:41:mount.lustre.0 Request processed in 96us (869us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843915.685234:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 20 00000100:00080000:2.0:1788843915.686374:0:22707:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788843915.686382:0:22707:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788843915.688074:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843915.690718:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116643968 00000100:00100000:3.0:1788843915.690741:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116643968 00000100:00100000:3.0:1788843915.690845:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 21 00000100:00100000:3.0:1788843915.690859:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f957480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1bbae83-8212-4d8d-abaf-75a84733a0c2+6:18191:x1875738116643968:12345-192.168.203.33@tcp:40:mount.lustre.0 00000100:00100000:3.0:1788843915.690977:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f957480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1bbae83-8212-4d8d-abaf-75a84733a0c2+6:18191:x1875738116643968:12345-192.168.203.33@tcp:40:mount.lustre.0 Request processed in 120us (2914us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843915.690984:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 21 00000100:00100000:0.0:1788843915.698134:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1788843915.698221:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1788843915.698250:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843915.698340:0:22722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116644352 00000100:00100000:2.0:1788843915.698353:0:22722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116644352 00000100:00100000:2.0:1788843915.698427:0:22722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 4 00000100:00100000:2.0:1788843915.698439:0:22722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f957b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:d1bbae83-8212-4d8d-abaf-75a84733a0c2+6:18191:x1875738116644352:12345-192.168.203.33@tcp:900:mount.lustre.0 00000100:00100000:2.0:1788843915.698543:0:22722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f957b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:d1bbae83-8212-4d8d-abaf-75a84733a0c2+6:18191:x1875738116644352:12345-192.168.203.33@tcp:900:mount.lustre.0 Request processed in 106us (422us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843915.698551:0:22722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 4 00000100:00100000:3.0:1788843915.698770:0:24225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116644096 00000100:00100000:3.0:1788843915.698775:0:24225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116644096 00000100:00100000:3.0:1788843915.698873:0:24225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116644224 00000100:00100000:3.0:1788843915.698877:0:24225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116644224 00000100:00100000:3.0:1788843915.698968:0:24225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 21 00000100:00100000:3.0:1788843915.698974:0:24225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f954e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2386:x1875738116644096:12345-192.168.203.33@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788843915.699006:0:24225:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from d1bbae83-8212-4d8d-abaf-75a84733a0c2@192.168.203.33@tcp t0 exp 0000000000000000 cur 693 last 0 00000020:00000080:3.0:1788843915.699051:0:24225:0:(genops.c:1385:class_connect()) connect: client d1bbae83-8212-4d8d-abaf-75a84733a0c2, cookie 0xa762dfcbd58d2f69 00002000:00100000:3.0:1788843915.699064:0:24225:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli d1bbae83-8212-4d8d-abaf-75a84733a0c2/ffff9bd001790800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211396f ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788843915.699076:0:24225:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788843915.699183:0:24225:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788843915.699215:0:24225:0:(import.c:65:import_set_state_nolock()) ffff9bd001790000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788843915.699258:0:24225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f954e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d1bbae83-8212-4d8d-abaf-75a84733a0c2+6:2386:x1875738116644096:12345-192.168.203.33@tcp:8:mount.lustre.0 Request processed in 283us (1036us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843915.699266:0:24225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 21 00000100:00100000:3.0:1788843915.699281:0:24225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 22 00000100:00100000:3.0:1788843915.699286:0:24225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f956d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2386:x1875738116644224:12345-192.168.203.33@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788843915.699303:0:24225:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from d1bbae83-8212-4d8d-abaf-75a84733a0c2@192.168.203.33@tcp t0 exp 0000000000000000 cur 693 last 0 00000020:00000080:3.0:1788843915.699320:0:24225:0:(genops.c:1385:class_connect()) connect: client d1bbae83-8212-4d8d-abaf-75a84733a0c2, cookie 0xa762dfcbd58d2f70 00002000:00100000:3.0:1788843915.699325:0:24225:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli d1bbae83-8212-4d8d-abaf-75a84733a0c2/ffff9bd001796800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211396f ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788843915.699332:0:24225:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788843915.699380:0:24225:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788843915.699396:0:24225:0:(import.c:65:import_set_state_nolock()) ffff9bd127b96000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788843915.699420:0:24225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f956d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d1bbae83-8212-4d8d-abaf-75a84733a0c2+6:2386:x1875738116644224:12345-192.168.203.33@tcp:8:mount.lustre.0 Request processed in 132us (1169us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843915.699447:0:24225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 22 00000100:00100000:0.0:1788843915.716923:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843915.717121:0:22715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116644480 00000100:00100000:3.0:1788843915.717133:0:22715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116644480 00000100:00100000:3.0:1788843915.717235:0:22715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1 00000100:00100000:3.0:1788843915.717247:0:22715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f954700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d1bbae83-8212-4d8d-abaf-75a84733a0c2+6:18191:x1875738116644480:12345-192.168.203.33@tcp:33:mount.lustre.0 00000004:00200000:3.0:1788843915.717387:0:22715:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1788843915.717482:0:22715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f954700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d1bbae83-8212-4d8d-abaf-75a84733a0c2+6:18191:x1875738116644480:12345-192.168.203.33@tcp:33:mount.lustre.0 Request processed in 236us (572us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843915.717490:0:22715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1 00010000:00010000:0.0:1788843915.868984:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788843915.886872:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1788843915.887058:0:22713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116644608 00000100:00100000:0.0:1788843915.887070:0:22713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116644608 00000100:00100000:0.0:1788843915.887182:0:22713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 22 00000100:00100000:0.0:1788843915.887193:0:22713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1054e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1bbae83-8212-4d8d-abaf-75a84733a0c2+6:18227:x1875738116644608:12345-192.168.203.33@tcp:101:mkdir.0 00010000:00010000:0.0:1788843915.887235:0:22713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788843915.887263:0:22713:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd00873b400/0xa762dfcbd58d2f77 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf24d95f22490f32 expref: -99 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843915.887341:0:22713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd00873b600/0xa762dfcbd58d2f7e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843915.887358:0:22713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd00873b600/0xa762dfcbd58d2f7e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843915.887371:0:22713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd00873b600/0xa762dfcbd58d2f7e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788843915.887429:0:22713:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788843915.887434:0:22713:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788843915.887460:0:22713:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bd00873b600/0xa762dfcbd58d2f7e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843915.887492:0:22713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd00873b400/0xa762dfcbd58d2f77 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490f32 expref: 8 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843915.887527:0:22713:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd00873b600/0xa762dfcbd58d2f7e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490f32 expref: 7 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843915.887537:0:22713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bd00746b600) 00010000:00010000:0.0:1788843915.887540:0:22713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788843915.887543:0:22713:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd00873b600, rc 0) 00000100:00100000:0.0:1788843915.887623:0:22713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1054e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1bbae83-8212-4d8d-abaf-75a84733a0c2+7:18227:x1875738116644608:12345-192.168.203.33@tcp:101:mkdir.0 Request processed in 431us (765us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843915.887631:0:22713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 22 00000100:00100000:0.0:1788843916.698869:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd1054e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1875738134587264:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788843916.698962:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843916.699104:0:24226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134587264 00000100:00100000:2.0:1788843916.699115:0:24226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134587264 00000100:00100000:3.0:1788843916.699241:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f984700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1875738134587392:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788843916.699263:0:22707:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788843916.699275:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843916.707907:0:24226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134587392 00000100:00100000:2.0:1788843916.707930:0:24226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134587392 00000100:00100000:2.0:1788843916.711415:0:24226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788843916.711435:0:24226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f955500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3631:x1875738134587264:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788843916.711469:0:24226:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915857920 avail 3684335616 00000100:00100000:2.0:1788843916.711593:0:24226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f955500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3631:x1875738134587264:12345-0@lo:13:osp-pre-0-1.0 Request processed in 164us (12631us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843916.711602:0:24226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788843916.711626:0:24226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788843916.711634:0:24226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f986a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3632:x1875738134587392:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788843916.711647:0:24226:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915857920 avail 3684335616 00000100:00100000:2.0:1788843916.711694:0:24226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f986a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3632:x1875738134587392:12345-0@lo:13:osp-pre-0-0.0 Request processed in 61us (12418us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843916.711718:0:24226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788843916.711809:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd1054e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1875738134587264:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788843916.711917:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f984700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1875738134587392:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788843916.714440:0:22707:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788843916.892555:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788843917.724560:0:3632:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788843917.724591:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd1054e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1875738134587520:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788843917.724680:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843917.724796:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134587520 00000100:00100000:1.0:1788843917.724823:0:22716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134587520 00000100:00100000:1.0:1788843917.724881:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788843917.724904:0:22716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f955880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3632:x1875738134587520:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788843917.724942:0:22716:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1788843917.724996:0:22716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f955880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3632:x1875738134587520:12345-0@lo:41:osp-pre-0-1.0 Request processed in 94us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843917.725004:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788843917.725298:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f954a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1875738134587648:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788843917.725331:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843917.725405:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd1054e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1875738134587520:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788843917.725469:0:23743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134587648 00000100:00100000:3.0:1788843917.725475:0:23743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134587648 00000100:00100000:3.0:1788843917.725510:0:23743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788843917.725517:0:23743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1054e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3630:x1875738134587648:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788843917.725538:0:23743:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788843917.725578:0:23743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1054e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3630:x1875738134587648:12345-0@lo:41:osp-pre-1-0.0 Request processed in 61us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843917.725584:0:23743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788843917.725611:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f954a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1875738134587648:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1788843917.920615:0:23471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788843918.748569:0:24219:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of d1bbae83-8212-4d8d-abaf-75a84733a0c2 00000001:00100000:3.0:1788843918.748585:0:24219:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of a6e673fb-9566-47bf-b86a-d710f4950716 00000001:00100000:3.0:1788843918.748750:0:22691:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of d1bbae83-8212-4d8d-abaf-75a84733a0c2 00000001:00100000:3.0:1788843918.748762:0:22691:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of a6e673fb-9566-47bf-b86a-d710f4950716 00000001:00100000:2.0:1788843918.748787:0:23446:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of d1bbae83-8212-4d8d-abaf-75a84733a0c2 00000001:00100000:2.0:1788843918.748796:0:23446:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of a6e673fb-9566-47bf-b86a-d710f4950716 00010000:00010000:1.0:1788843918.941275:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788843919.258484:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788843919.258515:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f985c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1875738134587776:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788843919.258615:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843919.258880:0:24226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134587776 00000100:00100000:3.0:1788843919.258890:0:24226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134587776 00000100:00100000:3.0:1788843919.258974:0:24226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788843919.258988:0:24226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1054e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3630:x1875738134587776:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788843919.259032:0:24226:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1788843919.259092:0:24226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1054e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3630:x1875738134587776:12345-0@lo:13:osp-pre-1-0.0 Request processed in 108us (477us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843919.259100:0:24226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788843919.259186:0:3630:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 12884901890 gen 2 00000100:00100000:3.0:1788843919.259214:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f985c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1875738134587776:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1788843919.259309:0:22707:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788843919.259560:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f985c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0ce589ba-8334-438e-8f48-13932fcba8b1:3632:1875738134587904:0@lo:400:kworker.0 00000100:00100000:3.0:1788843919.259601:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843919.259630:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f986680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1875738134588416:0@lo:400:kworker.0 00000100:00100000:3.0:1788843919.259658:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843919.259677:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f984700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3632:1875738134588928:0@lo:400:kworker.0 00000100:00100000:3.0:1788843919.259703:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843919.259724:0:3632:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1788843919.259968:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f985180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1875738134588032:0@lo:400:kworker.0 00000100:00100000:3.0:1788843919.259996:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843919.260068:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f987b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1875738134588544:0@lo:400:kworker.0 00000100:00100000:3.0:1788843919.260094:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843919.260124:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f985880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3632:1875738134589056:0@lo:400:kworker.0 00000100:00100000:3.0:1788843919.260177:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843919.260216:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134587904 00000100:00100000:3.0:1788843919.260223:0:22704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134587904 00000100:00100000:3.0:1788843919.260282:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1788843919.260289:0:22704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007356c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ce589ba-8334-438e-8f48-13932fcba8b1+24:3632:x1875738134587904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788843919.260357:0:22704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007356c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ce589ba-8334-438e-8f48-13932fcba8b1+24:3632:x1875738134587904:12345-0@lo:400:kworker.0 Request processed in 69us (755us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843919.260364:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1788843919.260450:0:24686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134588544 00000100:00100000:1.0:1788843919.260455:0:24686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134588544 00000100:00100000:1.0:1788843919.260497:0:24686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788843919.260506:0:24686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007768380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3632:x1875738134588544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843919.260548:0:24686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007768380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3632:x1875738134588544:12345-0@lo:400:kworker.0 Request processed in 44us (453us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843919.260556:0:24686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:1.0:1788843919.260578:0:22707:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788843919.266896:0:23743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134588416 00000100:00100000:0.0:1788843919.266919:0:23743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134588416 00000100:00100000:0.0:1788843919.266992:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134588032 00000100:00100000:0.0:1788843919.266996:0:22716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134588032 00000100:00100000:0.0:1788843919.267034:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788843919.267047:0:22716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1203d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3632:x1875738134588416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788843919.267185:0:22716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1203d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3632:x1875738134588416:12345-0@lo:400:kworker.0 Request processed in 141us (7525us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843919.267193:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788843919.267212:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788843919.267219:0:22716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007ba3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3632:x1875738134588032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788843919.267253:0:22716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007ba3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3632:x1875738134588032:12345-0@lo:400:kworker.0 Request processed in 34us (7256us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843919.267259:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788843919.270174:0:25511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134588928 00000100:00100000:2.0:1788843919.270194:0:25511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134588928 00000100:00100000:2.0:1788843919.270269:0:25511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134589056 00000100:00100000:2.0:1788843919.270273:0:25511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134589056 00000100:00100000:2.0:1788843919.270302:0:25511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00080000:1.0:1788843919.270510:0:22707:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788843919.270515:0:22707:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788843919.270555:0:25511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007ba3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3632:x1875738134588928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788843919.270665:0:25511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007ba3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3632:x1875738134588928:12345-0@lo:400:kworker.0 Request processed in 115us (10960us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843919.270815:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788843919.270837:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd1054e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1875738134589440:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788843919.270887:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843919.270927:0:24226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134589440 00000100:00100000:3.0:1788843919.270931:0:24226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134589440 00000100:00100000:3.0:1788843919.270974:0:24226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788843919.270983:0:24226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007769880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1875738134589440:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788843919.271002:0:24226:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1788843919.271050:0:24226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007769880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1875738134589440:12345-0@lo:13:osp-pre-1-1.0 Request processed in 69us (163us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843919.271057:0:24226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788843919.271112:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd1054e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1875738134589440:0@lo:13:osp-pre-1-1.0 00000100:00080000:3.0:1788843919.271156:0:22707:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788843919.271178:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f985180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1875738134588032:0@lo:400:kworker.0 00000100:00100000:3.0:1788843919.271192:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f987b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1875738134588544:0@lo:400:kworker.0 00000100:00100000:3.0:1788843919.271204:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f985c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0ce589ba-8334-438e-8f48-13932fcba8b1:3632:1875738134587904:0@lo:400:kworker.0 00000100:00100000:3.0:1788843919.271215:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f986680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1875738134588416:0@lo:400:kworker.0 00000100:00100000:3.0:1788843919.271225:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f984700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3632:1875738134588928:0@lo:400:kworker.0 00000100:00100000:0.0:1788843919.271428:0:22713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788843919.271442:0:22713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd00776bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3632:x1875738134589056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788843919.271490:0:22713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd00776bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3632:x1875738134589056:12345-0@lo:400:kworker.0 Request processed in 53us (11313us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843919.271498:0:22713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788843919.273399:0:25511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788843919.273447:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f987480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3631:1875738134588288:0@lo:400:kworker.0 00010000:00080000:3.0:1788843919.273508:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd10f985880 x1875738134589056/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843935 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788843919.273533:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f985880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3632:1875738134589056:0@lo:400:kworker.0 00000100:00100000:2.0:1788843919.273890:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843919.273986:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f987800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3631:1875738134588800:0@lo:400:kworker.0 00000100:00100000:2.0:1788843919.274025:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843919.274111:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd1203d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3631:1875738134589312:0@lo:400:kworker.0 00000100:00100000:2.0:1788843919.274366:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843919.274477:0:22713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134588288 00000100:00100000:1.0:1788843919.274618:0:22713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134588288 00000100:00100000:1.0:1788843919.274677:0:22713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134588800 00000100:00100000:1.0:1788843919.274680:0:22713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134588800 00000100:00100000:1.0:1788843919.274931:0:22713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788843919.274939:0:22713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1054e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3631:x1875738134588288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843919.275002:0:22713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1054e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3631:x1875738134588288:12345-0@lo:400:kworker.0 Request processed in 64us (1114us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843919.275009:0:22713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788843919.275036:0:22713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788843919.275042:0:22713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1054e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3631:x1875738134588800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843919.275069:0:22713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1054e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3631:x1875738134588800:12345-0@lo:400:kworker.0 Request processed in 27us (1055us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843919.275074:0:22713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788843919.275194:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f984e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1875738134588160:0@lo:400:kworker.0 00000100:00100000:0.0:1788843919.275242:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843919.275270:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f987100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1875738134588672:0@lo:400:kworker.0 00000100:00100000:0.0:1788843919.275292:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843919.275380:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f986300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3630:1875738134589184:0@lo:400:kworker.0 00000100:00100000:0.0:1788843919.275421:0:24222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134588160 00000100:00100000:0.0:1788843919.275425:0:24222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134588160 00000100:00100000:0.0:1788843919.275465:0:24222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134588672 00000100:00100000:0.0:1788843919.275468:0:24222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134588672 00000100:00100000:0.0:1788843919.275487:0:24222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788843919.275493:0:24222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f956680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3630:x1875738134588160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788843919.275532:0:24222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f956680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3630:x1875738134588160:12345-0@lo:400:kworker.0 Request processed in 40us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843919.275539:0:24222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788843919.275553:0:24222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788843919.275558:0:24222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f956a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3630:x1875738134588672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788843919.275586:0:24222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f956a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3630:x1875738134588672:12345-0@lo:400:kworker.0 Request processed in 28us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843919.275593:0:24222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:0.0:1788843919.275614:0:22707:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788843919.275899:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f987480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3631:1875738134588288:0@lo:400:kworker.0 00000100:00100000:2.0:1788843919.275912:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f987800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3631:1875738134588800:0@lo:400:kworker.0 00000100:00100000:3.0:1788843919.275972:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843919.276061:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f984e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1875738134588160:0@lo:400:kworker.0 00000100:00100000:3.0:1788843919.276071:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f987100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1875738134588672:0@lo:400:kworker.0 00000100:00100000:0.0:1788843919.276131:0:22713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134589312 00000100:00100000:0.0:1788843919.276135:0:22713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134589312 00000100:00100000:0.0:1788843919.276199:0:22713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134589184 00000100:00100000:0.0:1788843919.276203:0:22713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134589184 00000100:00100000:0.0:1788843919.276224:0:22713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788843919.276231:0:22713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1054e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3631:x1875738134589312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788843919.276274:0:22713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1054e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3631:x1875738134589312:12345-0@lo:400:kworker.0 Request processed in 43us (2132us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843919.276290:0:22713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788843919.276304:0:22713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788843919.276389:0:22713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd00776a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3630:x1875738134589184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788843919.276425:0:22713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd00776a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3630:x1875738134589184:12345-0@lo:400:kworker.0 Request processed in 39us (452us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843919.276430:0:22713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:3.0:1788843919.276487:0:22707:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788843919.276490:0:22707:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788843919.276511:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f986300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3630:1875738134589184:0@lo:400:kworker.0 00010000:00080000:2.0:1788843919.276637:0:3631:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd1203d1f80 x1875738134589312/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843935 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788843919.276658:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd1203d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3631:1875738134589312:0@lo:400:kworker.0 00000001:02000400:3.0:1788843919.372086:0:25596:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000040:00080000:3.0:1788843919.518898:0:22748:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788843919.963097:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788843920.811806:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843920.811851:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843920.811886:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843920.811908:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843920.811932:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843920.811948:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843920.811967:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843920.811986:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843920.812022:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843920.812052:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116644864 00000100:00100000:2.0:1788843920.812061:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116644864 00000100:00100000:2.0:1788843920.812110:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116645376 00000100:00100000:2.0:1788843920.812113:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116645376 00000100:00100000:2.0:1788843920.812127:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116644992 00000100:00100000:2.0:1788843920.812129:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116644992 00000100:00100000:2.0:1788843920.812172:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116645504 00000100:00100000:2.0:1788843920.812175:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116645504 00000100:00100000:2.0:1788843920.812193:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 42 00000100:00100000:2.0:1788843920.812202:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1054e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a6e673fb-9566-47bf-b86a-d710f4950716+6:2389:x1875738116644864:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:2.0:1788843920.812275:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1054e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a6e673fb-9566-47bf-b86a-d710f4950716+6:2389:x1875738116644864:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 73us (479us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843920.812282:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 42 00000100:00100000:2.0:1788843920.812298:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 43 00000100:00100000:2.0:1788843920.812305:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1054e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1bbae83-8212-4d8d-abaf-75a84733a0c2+6:2389:x1875738116645376:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:2.0:1788843920.812326:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1054e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1bbae83-8212-4d8d-abaf-75a84733a0c2+6:2389:x1875738116645376:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 22us (440us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843920.812342:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 43 00000100:00100000:2.0:1788843920.812353:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 44 00000100:00100000:2.0:1788843920.812359:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1054e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a6e673fb-9566-47bf-b86a-d710f4950716+5:2389:x1875738116644992:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:2.0:1788843920.812382:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1054e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a6e673fb-9566-47bf-b86a-d710f4950716+5:2389:x1875738116644992:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 23us (433us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843920.812388:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 44 00000100:00100000:2.0:1788843920.812399:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 45 00000100:00100000:2.0:1788843920.812405:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1203d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1bbae83-8212-4d8d-abaf-75a84733a0c2+5:2389:x1875738116645504:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:2.0:1788843920.812423:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1203d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1bbae83-8212-4d8d-abaf-75a84733a0c2+5:2389:x1875738116645504:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 19us (438us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843920.812429:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 45 00000100:00100000:2.0:1788843920.812446:0:24224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116645120 00000100:00100000:2.0:1788843920.812449:0:24224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116645120 00000100:00100000:2.0:1788843920.812469:0:24224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116645632 00000100:00100000:2.0:1788843920.812471:0:24224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116645632 00000100:00100000:2.0:1788843920.812496:0:24224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116645248 00000100:00100000:2.0:1788843920.812499:0:24224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116645248 00000100:00100000:2.0:1788843920.812509:0:24224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116645760 00000100:00100000:2.0:1788843920.812511:0:24224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116645760 00000100:00100000:2.0:1788843920.812523:0:24224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 11 00000100:00100000:2.0:1788843920.812528:0:24224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1054e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a6e673fb-9566-47bf-b86a-d710f4950716+5:2389:x1875738116645120:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:2.0:1788843920.812550:0:24224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1054e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a6e673fb-9566-47bf-b86a-d710f4950716+5:2389:x1875738116645120:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 22us (699us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843920.812556:0:24224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 11 00000100:00100000:2.0:1788843920.812567:0:24224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 12 00000100:00100000:2.0:1788843920.812579:0:24224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1054e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d1bbae83-8212-4d8d-abaf-75a84733a0c2+5:2389:x1875738116645632:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:2.0:1788843920.812600:0:24224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1054e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d1bbae83-8212-4d8d-abaf-75a84733a0c2+5:2389:x1875738116645632:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 22us (692us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843920.812606:0:24224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 12 00000100:00100000:2.0:1788843920.812616:0:24224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 13 00000100:00100000:2.0:1788843920.812621:0:24224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1054e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a6e673fb-9566-47bf-b86a-d710f4950716+5:2389:x1875738116645248:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:2.0:1788843920.812639:0:24224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1054e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a6e673fb-9566-47bf-b86a-d710f4950716+5:2389:x1875738116645248:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 18us (673us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843920.812645:0:24224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 13 00000100:00100000:2.0:1788843920.812654:0:24224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 14 00000100:00100000:2.0:1788843920.812660:0:24224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10fe21f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d1bbae83-8212-4d8d-abaf-75a84733a0c2+6:2389:x1875738116645760:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:2.0:1788843920.812676:0:24224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10fe21f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d1bbae83-8212-4d8d-abaf-75a84733a0c2+6:2389:x1875738116645760:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 17us (654us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843920.812682:0:24224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 14 00000100:00100000:3.0:1788843920.812999:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116644736 00000100:00100000:3.0:1788843920.813015:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116644736 00000100:00100000:3.0:1788843920.813052:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 145 00000100:00100000:3.0:1788843920.813059:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007357c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efb31ab2-ab0a-4b00-9471-3fc304e37c6a+13:2389:x1875738116644736:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:3.0:1788843920.813097:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007357c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efb31ab2-ab0a-4b00-9471-3fc304e37c6a+13:2389:x1875738116644736:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 38us (1164us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843920.813103:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 145 00000100:00080000:3.0:1788843920.813136:0:22707:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788843920.813159:0:22707:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788843920.813162:0:22707:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788843920.813164:0:22707:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788843920.989819:0:23471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788843921.819571:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10fe22300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1875738134589568:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788843921.819790:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843921.819870:0:24226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134589568 00000100:00100000:2.0:1788843921.819880:0:24226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134589568 00000100:00100000:2.0:1788843921.819947:0:24226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788843921.819959:0:24226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10fe23480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3633:x1875738134589568:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788843921.820005:0:24226:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915857920 avail 3684335616 00000100:00100000:2.0:1788843921.820057:0:24226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10fe23480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3633:x1875738134589568:12345-0@lo:13:osp-pre-0-0.0 Request processed in 101us (392us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843921.820065:0:24226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:2.0:1788843921.820111:0:22707:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788843921.821311:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10fe22300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1875738134589568:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788843921.828174:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f954a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1875738134589696:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788843921.828279:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843921.830314:0:24226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134589696 00000100:00100000:0.0:1788843921.830331:0:24226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134589696 00000100:00100000:0.0:1788843921.830422:0:24226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788843921.830434:0:24226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10fe22300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3630:x1875738134589696:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788843921.830464:0:24226:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915857920 avail 3684335616 00000100:00100000:0.0:1788843921.830579:0:24226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10fe22300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3630:x1875738134589696:12345-0@lo:13:osp-pre-0-1.0 Request processed in 147us (2299us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843921.830586:0:24226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788843921.831391:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f954a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1875738134589696:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1788843921.831443:0:22707:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00100000:0.0:1788843921.840988:0:25039:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of d1bbae83-8212-4d8d-abaf-75a84733a0c2 00010000:00010000:0.0:1788843922.012822:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788843922.842864:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788843922.842893:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007769c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1875738134589824:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788843922.842998:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843922.843438:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134589824 00000100:00100000:0.0:1788843922.843447:0:22716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134589824 00000100:00100000:0.0:1788843922.843505:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788843922.843515:0:22716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007768000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3630:x1875738134589824:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788843922.843556:0:22716:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1788843922.843623:0:22716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007768000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3630:x1875738134589824:12345-0@lo:41:osp-pre-0-1.0 Request processed in 108us (633us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843922.843631:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788843922.843655:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788843922.843676:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f954a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1875738134589952:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788843922.843716:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843922.843753:0:23743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134589952 00000100:00100000:0.0:1788843922.843758:0:23743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134589952 00000100:00100000:0.0:1788843922.843782:0:23743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788843922.843788:0:23743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd14165c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3633:x1875738134589952:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788843922.843808:0:23743:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788843922.843846:0:23743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd14165c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3633:x1875738134589952:12345-0@lo:41:osp-pre-1-0.0 Request processed in 58us (129us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843922.843853:0:23743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788843922.843902:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f954a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1875738134589952:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788843922.843942:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007769c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1875738134589824:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1788843923.034456:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788843923.433994:0:25744:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffee1f716a0 20000000:00000080:1.0:1788843923.434017:0:25744:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9bd140b8ac00 uarg=0000000000000000 20000000:01000000:1.0:1788843923.434074:0:25744:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1788843923.434081:0:25744:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1788843923.434086:0:25744:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1788843923.435509:0:25745:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 13 20000000:00000400:1.0:1788843923.435694:0:25744:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:1.0:1788843923.443134:0:25744:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1788843923.443546:0:25744:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9bd13fbeb200/0xa762dfcbd58d2f85 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843923.443570:0:25744:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bd1153e7a00/0xa762dfcbd58d2be2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa762dfcbd58d2bdb expref: 23 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843923.443578:0:25744:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bd1153e6600/0xa762dfcbd58d2bf0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa762dfcbd58d2be9 expref: 23 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843923.443584:0:25744:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bd1153e6a00/0xa762dfcbd58d2c2f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa762dfcbd58d2c28 expref: 23 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843923.443611:0:25744:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bd007947c00/0xa762dfcbd58d2da9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa762dfcbd58d2da2 expref: 23 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843923.443622:0:25744:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bd007be3c00/0xa762dfcbd58d2f15 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490e91 expref: 12 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843923.443630:0:25744:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bd007be3400/0xa762dfcbd58d2f54 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490f01 expref: 12 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843923.443638:0:25744:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9bd13fbeb200/0xa762dfcbd58d2f85 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 25744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843923.443702:0:25744:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bd007be3400/0xa762dfcbd58d2f54 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490f01 expref: 12 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843923.443720:0:25744:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9bd007be3400/0xa762dfcbd58d2f54 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490f01 expref: 12 pid: 22706 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843923.443736:0:25744:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd1054e3480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25744:1875738134590080:192.168.203.33@tcp:104: 00010000:00010000:1.0:1788843923.443935:0:25744:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bd007be3c00/0xa762dfcbd58d2f15 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490e91 expref: 12 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843923.443944:0:25744:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9bd007be3c00/0xa762dfcbd58d2f15 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490e91 expref: 12 pid: 22706 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843923.443953:0:25744:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd1054e3b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25744:1875738134590208:192.168.203.33@tcp:104: 00010000:00010000:1.0:1788843923.444064:0:25744:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bd007947c00/0xa762dfcbd58d2da9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa762dfcbd58d2da2 expref: 23 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843923.444086:0:25744:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9bd007947c00/0xa762dfcbd58d2da9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa762dfcbd58d2da2 expref: 23 pid: 22706 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843923.444097:0:25744:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd1054e2d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25744:1875738134590336:0@lo:104: 00000100:00100000:1.0:1788843923.444183:0:25744:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788843923.444247:0:25744:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bd1153e6a00/0xa762dfcbd58d2c2f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa762dfcbd58d2c28 expref: 23 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843923.444256:0:25744:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9bd1153e6a00/0xa762dfcbd58d2c2f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa762dfcbd58d2c28 expref: 23 pid: 22705 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843923.444266:0:25744:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd1054e1500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25744:1875738134590464:0@lo:104: 00000100:00100000:1.0:1788843923.444288:0:25744:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788843923.444312:0:25744:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bd1153e6600/0xa762dfcbd58d2bf0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa762dfcbd58d2be9 expref: 23 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843923.444319:0:25744:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9bd1153e6600/0xa762dfcbd58d2bf0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa762dfcbd58d2be9 expref: 23 pid: 22706 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843923.444327:0:25744:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd1054e2680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25744:1875738134590592:0@lo:104: 00000100:00100000:1.0:1788843923.444348:0:25744:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788843923.444363:0:25744:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bd1153e7a00/0xa762dfcbd58d2be2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa762dfcbd58d2bdb expref: 23 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843923.444370:0:25744:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9bd1153e7a00/0xa762dfcbd58d2be2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa762dfcbd58d2bdb expref: 23 pid: 22706 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843923.444377:0:25744:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd1054e3800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25744:1875738134590720:0@lo:104: 00000100:00100000:1.0:1788843923.444407:0:25744:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843923.444418:0:25744:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd1054fb180 going to sleep for 11 seconds 00000100:00100000:2.0:1788843923.444716:0:22694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134590336 00000100:00100000:2.0:1788843923.444726:0:22694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134590336 00000100:00100000:2.0:1788843923.444773:0:22694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134590464 00000100:00100000:2.0:1788843923.444776:0:22694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134590464 00000100:00100000:2.0:1788843923.444787:0:22694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134590592 00000100:00100000:2.0:1788843923.444789:0:22694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134590592 00000100:00100000:2.0:1788843923.444799:0:22694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134590720 00000100:00100000:2.0:1788843923.444801:0:22694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134590720 00000100:00100000:2.0:1788843923.444816:0:22694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788843923.444826:0:22694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1054e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0ce589ba-8334-438e-8f48-13932fcba8b1+6:25744:x1875738134590336:12345-0@lo:104: 00010000:00010000:2.0:1788843923.444841:0:22694:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.133@tcp lock: ffff9bd10f7ae600/0xa762dfcbd58d2da2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xa762dfcbd58d2da9 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843923.445004:0:22694:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788843923.445010:0:22694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1054e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0ce589ba-8334-438e-8f48-13932fcba8b1+6:25744:x1875738134590336:12345-0@lo:104: Request processed in 186us (828us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843923.445017:0:22694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788843923.445036:0:22694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788843923.445041:0:22694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1054e0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0ce589ba-8334-438e-8f48-13932fcba8b1+5:25744:x1875738134590464:12345-0@lo:104: 00010000:00010000:2.0:1788843923.445048:0:22694:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.133@tcp lock: ffff9bd007946800/0xa762dfcbd58d2c28 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xa762dfcbd58d2c2f expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843923.445098:0:22694:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788843923.445104:0:22694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1054e0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0ce589ba-8334-438e-8f48-13932fcba8b1+5:25744:x1875738134590464:12345-0@lo:104: Request processed in 63us (815us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843923.445111:0:22694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788843923.445125:0:22694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788843923.445130:0:22694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1054e1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0ce589ba-8334-438e-8f48-13932fcba8b1+4:25744:x1875738134590592:12345-0@lo:104: 00010000:00010000:2.0:1788843923.445138:0:22694:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.133@tcp lock: ffff9bd1420e4800/0xa762dfcbd58d2be9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xa762dfcbd58d2bf0 expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843923.445198:0:22694:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1788843923.445203:0:22694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1054e1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0ce589ba-8334-438e-8f48-13932fcba8b1+4:25744:x1875738134590592:12345-0@lo:104: Request processed in 74us (855us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843923.445278:0:22694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788843923.445291:0:22694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788843923.445298:0:22694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1054e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0ce589ba-8334-438e-8f48-13932fcba8b1+3:25744:x1875738134590720:12345-0@lo:104: 00010000:00010000:2.0:1788843923.445306:0:22694:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.133@tcp lock: ffff9bd007947000/0xa762dfcbd58d2bdb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xa762dfcbd58d2be2 expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843923.445335:0:22694:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1788843923.445339:0:22694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1054e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0ce589ba-8334-438e-8f48-13932fcba8b1+3:25744:x1875738134590720:12345-0@lo:104: Request processed in 44us (932us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843923.445344:0:22694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:2.0:1788843923.445362:0:23471:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1788843923.445368:0:23471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.133@tcp lock: ffff9bd10f7ae600/0xa762dfcbd58d2da2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xa762dfcbd58d2da9 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843923.445387:0:23471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd10f7ae600 already unused, calling callback (ffffffffc12a7c20) 10000000:00010000:2.0:1788843923.445392:0:23471:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.133@tcp lock: ffff9bd10f7ae600/0xa762dfcbd58d2da2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xa762dfcbd58d2da9 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843923.445401:0:23471:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.133@tcp lock: ffff9bd10f7ae600/0xa762dfcbd58d2da2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xa762dfcbd58d2da9 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788843923.445408:0:23471:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.133@tcp lock: ffff9bd10f7ae600/0xa762dfcbd58d2da2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xa762dfcbd58d2da9 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788843923.445415:0:23471:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788843923.445451:0:23471:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.133@tcp lock: ffff9bd10f7ae600/0xa762dfcbd58d2da2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa762dfcbd58d2da9 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843923.445458:0:23471:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788843923.445482:0:23471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.133@tcp lock: ffff9bd10f7ae600/0xa762dfcbd58d2da2 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa762dfcbd58d2da9 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843923.445490:0:23471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.133@tcp lock: ffff9bd10f7ae600/0xa762dfcbd58d2da2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa762dfcbd58d2da9 expref: -99 pid: 25038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843923.445509:0:23471:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788843923.445512:0:23471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.133@tcp lock: ffff9bd007946800/0xa762dfcbd58d2c28 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa762dfcbd58d2c2f expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843923.445518:0:23471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd007946800 already unused, calling callback (ffffffffc12a7c20) 10000000:00010000:2.0:1788843923.445521:0:23471:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.133@tcp lock: ffff9bd007946800/0xa762dfcbd58d2c28 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xa762dfcbd58d2c2f expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843923.445539:0:23471:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.133@tcp lock: ffff9bd007946800/0xa762dfcbd58d2c28 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xa762dfcbd58d2c2f expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788843923.445546:0:23471:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.133@tcp lock: ffff9bd007946800/0xa762dfcbd58d2c28 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xa762dfcbd58d2c2f expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788843923.445551:0:23471:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788843923.445565:0:23471:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.133@tcp lock: ffff9bd007946800/0xa762dfcbd58d2c28 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa762dfcbd58d2c2f expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843923.445571:0:23471:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788843923.445588:0:23471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.133@tcp lock: ffff9bd007946800/0xa762dfcbd58d2c28 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa762dfcbd58d2c2f expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843923.445594:0:23471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.133@tcp lock: ffff9bd007946800/0xa762dfcbd58d2c28 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa762dfcbd58d2c2f expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843923.445604:0:23471:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788843923.445608:0:23471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.133@tcp lock: ffff9bd1420e4800/0xa762dfcbd58d2be9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa762dfcbd58d2bf0 expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843923.445613:0:23471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd1420e4800 already unused, calling callback (ffffffffc12a7c20) 10000000:00010000:2.0:1788843923.445616:0:23471:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.133@tcp lock: ffff9bd1420e4800/0xa762dfcbd58d2be9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xa762dfcbd58d2bf0 expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843923.445623:0:23471:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.133@tcp lock: ffff9bd1420e4800/0xa762dfcbd58d2be9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xa762dfcbd58d2bf0 expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788843923.445628:0:23471:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.133@tcp lock: ffff9bd1420e4800/0xa762dfcbd58d2be9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xa762dfcbd58d2bf0 expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788843923.445640:0:23471:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788843923.445653:0:23471:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.133@tcp lock: ffff9bd1420e4800/0xa762dfcbd58d2be9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa762dfcbd58d2bf0 expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843923.445659:0:23471:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788843923.445666:0:23471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.133@tcp lock: ffff9bd1420e4800/0xa762dfcbd58d2be9 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa762dfcbd58d2bf0 expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843923.445672:0:23471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.133@tcp lock: ffff9bd1420e4800/0xa762dfcbd58d2be9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa762dfcbd58d2bf0 expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843923.445685:0:23471:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788843923.445688:0:23471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.133@tcp lock: ffff9bd007947000/0xa762dfcbd58d2bdb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa762dfcbd58d2be2 expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843923.445694:0:23471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd007947000 already unused, calling callback (ffffffffc12a7c20) 10000000:00010000:2.0:1788843923.445697:0:23471:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.133@tcp lock: ffff9bd007947000/0xa762dfcbd58d2bdb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa762dfcbd58d2be2 expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843923.445704:0:23471:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.133@tcp lock: ffff9bd007947000/0xa762dfcbd58d2bdb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa762dfcbd58d2be2 expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788843923.445710:0:23471:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.133@tcp lock: ffff9bd007947000/0xa762dfcbd58d2bdb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa762dfcbd58d2be2 expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788843923.445716:0:23471:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788843923.445728:0:23471:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.133@tcp lock: ffff9bd007947000/0xa762dfcbd58d2bdb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa762dfcbd58d2be2 expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843923.445734:0:23471:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788843923.445749:0:23471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.133@tcp lock: ffff9bd007947000/0xa762dfcbd58d2bdb lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa762dfcbd58d2be2 expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843923.445755:0:23471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.133@tcp lock: ffff9bd007947000/0xa762dfcbd58d2bdb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa762dfcbd58d2be2 expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843923.445771:0:23471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788843923.445773:0:23471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788843923.445775:0:23471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788843923.445783:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788843923.445789:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788843923.445812:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10fe20e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0ce589ba-8334-438e-8f48-13932fcba8b1:3633:1875738134590848:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788843923.446315:0:25744:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd1054e2d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25744:1875738134590336:0@lo:104: 00000100:00100000:1.0:1788843923.446326:0:25744:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd1054e1500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25744:1875738134590464:0@lo:104: 00000100:00100000:1.0:1788843923.446334:0:25744:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd1054e2680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25744:1875738134590592:0@lo:104: 00000100:00100000:1.0:1788843923.446343:0:25744:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd1054e3800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25744:1875738134590720:0@lo:104: 00000100:00100000:2.0:1788843923.446469:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843923.446520:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788843923.446527:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10fe21880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0ce589ba-8334-438e-8f48-13932fcba8b1:3633:1875738134591232:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788843923.446556:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843923.446590:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10fe23800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0ce589ba-8334-438e-8f48-13932fcba8b1:3630:1875738134590976:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788843923.446614:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843923.446635:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788843923.446641:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10fe22680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0ce589ba-8334-438e-8f48-13932fcba8b1:3630:1875738134591104:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788843923.446667:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843923.446700:0:22698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134590848 00000100:00100000:2.0:1788843923.446706:0:22698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134590848 00010000:00010000:2.0:1788843923.446740:0:22698:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bd007947c00/0xa762dfcbd58d2da9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa762dfcbd58d2da2 expref: 24 pid: 22706 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843923.446759:0:22698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134591232 00000100:00100000:2.0:1788843923.446762:0:22698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134591232 00010000:00010000:2.0:1788843923.446772:0:22698:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bd1153e7a00/0xa762dfcbd58d2be2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa762dfcbd58d2bdb expref: 25 pid: 22706 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843923.446795:0:22698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134590976 00000100:00100000:2.0:1788843923.446798:0:22698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134590976 00010000:00010000:2.0:1788843923.446808:0:22698:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bd1153e6a00/0xa762dfcbd58d2c2f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa762dfcbd58d2c28 expref: 26 pid: 22705 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843923.446818:0:22698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134591104 00000100:00100000:2.0:1788843923.446820:0:22698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134591104 00010000:00010000:2.0:1788843923.446829:0:22698:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bd1153e6600/0xa762dfcbd58d2bf0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa762dfcbd58d2be9 expref: 27 pid: 22706 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843923.446842:0:22698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788843923.447019:0:22698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10fe23b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0ce589ba-8334-438e-8f48-13932fcba8b1+27:3633:x1875738134590848:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788843923.447035:0:22698:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788843923.447041:0:22698:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bd007947c00/0xa762dfcbd58d2da9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa762dfcbd58d2da2 expref: 27 pid: 22706 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843923.447051:0:22698:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bd007947c00/0xa762dfcbd58d2da9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa762dfcbd58d2da2 expref: 27 pid: 22706 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843923.447069:0:22698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd007947c00/0xa762dfcbd58d2da9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa762dfcbd58d2da2 expref: 27 pid: 22706 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843923.447086:0:22698:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788843923.447274:0:23870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788843923.447283:0:23870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10fe20700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0ce589ba-8334-438e-8f48-13932fcba8b1+26:3633:x1875738134591232:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788843923.447291:0:23870:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788843923.447296:0:23870:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bd1153e7a00/0xa762dfcbd58d2be2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa762dfcbd58d2bdb expref: 26 pid: 22706 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843923.447305:0:23870:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bd1153e7a00/0xa762dfcbd58d2be2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa762dfcbd58d2bdb expref: 26 pid: 22706 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843923.447315:0:23870:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd1153e7a00/0xa762dfcbd58d2be2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa762dfcbd58d2bdb expref: 26 pid: 22706 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843923.447324:0:23870:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788843923.447804:0:22698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10fe23b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0ce589ba-8334-438e-8f48-13932fcba8b1+25:3633:x1875738134590848:12345-0@lo:103:ldlm_bl.0 Request processed in 787us (1333us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843923.447813:0:22698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788843923.447836:0:22698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788843923.447843:0:22698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10fe22a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0ce589ba-8334-438e-8f48-13932fcba8b1+24:3630:x1875738134590976:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788843923.447945:0:22698:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788843923.447952:0:22698:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bd1153e6a00/0xa762dfcbd58d2c2f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa762dfcbd58d2c28 expref: 24 pid: 22705 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843923.447962:0:22698:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bd1153e6a00/0xa762dfcbd58d2c2f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa762dfcbd58d2c28 expref: 24 pid: 22705 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843923.447973:0:22698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd1153e6a00/0xa762dfcbd58d2c2f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa762dfcbd58d2c28 expref: 24 pid: 22705 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843923.447984:0:22698:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788843923.448035:0:22698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10fe22a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0ce589ba-8334-438e-8f48-13932fcba8b1+23:3630:x1875738134590976:12345-0@lo:103:ldlm_bl.0 Request processed in 192us (1419us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843923.448041:0:22698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788843923.448056:0:22698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788843923.448062:0:22698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10fe20000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0ce589ba-8334-438e-8f48-13932fcba8b1+22:3630:x1875738134591104:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788843923.448090:0:22698:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788843923.448095:0:22698:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bd1153e6600/0xa762dfcbd58d2bf0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa762dfcbd58d2be9 expref: 22 pid: 22706 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843923.448104:0:22698:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bd1153e6600/0xa762dfcbd58d2bf0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa762dfcbd58d2be9 expref: 22 pid: 22706 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843923.448115:0:22698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd1153e6600/0xa762dfcbd58d2bf0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa762dfcbd58d2be9 expref: 22 pid: 22706 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843923.448124:0:22698:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788843923.448164:0:22698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10fe20000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0ce589ba-8334-438e-8f48-13932fcba8b1+21:3630:x1875738134591104:12345-0@lo:103:ldlm_bl.0 Request processed in 102us (1496us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843923.448180:0:22698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788843923.448519:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10fe22680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0ce589ba-8334-438e-8f48-13932fcba8b1:3630:1875738134591104:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788843923.448531:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10fe23800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0ce589ba-8334-438e-8f48-13932fcba8b1:3630:1875738134590976:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788843923.448713:0:25744:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd1054e3480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25744:1875738134590080:192.168.203.33@tcp:104: 00000100:00100000:1.0:1788843923.448954:0:23870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10fe20700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0ce589ba-8334-438e-8f48-13932fcba8b1+20:3633:x1875738134591232:12345-0@lo:103:ldlm_bl.0 Request processed in 1671us (2396us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843923.448963:0:23870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788843923.449022:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10fe20e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0ce589ba-8334-438e-8f48-13932fcba8b1:3633:1875738134590848:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788843923.449042:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10fe21880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0ce589ba-8334-438e-8f48-13932fcba8b1:3633:1875738134591232:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788843923.453479:0:25744:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd1054e3b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25744:1875738134590208:192.168.203.33@tcp:104: 00010000:00010000:1.0:1788843923.453535:0:25744:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9bd13fbeb200/0xa762dfcbd58d2f85 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 25744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843923.460924:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843923.461227:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843923.463846:0:22697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116646016 00000100:00100000:3.0:1788843923.463865:0:22697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116646016 00000100:00100000:1.0:1788843923.463917:0:22698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116645888 00010000:00010000:3.0:1788843923.463925:0:22697:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bd007be3c00/0xa762dfcbd58d2f15 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490e91 expref: 13 pid: 22706 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843923.463973:0:22697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 13 00000100:00100000:3.0:1788843923.463984:0:22697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10fe20a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:efb31ab2-ab0a-4b00-9471-3fc304e37c6a+13:2390:x1875738116646016:12345-192.168.203.33@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1788843923.463984:0:22698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116645888 00010000:00010000:3.0:1788843923.464011:0:22697:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788843923.464013:0:22698:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bd007be3400/0xa762dfcbd58d2f54 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490f01 expref: 14 pid: 22706 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843923.464018:0:22697:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bd007be3c00/0xa762dfcbd58d2f15 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490e91 expref: 14 pid: 22706 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843923.464030:0:22697:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bd007be3c00/0xa762dfcbd58d2f15 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490e91 expref: 14 pid: 22706 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843923.464061:0:22697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd007be3c00/0xa762dfcbd58d2f15 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490e91 expref: 14 pid: 22706 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843923.464079:0:22698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 14 00010000:00010000:3.0:1788843923.464082:0:22697:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788843923.464086:0:22698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd11504ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:efb31ab2-ab0a-4b00-9471-3fc304e37c6a+13:2389:x1875738116645888:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788843923.464094:0:22698:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788843923.464098:0:22698:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bd007be3400/0xa762dfcbd58d2f54 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490f01 expref: 13 pid: 22706 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843923.464106:0:22698:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bd007be3400/0xa762dfcbd58d2f54 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490f01 expref: 13 pid: 22706 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843923.464116:0:22698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd007be3400/0xa762dfcbd58d2f54 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490f01 expref: 13 pid: 22706 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843923.464127:0:22698:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9bd13fbeb200/0xa762dfcbd58d2f85 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 25744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843923.464135:0:22698:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd13fbeb200/0xa762dfcbd58d2f85 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 25744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843923.464166:0:22697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10fe20a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:efb31ab2-ab0a-4b00-9471-3fc304e37c6a+12:2390:x1875738116646016:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 183us (2938us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843923.464175:0:22697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 13 00010000:00010000:1.0:1788843923.464338:0:22698:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9bd13fbeb200/0xa762dfcbd58d2f85 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 25744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843923.464346:0:22698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9bd13fbeb200/0xa762dfcbd58d2f85 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 25744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843923.464352:0:22698:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9bd13fbeb200/0xa762dfcbd58d2f85 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 25744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843923.464369:0:22698:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9bd13fbeb200/0xa762dfcbd58d2f85 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 25744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843923.464375:0:22698:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd13fbeb200 already unused, calling callback (ffffffffc0cb1420) 00010000:00010000:1.0:1788843923.464379:0:22698:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9bd13fbeb200/0xa762dfcbd58d2f85 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 25744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843923.464387:0:22698:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9bd13fbeb200/0xa762dfcbd58d2f85 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 25744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843923.464402:0:22698:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9bd13fbeb200/0xa762dfcbd58d2f85 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843923.464414:0:22698:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788843923.464437:0:22698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd11504ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:efb31ab2-ab0a-4b00-9471-3fc304e37c6a+11:2389:x1875738116645888:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 351us (3526us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843923.464443:0:22698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 14 00010000:00010000:0.0:1788843923.466377:0:25744:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9bd13fbeb200/0xa762dfcbd58d2f85 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843923.466399:0:25744:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9bd13fbeb200/0xa762dfcbd58d2f85 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843923.466406:0:25744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd13fbeb200/0xa762dfcbd58d2f85 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788843923.802953:0:23469:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788843924.058336:0:23471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788843924.390052:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd14165ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1875738134591744:0@lo:400:kworker.0 00000100:00100000:0.0:1788843924.390124:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843924.390186:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd14165f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1875738134592256:0@lo:400:kworker.0 00000100:00100000:0.0:1788843924.390221:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843924.390237:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd14165f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3632:1875738134592768:0@lo:400:kworker.0 00000100:00100000:0.0:1788843924.390259:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843924.390297:0:3632:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:0.0:1788843924.390310:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd1054e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1875738134591360:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788843924.390334:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843924.390351:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd14165ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1875738134591872:0@lo:400:kworker.0 00000100:00100000:0.0:1788843924.390373:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843924.390388:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd14165d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1875738134592384:0@lo:400:kworker.0 00000100:00100000:0.0:1788843924.390421:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843924.390436:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd14165c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3632:1875738134592896:0@lo:400:kworker.0 00000100:00100000:0.0:1788843924.390454:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843924.390485:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134592768 00000100:00100000:0.0:1788843924.390492:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134592768 00000100:00100000:0.0:1788843924.390553:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134592896 00000100:00100000:0.0:1788843924.390557:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134592896 00000100:00100000:0.0:1788843924.390576:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788843924.390586:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd14165df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3632:x1875738134592768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788843924.390649:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd14165df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3632:x1875738134592768:12345-0@lo:400:kworker.0 Request processed in 64us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843924.390657:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788843924.390675:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788843924.390681:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141ae9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3632:x1875738134592896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788843924.390708:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141ae9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3632:x1875738134592896:12345-0@lo:400:kworker.0 Request processed in 28us (253us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843924.390713:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788843924.390739:0:24226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134591360 00000100:00100000:0.0:1788843924.390742:0:24226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134591360 00000100:00100000:0.0:1788843924.390783:0:24226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788843924.390789:0:24226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd14165e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3632:x1875738134591360:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788843924.390811:0:24226:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1788843924.390843:0:24226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd14165e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3632:x1875738134591360:12345-0@lo:13:osp-pre-1-1.0 Request processed in 54us (508us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843924.390850:0:24226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788843924.390867:0:24222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134591744 00000100:00100000:0.0:1788843924.390870:0:24222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134591744 00000100:00100000:0.0:1788843924.390887:0:24222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134592256 00000100:00100000:0.0:1788843924.390890:0:24222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134592256 00000100:00100000:0.0:1788843924.390900:0:24222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134591872 00000100:00100000:0.0:1788843924.390903:0:24222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134591872 00000100:00100000:0.0:1788843924.390915:0:24222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134592384 00000100:00100000:0.0:1788843924.390917:0:24222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134592384 00000100:00100000:0.0:1788843924.390927:0:24222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788843924.390933:0:24222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd14165e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3632:x1875738134591744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788843924.390960:0:24222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd14165e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3632:x1875738134591744:12345-0@lo:400:kworker.0 Request processed in 27us (837us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843924.390966:0:24222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788843924.390988:0:24222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788843924.390995:0:24222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd14165ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3632:x1875738134592256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788843924.391020:0:24222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd14165ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3632:x1875738134592256:12345-0@lo:400:kworker.0 Request processed in 27us (799us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843924.391026:0:24222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788843924.391036:0:24222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788843924.391041:0:24222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f954a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3632:x1875738134591872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788843924.391071:0:24222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f954a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3632:x1875738134591872:12345-0@lo:400:kworker.0 Request processed in 30us (698us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843924.391078:0:24222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788843924.391089:0:24222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788843924.391094:0:24222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141aeb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3632:x1875738134592384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788843924.391115:0:24222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141aeb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3632:x1875738134592384:12345-0@lo:400:kworker.0 Request processed in 22us (694us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843924.391121:0:24222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:0.0:1788843924.391161:0:22707:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788843924.391165:0:22707:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788843924.391167:0:22707:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788843924.391169:0:22707:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788843924.391208:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd1054e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1875738134591360:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788843924.391220:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd14165ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1875738134591872:0@lo:400:kworker.0 00000100:00100000:0.0:1788843924.391229:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd14165d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1875738134592384:0@lo:400:kworker.0 00000100:00100000:0.0:1788843924.391237:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd14165c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3632:1875738134592896:0@lo:400:kworker.0 00000100:00100000:0.0:1788843924.391245:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd14165ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1875738134591744:0@lo:400:kworker.0 00000100:00100000:0.0:1788843924.391253:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd14165f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1875738134592256:0@lo:400:kworker.0 00010000:00080000:0.0:1788843924.391264:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd14165f480 x1875738134592768/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843940 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788843924.391275:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd14165f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3632:1875738134592768:0@lo:400:kworker.0 00000100:00100000:0.0:1788843924.391324:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd14165d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1875738134591616:0@lo:400:kworker.0 00000100:00100000:0.0:1788843924.391354:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843924.391382:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd14165dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1875738134592128:0@lo:400:kworker.0 00000100:00100000:0.0:1788843924.391402:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843924.391416:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd14165d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3631:1875738134592640:0@lo:400:kworker.0 00000100:00100000:0.0:1788843924.391434:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843924.391451:0:3631:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:0.0:1788843924.391456:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd14165f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0ce589ba-8334-438e-8f48-13932fcba8b1:3631:1875738134591488:0@lo:400:kworker.0 00000100:00100000:0.0:1788843924.391479:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843924.391502:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd14165fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3631:1875738134592000:0@lo:400:kworker.0 00000100:00100000:0.0:1788843924.391519:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843924.391533:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd14165c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3631:1875738134592512:0@lo:400:kworker.0 00000100:00100000:0.0:1788843924.391556:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843924.391570:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd14165ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3631:1875738134593024:0@lo:400:kworker.0 00000100:00100000:0.0:1788843924.391591:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843924.391611:0:23743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134591616 00000100:00100000:0.0:1788843924.391614:0:23743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134591616 00000100:00100000:0.0:1788843924.391639:0:23743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134592128 00000100:00100000:0.0:1788843924.391642:0:23743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134592128 00000100:00100000:0.0:1788843924.391655:0:23743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788843924.391661:0:23743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141ae8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3631:x1875738134591616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788843924.391698:0:23743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141ae8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3631:x1875738134591616:12345-0@lo:400:kworker.0 Request processed in 37us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843924.391703:0:23743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788843924.391714:0:23743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788843924.391720:0:23743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141ae9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3631:x1875738134592128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788843924.391745:0:23743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141ae9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3631:x1875738134592128:12345-0@lo:400:kworker.0 Request processed in 26us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843924.391759:0:23743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788843924.391781:0:25511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134592640 00000100:00100000:0.0:1788843924.391784:0:25511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134592640 00000100:00100000:0.0:1788843924.391804:0:25511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134592000 00000100:00100000:0.0:1788843924.391807:0:25511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134592000 00000100:00100000:0.0:1788843924.391815:0:25511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134592512 00000100:00100000:0.0:1788843924.391817:0:25511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134592512 00000100:00100000:0.0:1788843924.391824:0:25511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134593024 00000100:00100000:0.0:1788843924.391827:0:25511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134593024 00000100:00100000:0.0:1788843924.391838:0:25511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788843924.391843:0:25511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141aebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3631:x1875738134592640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788843924.391872:0:25511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141aebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3631:x1875738134592640:12345-0@lo:400:kworker.0 Request processed in 29us (437us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843924.391878:0:25511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788843924.391888:0:25511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788843924.391893:0:25511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141aea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3631:x1875738134592000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788843924.391916:0:25511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141aea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3631:x1875738134592000:12345-0@lo:400:kworker.0 Request processed in 23us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843924.391922:0:25511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788843924.391932:0:25511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788843924.391938:0:25511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141aead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3631:x1875738134592512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788843924.391961:0:25511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141aead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3631:x1875738134592512:12345-0@lo:400:kworker.0 Request processed in 24us (405us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843924.391967:0:25511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788843924.391977:0:25511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788843924.391995:0:25511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141aeaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3631:x1875738134593024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788843924.392041:0:25511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141aeaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3631:x1875738134593024:12345-0@lo:400:kworker.0 Request processed in 47us (449us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843924.392047:0:25511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00080000:0.0:1788843924.392063:0:22707:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788843924.392066:0:22707:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788843924.392084:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd14165fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3631:1875738134592000:0@lo:400:kworker.0 00000100:00100000:0.0:1788843924.392093:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd14165c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3631:1875738134592512:0@lo:400:kworker.0 00010000:00080000:0.0:1788843924.392102:0:3631:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd14165ed80 x1875738134593024/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843940 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788843924.392112:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd14165ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3631:1875738134593024:0@lo:400:kworker.0 00000100:00100000:0.0:1788843924.392120:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd14165d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1875738134591616:0@lo:400:kworker.0 00000100:00100000:0.0:1788843924.392128:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd14165dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1875738134592128:0@lo:400:kworker.0 00000100:00100000:0.0:1788843924.392136:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd14165d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3631:1875738134592640:0@lo:400:kworker.0 00000100:00100000:3.0:1788843924.393185:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134591488 00000100:00100000:3.0:1788843924.393195:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134591488 00000100:00100000:3.0:1788843924.393236:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1788843924.393244:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007357850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ce589ba-8334-438e-8f48-13932fcba8b1+20:3631:x1875738134591488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788843924.393332:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007357850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ce589ba-8334-438e-8f48-13932fcba8b1+20:3631:x1875738134591488:12345-0@lo:400:kworker.0 Request processed in 89us (1851us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843924.393340:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1788843924.393437:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd14165f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0ce589ba-8334-438e-8f48-13932fcba8b1:3631:1875738134591488:0@lo:400:kworker.0 00000100:00100000:3.0:1788843924.401163:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788843924.401188:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10fe21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1875738134593152:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788843924.401259:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843924.403378:0:24226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134593152 00000100:00100000:0.0:1788843924.403391:0:24226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134593152 00000100:00100000:0.0:1788843924.403473:0:24226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788843924.403484:0:24226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007768e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3630:x1875738134593152:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788843924.403511:0:24226:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1788843924.403599:0:24226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007768e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3630:x1875738134593152:12345-0@lo:13:osp-pre-1-0.0 Request processed in 107us (2331us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843924.403607:0:24226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788843924.404103:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10fe21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1875738134593152:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788843925.021315:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1788843925.022122:0:25511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116646144 00000100:00100000:0.0:1788843925.022138:0:25511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116646144 00000100:00100000:0.0:1788843925.022364:0:25511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 23 00000100:00100000:0.0:1788843925.022396:0:25511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007769500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a6e673fb-9566-47bf-b86a-d710f4950716+6:18695:x1875738116646144:12345-192.168.203.33@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788843925.022418:0:25511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788843925.022443:0:25511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd00873b200/0xa762dfcbd58d2f8c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf24d95f22490f39 expref: -99 pid: 25511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843925.022544:0:25511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd00873a200/0xa762dfcbd58d2f93 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843925.022562:0:25511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd00873a200/0xa762dfcbd58d2f93 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843925.022577:0:25511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd00873a200/0xa762dfcbd58d2f93 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843925.022593:0:25511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd00873bc00/0xa762dfcbd58d2f9a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843925.022600:0:25511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd00873bc00/0xa762dfcbd58d2f9a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843925.022608:0:25511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd00873bc00/0xa762dfcbd58d2f9a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25511 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788843925.022765:0:22707:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788843925.023329:0:25511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd00873b000/0xa762dfcbd58d2fa1 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843925.023343:0:25511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd00873b000/0xa762dfcbd58d2fa1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843925.023351:0:25511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd00873b000/0xa762dfcbd58d2fa1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788843925.023402:0:25511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788843925.023407:0:25511:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788843925.024066:0:25511:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bd00873b000/0xa762dfcbd58d2fa1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843925.024082:0:25511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd00873a200/0xa762dfcbd58d2f93 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843925.024089:0:25511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd00873a200/0xa762dfcbd58d2f93 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843925.024095:0:25511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd00873a200/0xa762dfcbd58d2f93 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843925.024101:0:25511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd00873a200 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1788843925.024105:0:25511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd00873a200/0xa762dfcbd58d2f93 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843925.024114:0:25511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd00873a200/0xa762dfcbd58d2f93 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843925.024129:0:25511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bd00746b600) 00010000:00010000:0.0:1788843925.024133:0:25511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788843925.024138:0:25511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd00873a200/0xa762dfcbd58d2f93 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843925.024176:0:25511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd00873a200/0xa762dfcbd58d2f93 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843925.024194:0:25511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd00873bc00/0xa762dfcbd58d2f9a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843925.024215:0:25511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd00873bc00/0xa762dfcbd58d2f9a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843925.024221:0:25511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd00873bc00/0xa762dfcbd58d2f9a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843925.024226:0:25511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd00873bc00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1788843925.024229:0:25511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd00873bc00/0xa762dfcbd58d2f9a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843925.024235:0:25511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd00873bc00/0xa762dfcbd58d2f9a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843925.024244:0:25511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9bd00746ca00) 00010000:00010000:0.0:1788843925.024246:0:25511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788843925.024258:0:25511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd00873bc00/0xa762dfcbd58d2f9a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843925.024265:0:25511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd00873bc00/0xa762dfcbd58d2f9a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843925.024314:0:25511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd00873b200/0xa762dfcbd58d2f8c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490f39 expref: 8 pid: 25511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843925.024330:0:25511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd00873b000/0xa762dfcbd58d2fa1 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490f39 expref: 7 pid: 25511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843925.024337:0:25511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9bd00746c000) 00010000:00010000:0.0:1788843925.024339:0:25511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788843925.024348:0:25511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd00873b000, rc 0) 00000100:00100000:0.0:1788843925.024439:0:25511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007769500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a6e673fb-9566-47bf-b86a-d710f4950716+7:18695:x1875738116646144:12345-192.168.203.33@tcp:101:lhsmtool_posix.0 Request processed in 2045us (3136us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843925.025446:0:25511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 23 00000100:00100000:3.0:1788843925.034073:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1788843925.034192:0:22723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116646272 00000100:00100000:0.0:1788843925.034205:0:22723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116646272 00000100:00100000:0.0:1788843925.034276:0:22723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 5 00000100:00100000:0.0:1788843925.034287:0:22723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007769c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:a6e673fb-9566-47bf-b86a-d710f4950716+7:18695:x1875738116646272:12345-192.168.203.33@tcp:900:lhsmtool_posix.0 00000100:00100000:0.0:1788843925.034382:0:22723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007769c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:a6e673fb-9566-47bf-b86a-d710f4950716+7:18695:x1875738116646272:12345-192.168.203.33@tcp:900:lhsmtool_posix.0 Request processed in 96us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843925.034390:0:22723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 5 00000100:00100000:2.0:1788843925.036414:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1788843925.036571:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116646528 00000100:00100000:0.0:1788843925.036582:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116646528 00000100:00100000:0.0:1788843925.036660:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 24 00000100:00100000:0.0:1788843925.036670:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10fe21180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a6e673fb-9566-47bf-b86a-d710f4950716+7:18695:x1875738116646528:12345-192.168.203.33@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788843925.036689:0:22711:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788843925.036712:0:22711:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd00873b200/0xa762dfcbd58d2fa8 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf24d95f22490f40 expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843925.036801:0:22711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd00873bc00/0xa762dfcbd58d2faf lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843925.036817:0:22711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd00873bc00/0xa762dfcbd58d2faf lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843925.036830:0:22711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd00873bc00/0xa762dfcbd58d2faf lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843925.036846:0:22711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd00873a200/0xa762dfcbd58d2fb6 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843925.036871:0:22711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd00873a200/0xa762dfcbd58d2fb6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843925.036878:0:22711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd00873a200/0xa762dfcbd58d2fb6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843925.037037:0:22711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd00873ba00/0xa762dfcbd58d2fbd lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843925.037046:0:22711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd00873ba00/0xa762dfcbd58d2fbd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843925.037052:0:22711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd00873ba00/0xa762dfcbd58d2fbd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788843925.037062:0:22711:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:1.0:1788843925.037797:0:22711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd00873bc00/0xa762dfcbd58d2faf lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843925.037812:0:22711:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd00873bc00/0xa762dfcbd58d2faf lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843925.037820:0:22711:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd00873bc00/0xa762dfcbd58d2faf lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843925.037827:0:22711:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd00873bc00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1788843925.037832:0:22711:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd00873bc00/0xa762dfcbd58d2faf lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843925.037849:0:22711:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd00873bc00/0xa762dfcbd58d2faf lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843925.037864:0:22711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9bd00746c000) 00010000:00010000:1.0:1788843925.037867:0:22711:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788843925.037871:0:22711:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd00873bc00/0xa762dfcbd58d2faf lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843925.037877:0:22711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd00873bc00/0xa762dfcbd58d2faf lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843925.037892:0:22711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd00873a200/0xa762dfcbd58d2fb6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843925.037897:0:22711:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd00873a200/0xa762dfcbd58d2fb6 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843925.037904:0:22711:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd00873a200/0xa762dfcbd58d2fb6 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843925.037908:0:22711:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd00873a200 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1788843925.037911:0:22711:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd00873a200/0xa762dfcbd58d2fb6 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843925.037917:0:22711:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd00873a200/0xa762dfcbd58d2fb6 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843925.037923:0:22711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9bd00746ca00) 00010000:00010000:1.0:1788843925.037926:0:22711:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788843925.037929:0:22711:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd00873a200/0xa762dfcbd58d2fb6 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843925.037945:0:22711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd00873a200/0xa762dfcbd58d2fb6 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843925.038881:0:22711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd00873b200/0xa762dfcbd58d2fa8 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490f40 expref: 10 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843925.038905:0:22711:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd00873ba00/0xa762dfcbd58d2fbd lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490f40 expref: 9 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843925.038913:0:22711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9bd00746c700) 00010000:00010000:1.0:1788843925.038915:0:22711:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788843925.038918:0:22711:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd00873ba00, rc 0) 00000100:00100000:1.0:1788843925.038998:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10fe21180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a6e673fb-9566-47bf-b86a-d710f4950716+9:18695:x1875738116646528:12345-192.168.203.33@tcp:101:lhsmtool_posix.0 Request processed in 2329us (2595us total) trans 12884901889 rc 0/0 00000100:00100000:1.0:1788843925.039007:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 24 00000100:00100000:3.0:1788843925.053334:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1788843925.053797:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116646656 00000100:00100000:1.0:1788843925.053810:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116646656 00000100:00100000:1.0:1788843925.053875:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 25 00000100:00100000:1.0:1788843925.053887:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f986300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a6e673fb-9566-47bf-b86a-d710f4950716+9:18695:x1875738116646656:12345-192.168.203.33@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1788843925.054027:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f986300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a6e673fb-9566-47bf-b86a-d710f4950716+9:18695:x1875738116646656:12345-192.168.203.33@tcp:59:lhsmtool_posix.0 Request processed in 141us (707us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843925.054035:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 25 00000100:00100000:3.0:1788843925.060441:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1788843925.060657:0:22713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116646784 00000100:00100000:1.0:1788843925.060669:0:22713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116646784 00000100:00100000:1.0:1788843925.060760:0:22713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 26 00000100:00100000:1.0:1788843925.060772:0:22713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f987100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a6e673fb-9566-47bf-b86a-d710f4950716+5:18695:x1875738116646784:12345-192.168.203.33@tcp:59:lhsmtool_posix.0 00000100:00080000:2.0:1788843925.061006:0:22707:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000004:00080000:1.0:1788843925.062104:0:22713:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 1263us 00000100:00100000:2.0:1788843925.083180:0:22713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f987100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a6e673fb-9566-47bf-b86a-d710f4950716+5:18695:x1875738116646784:12345-192.168.203.33@tcp:59:lhsmtool_posix.0 Request processed in 22399us (22743us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843925.083196:0:22713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 26 00010000:00010000:0.0:1788843925.087338:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788843925.107824:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1788843925.114470:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116646912 00000100:00100000:1.0:1788843925.114484:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116646912 00000100:00100000:1.0:1788843925.114549:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 27 00000100:00100000:1.0:1788843925.114559:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10fe21c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a6e673fb-9566-47bf-b86a-d710f4950716+9:18701:x1875738116646912:12345-192.168.203.33@tcp:101:lfs.0 00010000:00010000:1.0:1788843925.114582:0:22712:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788843925.114604:0:22712:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbea200/0xa762dfcbd58d2fcb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf24d95f22490f47 expref: -99 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843925.114679:0:22712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbeae00/0xa762dfcbd58d2fd2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843925.114694:0:22712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbeae00/0xa762dfcbd58d2fd2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843925.114705:0:22712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbeae00/0xa762dfcbd58d2fd2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843925.114720:0:22712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbeac00/0xa762dfcbd58d2fd9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843925.114728:0:22712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbeac00/0xa762dfcbd58d2fd9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843925.114736:0:22712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbeac00/0xa762dfcbd58d2fd9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843925.114779:0:22712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbeae00/0xa762dfcbd58d2fd2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843925.114803:0:22712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbeae00/0xa762dfcbd58d2fd2 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843925.114810:0:22712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbeae00/0xa762dfcbd58d2fd2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843925.114816:0:22712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd13fbeae00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1788843925.114820:0:22712:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbeae00/0xa762dfcbd58d2fd2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843925.114828:0:22712:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbeae00/0xa762dfcbd58d2fd2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843925.114851:0:22712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bd00746b600) 00010000:00010000:1.0:1788843925.114855:0:22712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788843925.114860:0:22712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbeae00/0xa762dfcbd58d2fd2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843925.114866:0:22712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbeae00/0xa762dfcbd58d2fd2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843925.114881:0:22712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbeac00/0xa762dfcbd58d2fd9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843925.114888:0:22712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbeac00/0xa762dfcbd58d2fd9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843925.114895:0:22712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbeac00/0xa762dfcbd58d2fd9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843925.114899:0:22712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd13fbeac00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1788843925.114907:0:22712:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbeac00/0xa762dfcbd58d2fd9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843925.114913:0:22712:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbeac00/0xa762dfcbd58d2fd9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843925.114921:0:22712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9bd00746bf00) 00010000:00010000:1.0:1788843925.114924:0:22712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788843925.114926:0:22712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbeac00/0xa762dfcbd58d2fd9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843925.114932:0:22712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbeac00/0xa762dfcbd58d2fd9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843925.114964:0:22712:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbea200/0xa762dfcbd58d2fcb lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490f47 expref: 10 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843925.115539:0:22712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bd00746b600) 00010000:00010000:1.0:1788843925.115543:0:22712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788843925.115548:0:22712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbea200/0xa762dfcbd58d2fcb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490f47 expref: 10 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843925.115559:0:22712:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd13fbea200, rc 0) 00000100:00100000:1.0:1788843925.116252:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10fe21c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a6e673fb-9566-47bf-b86a-d710f4950716+9:18701:x1875738116646912:12345-192.168.203.33@tcp:101:lfs.0 Request processed in 1691us (8435us total) trans 0 rc 301/301 00000100:00100000:1.0:1788843925.116261:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 27 00000100:00100000:0.0:1788843925.129239:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843925.129374:0:22720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116647040 00000100:00100000:3.0:1788843925.129387:0:22720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116647040 00000100:00100000:3.0:1788843925.129439:0:22720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 0 00000100:00100000:3.0:1788843925.129449:0:22720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141aea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:a6e673fb-9566-47bf-b86a-d710f4950716+9:18701:x1875738116647040:12345-192.168.203.33@tcp:700:lfs.0 00000100:00100000:3.0:1788843925.129571:0:22720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141aea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:a6e673fb-9566-47bf-b86a-d710f4950716+9:18701:x1875738116647040:12345-192.168.203.33@tcp:700:lfs.0 Request processed in 123us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843925.129580:0:22720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 0 00000100:00100000:2.0:1788843925.133291:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1788843925.133406:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116647296 00000100:00100000:0.0:1788843925.133418:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116647296 00000100:00100000:0.0:1788843925.133715:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 28 00000100:00100000:0.0:1788843925.133728:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10fe20380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a6e673fb-9566-47bf-b86a-d710f4950716+9:18701:x1875738116647296:12345-192.168.203.33@tcp:36:lfs.0 00010000:00010000:0.0:1788843925.133799:0:22711:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788843925.133832:0:22711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbebe00/0xa762dfcbd58d2f3f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490ec2 expref: 9 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843925.133853:0:22711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bd00746b600) 00010000:00010000:0.0:1788843925.133859:0:22711:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788843925.133931:0:22711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd00873a000/0xa762dfcbd58d2fe0 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843925.133962:0:22711:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd00873b600/0xa762dfcbd58d2f7e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490f32 expref: 5 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843925.133971:0:22711:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd00873a000/0xa762dfcbd58d2fe0 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843925.134018:0:22711:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bd00873b600/0xa762dfcbd58d2f7e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490f32 expref: 5 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843925.134035:0:22711:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd00873b600/0xa762dfcbd58d2f7e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490f32 expref: 5 pid: 22713 timeout: 803 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843925.134050:0:22711:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd141aeb800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22711:1875738134593280:192.168.203.33@tcp:104: 00000100:00100000:0.0:1788843925.134299:0:22711:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd10764a240 going to sleep for 11 seconds 00000100:00100000:0.0:1788843925.147703:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843925.147830:0:23870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116647424 00000100:00100000:3.0:1788843925.147841:0:23870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116647424 00010000:00010000:3.0:1788843925.147910:0:23870:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd00873b600/0xa762dfcbd58d2f7e lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490f32 expref: 6 pid: 22713 timeout: 803 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843925.147958:0:23870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 15 00000100:00100000:3.0:1788843925.147969:0:23870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141ae8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d1bbae83-8212-4d8d-abaf-75a84733a0c2+6:2390:x1875738116647424:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788843925.147996:0:23870:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788843925.148022:0:23870:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bd00873b600/0xa762dfcbd58d2f7e lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490f32 expref: 6 pid: 22713 timeout: 803 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843925.148037:0:23870:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bd00873b600/0xa762dfcbd58d2f7e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490f32 expref: 6 pid: 22713 timeout: 803 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843925.148065:0:23870:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bd00746b600) 00010000:00010000:3.0:1788843925.148070:0:23870:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd00873a000/0xa762dfcbd58d2fe0 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843925.148082:0:23870:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd00873a000/0xa762dfcbd58d2fe0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843925.148090:0:23870:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd00873a000/0xa762dfcbd58d2fe0 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788843925.148199:0:22707:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788843925.148261:0:23870:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788843925.148318:0:23870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141ae8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d1bbae83-8212-4d8d-abaf-75a84733a0c2+6:2390:x1875738116647424:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 350us (627us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843925.148327:0:23870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 15 00010000:00010000:1.0:1788843925.149749:0:22711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd00873b600/0xa762dfcbd58d2f7e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490f32 expref: 5 pid: 22713 timeout: 803 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843925.149775:0:22711:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd141aeb800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22711:1875738134593280:192.168.203.33@tcp:104: 00010000:00010000:1.0:1788843925.149820:0:22711:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bd00873a000/0xa762dfcbd58d2fe0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843925.149830:0:22711:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bd00873a000/0xa762dfcbd58d2fe0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843925.149836:0:22711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd00873a000/0xa762dfcbd58d2fe0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843925.149864:0:22711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbea200/0xa762dfcbd58d2fe7 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843925.149877:0:22711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbea200/0xa762dfcbd58d2fe7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843925.149887:0:22711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbea200/0xa762dfcbd58d2fe7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843925.153600:0:22711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd00873be00/0xa762dfcbd58d2fee lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843925.153630:0:22711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd00873be00/0xa762dfcbd58d2fee lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843925.153654:0:22711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd00873be00/0xa762dfcbd58d2fee lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788843925.153676:0:22711:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d1362de2 reply state 00000000f4421aa8 transno 12884901890 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd00873be00/0xa762dfcbd58d2fee lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843925.153688:0:22711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd00873be00/0xa762dfcbd58d2fee lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843925.153704:0:22711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9bd00746cd00) 00010000:00010000:0.0:1788843925.153707:0:22711:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788843925.153711:0:22711:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1788843925.153718:0:22711:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1788843925.153728:0:22711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd00873a000/0xa762dfcbd58d2fe0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843925.153735:0:22711:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd00873a000/0xa762dfcbd58d2fe0 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843925.153743:0:22711:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd00873a000/0xa762dfcbd58d2fe0 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843925.153750:0:22711:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd00873a000 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1788843925.153755:0:22711:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd00873a000/0xa762dfcbd58d2fe0 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843925.153765:0:22711:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd00873a000/0xa762dfcbd58d2fe0 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843925.153776:0:22711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bd00746b600) 00010000:00010000:0.0:1788843925.153779:0:22711:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788843925.153782:0:22711:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd00873a000/0xa762dfcbd58d2fe0 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843925.153788:0:22711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd00873a000/0xa762dfcbd58d2fe0 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788843925.153809:0:22711:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d1362de2 reply state 00000000f4421aa8 transno 12884901890 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbea200/0xa762dfcbd58d2fe7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843925.153829:0:22711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbea200/0xa762dfcbd58d2fe7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843925.153835:0:22711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9bd00746bf00) 00010000:00010000:0.0:1788843925.153838:0:22711:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788843925.153840:0:22711:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:0.0:1788843925.153954:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10fe20380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a6e673fb-9566-47bf-b86a-d710f4950716+10:18701:x1875738116647296:12345-192.168.203.33@tcp:36:lfs.0 Request processed in 20224us (20672us total) trans 12884901890 rc 0/0 00000100:00100000:0.0:1788843925.153964:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 28 00000100:00100000:0.0:1788843925.245511:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843925.249932:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116647552 00000100:00100000:2.0:1788843925.249951:0:22704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116647552 00000100:00100000:2.0:1788843925.250056:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 147 00000100:00100000:2.0:1788843925.250069:0:22704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0018b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efb31ab2-ab0a-4b00-9471-3fc304e37c6a+11:18076:x1875738116647552:12345-192.168.203.33@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788843925.250088:0:22704:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788843925.250113:0:22704:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd1153e6a00/0xa762dfcbd58d2ff5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xaf24d95f22490f4e expref: -99 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843925.250227:0:22704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd1153e6a00/0xa762dfcbd58d2ff5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490f4e expref: 12 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843925.250730:0:22704:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd1153e6a00/0xa762dfcbd58d2ff5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490f4e expref: 12 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843925.250763:0:22704:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd1153e6a00, rc 0) 00000100:00100000:2.0:1788843925.250850:0:22704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0018b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efb31ab2-ab0a-4b00-9471-3fc304e37c6a+12:18076:x1875738116647552:12345-192.168.203.33@tcp:101:ll_cfg_requeue.0 Request processed in 783us (5352us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843925.250857:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 147 00000100:00100000:2.0:1788843925.262102:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1788843925.262239:0:25511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116647680 00000100:00100000:0.0:1788843925.262250:0:25511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116647680 00000100:00100000:2.0:1788843925.262290:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1788843925.262316:0:25511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 29 00000100:00100000:0.0:1788843925.262327:0:25511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10fe23100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a6e673fb-9566-47bf-b86a-d710f4950716+10:18709:x1875738116647680:12345-192.168.203.33@tcp:101:lctl.0 00010000:00010000:0.0:1788843925.262353:0:25511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788843925.262382:0:25511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd00873b400/0xa762dfcbd58d2ffc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf24d95f22490f55 expref: -99 pid: 25511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843925.262481:0:25511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd00873b800/0xa762dfcbd58d3003 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 25511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843925.262497:0:25511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd00873b800/0xa762dfcbd58d3003 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843925.262510:0:25511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd00873b800/0xa762dfcbd58d3003 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788843925.262562:0:25511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788843925.262583:0:25511:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788843925.262631:0:25511:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bd00873b800/0xa762dfcbd58d3003 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843925.262660:0:25511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd00873b400/0xa762dfcbd58d2ffc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490f55 expref: 12 pid: 25511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843925.262681:0:25511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd00873b800/0xa762dfcbd58d3003 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490f55 expref: 11 pid: 25511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843925.262691:0:25511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bd00746cc00) 00010000:00010000:0.0:1788843925.262695:0:25511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788843925.262699:0:25511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd00873b800, rc 0) 00000100:00100000:0.0:1788843925.262771:0:25511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10fe23100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a6e673fb-9566-47bf-b86a-d710f4950716+11:18709:x1875738116647680:12345-192.168.203.33@tcp:101:lctl.0 Request processed in 445us (682us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843925.262779:0:25511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 29 00000100:00100000:3.0:1788843925.263191:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116647808 00000100:00100000:3.0:1788843925.263198:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116647808 00000100:00100000:3.0:1788843925.263238:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 148 00000100:00100000:3.0:1788843925.263245:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0018b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efb31ab2-ab0a-4b00-9471-3fc304e37c6a+12:18076:x1875738116647808:12345-192.168.203.33@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788843925.263366:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0018b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efb31ab2-ab0a-4b00-9471-3fc304e37c6a+12:18076:x1875738116647808:12345-192.168.203.33@tcp:501:ll_cfg_requeue.0 Request processed in 121us (1076us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843925.263373:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 148 00000100:00100000:0.0:1788843925.269773:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843925.270464:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116647936 00000100:00100000:2.0:1788843925.270478:0:22704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116647936 00000100:00100000:2.0:1788843925.270682:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 149 00000100:00100000:2.0:1788843925.270695:0:22704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0018b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efb31ab2-ab0a-4b00-9471-3fc304e37c6a+12:18076:x1875738116647936:12345-192.168.203.33@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788843925.270882:0:22704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0018b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efb31ab2-ab0a-4b00-9471-3fc304e37c6a+12:18076:x1875738116647936:12345-192.168.203.33@tcp:503:ll_cfg_requeue.0 Request processed in 189us (1121us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843925.270891:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 149 10000000:01000000:0.0:1788843925.286687:0:22708:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788843925.286697:0:22708:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9bd007334800 from 13 10000000:01000000:0.0:1788843925.286708:0:22708:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788843925.286769:0:22708:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd00873b400/0xa762dfcbd58d300a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843925.286782:0:22708:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.133@tcp lock: ffff9bd00873b400/0xa762dfcbd58d300a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843925.286793:0:22708:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.133@tcp lock: ffff9bd00873b400/0xa762dfcbd58d300a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843925.286821:0:22708:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd141ae9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ce589ba-8334-438e-8f48-13932fcba8b1:22708:1875738134593408:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788843925.286930:0:22708:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843925.287001:0:22708:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd10764acc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788843925.287134:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134593408 00000100:00100000:1.0:1788843925.287165:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134593408 00000100:00100000:1.0:1788843925.287229:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1788843925.287240:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0018b2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ce589ba-8334-438e-8f48-13932fcba8b1+20:22708:x1875738134593408:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788843925.287255:0:22705:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788843925.287271:0:22705:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd13fbeac00/0xa762dfcbd58d3011 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa762dfcbd58d300a expref: -99 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843925.287300:0:22705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd13fbeac00/0xa762dfcbd58d3011 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa762dfcbd58d300a expref: 21 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843925.287311:0:22705:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd13fbeac00/0xa762dfcbd58d3011 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa762dfcbd58d300a expref: 21 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843925.287333:0:22705:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd13fbeac00, rc 0) 00000100:00100000:1.0:1788843925.287393:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0018b2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ce589ba-8334-438e-8f48-13932fcba8b1+21:22708:x1875738134593408:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 154us (463us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843925.287400:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1788843925.287506:0:22708:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd141ae9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ce589ba-8334-438e-8f48-13932fcba8b1:22708:1875738134593408:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788843925.287522:0:22708:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.133@tcp lock: ffff9bd00873b400/0xa762dfcbd58d300a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d3011 expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843925.287532:0:22708:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.133@tcp lock: ffff9bd00873b400/0xa762dfcbd58d300a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa762dfcbd58d3011 expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843925.287603:0:22708:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10fe22d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ce589ba-8334-438e-8f48-13932fcba8b1:22708:1875738134593536:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788843925.287633:0:22708:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843925.287816:0:22708:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd007722d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788843925.287870:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134593536 00000100:00100000:0.0:1788843925.287875:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134593536 00000100:00100000:0.0:1788843925.288186:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1788843925.288194:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0018b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ce589ba-8334-438e-8f48-13932fcba8b1+21:22708:x1875738134593536:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788843925.288337:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0018b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ce589ba-8334-438e-8f48-13932fcba8b1+21:22708:x1875738134593536:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 143us (702us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843925.288344:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1788843925.293521:0:22708:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10fe22d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ce589ba-8334-438e-8f48-13932fcba8b1:22708:1875738134593536:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788843925.294017:0:22708:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10fe22d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ce589ba-8334-438e-8f48-13932fcba8b1:22708:1875738134593664:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788843925.294109:0:22708:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843925.294169:0:22708:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd007722d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788843925.294271:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134593664 00000100:00100000:3.0:1788843925.294279:0:22704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134593664 00000100:00100000:3.0:1788843925.294338:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1788843925.294348:0:22704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0018b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ce589ba-8334-438e-8f48-13932fcba8b1+21:22708:x1875738134593664:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788843925.294484:0:22704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0018b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ce589ba-8334-438e-8f48-13932fcba8b1+21:22708:x1875738134593664:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 136us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843925.294504:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1788843925.294783:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843925.294828:0:22708:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10fe22d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ce589ba-8334-438e-8f48-13932fcba8b1:22708:1875738134593664:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788843925.295049:0:22713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116648064 00000100:00100000:3.0:1788843925.295055:0:22713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116648064 00000100:00100000:3.0:1788843925.295093:0:22713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 30 00000100:00100000:3.0:1788843925.295100:0:22713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10fe21500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1bbae83-8212-4d8d-abaf-75a84733a0c2+5:18710:x1875738116648064:12345-192.168.203.33@tcp:101:lfs.0 00010000:00010000:3.0:1788843925.295123:0:22713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788843925.295167:0:22713:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2600/0xa762dfcbd58d3018 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf24d95f22490f5c expref: -99 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843925.295245:0:22713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be3c00/0xa762dfcbd58d301f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843925.295262:0:22713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be3c00/0xa762dfcbd58d301f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843925.295274:0:22713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be3c00/0xa762dfcbd58d301f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788843925.295320:0:22713:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788843925.295323:0:22713:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788843925.295346:0:22713:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be3c00/0xa762dfcbd58d301f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843925.295372:0:22713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2600/0xa762dfcbd58d3018 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490f5c expref: 7 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843925.295402:0:22713:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be3c00/0xa762dfcbd58d301f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490f5c expref: 6 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843925.295412:0:22713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bd00746cc00) 00010000:00010000:3.0:1788843925.295415:0:22713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788843925.295418:0:22713:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd007be3c00, rc 0) 00000100:00100000:3.0:1788843925.295465:0:22713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10fe21500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1bbae83-8212-4d8d-abaf-75a84733a0c2+6:18710:x1875738116648064:12345-192.168.203.33@tcp:101:lfs.0 Request processed in 365us (683us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843925.295471:0:22713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 30 00000040:00080000:2.0:1788843925.295549:0:25758:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1788843925.295610:0:22708:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1788843925.295632:0:22708:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.133@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788843925.295645:0:22708:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd00873b400/0xa762dfcbd58d300a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d3011 expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843925.295655:0:22708:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.133@tcp lock: ffff9bd00873b400/0xa762dfcbd58d300a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d3011 expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788843925.295667:0:22708:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788843925.295670:0:22708:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9bd006448000 from 13 10000000:01000000:2.0:1788843925.295674:0:22708:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788843925.295698:0:22708:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd1153e7a00/0xa762dfcbd58d3026 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843925.295706:0:22708:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.133@tcp lock: ffff9bd1153e7a00/0xa762dfcbd58d3026 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843925.295714:0:22708:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.133@tcp lock: ffff9bd1153e7a00/0xa762dfcbd58d3026 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843925.295735:0:22708:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10fe22d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ce589ba-8334-438e-8f48-13932fcba8b1:22708:1875738134593792:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788843925.295773:0:22708:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843925.295809:0:22708:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd007722000 going to sleep for 11 seconds 00000100:00100000:3.0:1788843925.295860:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134593792 00000100:00100000:3.0:1788843925.295864:0:22704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134593792 00000100:00100000:3.0:1788843925.295885:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1788843925.295892:0:22704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0018b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ce589ba-8334-438e-8f48-13932fcba8b1+21:22708:x1875738134593792:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788843925.295899:0:22704:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788843925.295911:0:22704:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd007be3200/0xa762dfcbd58d302d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa762dfcbd58d3026 expref: -99 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843925.295930:0:22704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd007be3200/0xa762dfcbd58d302d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa762dfcbd58d3026 expref: 22 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843925.295939:0:22704:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd007be3200/0xa762dfcbd58d302d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa762dfcbd58d3026 expref: 22 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843925.295946:0:22704:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd007be3200, rc 0) 00000100:00100000:3.0:1788843925.295995:0:22704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0018b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ce589ba-8334-438e-8f48-13932fcba8b1+22:22708:x1875738134593792:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 103us (221us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843925.296011:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1788843925.296104:0:22708:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10fe22d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ce589ba-8334-438e-8f48-13932fcba8b1:22708:1875738134593792:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788843925.296119:0:22708:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.133@tcp lock: ffff9bd1153e7a00/0xa762dfcbd58d3026 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d302d expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843925.296127:0:22708:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.133@tcp lock: ffff9bd1153e7a00/0xa762dfcbd58d3026 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa762dfcbd58d302d expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843925.296217:0:22708:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10fe22d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ce589ba-8334-438e-8f48-13932fcba8b1:22708:1875738134593920:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788843925.296244:0:22708:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843925.296259:0:22708:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd007722000 going to sleep for 11 seconds 00000100:00100000:2.0:1788843925.296270:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134593920 00000100:00100000:2.0:1788843925.296274:0:22704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134593920 00000100:00100000:2.0:1788843925.296295:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1788843925.296300:0:22704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0018b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ce589ba-8334-438e-8f48-13932fcba8b1+22:22708:x1875738134593920:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788843925.296404:0:22704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0018b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ce589ba-8334-438e-8f48-13932fcba8b1+22:22708:x1875738134593920:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 103us (159us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843925.296410:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1788843925.296442:0:22708:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10fe22d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ce589ba-8334-438e-8f48-13932fcba8b1:22708:1875738134593920:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788843925.296482:0:22708:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10fe22d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ce589ba-8334-438e-8f48-13932fcba8b1:22708:1875738134594048:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788843925.296520:0:22708:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843925.296542:0:22708:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd007722000 going to sleep for 11 seconds 00000100:00100000:1.0:1788843925.296778:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134594048 00000100:00100000:1.0:1788843925.296784:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134594048 00000100:00100000:1.0:1788843925.296807:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1788843925.296814:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0018b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ce589ba-8334-438e-8f48-13932fcba8b1+22:22708:x1875738134594048:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788843925.296914:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0018b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ce589ba-8334-438e-8f48-13932fcba8b1+22:22708:x1875738134594048:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 100us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843925.296921:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1788843925.298064:0:22708:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10fe22d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ce589ba-8334-438e-8f48-13932fcba8b1:22708:1875738134594048:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788843925.299507:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1788843925.303345:0:25511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116648192 00000100:00100000:1.0:1788843925.303366:0:25511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116648192 00000100:00100000:1.0:1788843925.303456:0:25511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 31 00000100:00100000:1.0:1788843925.303469:0:25511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141ae8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1bbae83-8212-4d8d-abaf-75a84733a0c2+6:18710:x1875738116648192:12345-192.168.203.33@tcp:101:lfs.0 00010000:00010000:1.0:1788843925.303492:0:25511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788843925.303517:0:25511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbeae00/0xa762dfcbd58d3034 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf24d95f22490f63 expref: -99 pid: 25511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843925.303599:0:25511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbeb400/0xa762dfcbd58d303b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843925.303616:0:25511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbeb400/0xa762dfcbd58d303b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843925.303628:0:25511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbeb400/0xa762dfcbd58d303b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843925.303663:0:25511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbea800/0xa762dfcbd58d3042 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 25511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843925.303670:0:25511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbea800/0xa762dfcbd58d3042 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843925.303677:0:25511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbea800/0xa762dfcbd58d3042 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843925.303761:0:25511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbea000/0xa762dfcbd58d3049 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 25511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843925.303769:0:25511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbea000/0xa762dfcbd58d3049 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843925.303776:0:25511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbea000/0xa762dfcbd58d3049 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788843925.303818:0:25511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788843925.303822:0:25511:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788843925.303846:0:25511:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbea000/0xa762dfcbd58d3049 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843925.303859:0:25511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbeb400/0xa762dfcbd58d303b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843925.303866:0:25511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbeb400/0xa762dfcbd58d303b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843925.303872:0:25511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbeb400/0xa762dfcbd58d303b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843925.303888:0:25511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd13fbeb400 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1788843925.303893:0:25511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbeb400/0xa762dfcbd58d303b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843925.303900:0:25511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbeb400/0xa762dfcbd58d303b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843925.303913:0:25511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bd00746cc00) 00010000:00010000:1.0:1788843925.303916:0:25511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788843925.303921:0:25511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbeb400/0xa762dfcbd58d303b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843925.303928:0:25511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbeb400/0xa762dfcbd58d303b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843925.303943:0:25511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbea800/0xa762dfcbd58d3042 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843925.303949:0:25511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbea800/0xa762dfcbd58d3042 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 25511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843925.303956:0:25511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbea800/0xa762dfcbd58d3042 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843925.303961:0:25511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd13fbea800 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1788843925.303964:0:25511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbea800/0xa762dfcbd58d3042 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843925.303970:0:25511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbea800/0xa762dfcbd58d3042 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 25511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843925.304000:0:25511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9bd00746bf00) 00010000:00010000:1.0:1788843925.304003:0:25511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788843925.304006:0:25511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbea800/0xa762dfcbd58d3042 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843925.304013:0:25511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbea800/0xa762dfcbd58d3042 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843925.304042:0:25511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbeae00/0xa762dfcbd58d3034 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490f63 expref: 8 pid: 25511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843925.304055:0:25511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbea000/0xa762dfcbd58d3049 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490f63 expref: 7 pid: 25511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843925.304062:0:25511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9bd00746cd00) 00010000:00010000:1.0:1788843925.304065:0:25511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788843925.304068:0:25511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd13fbea000, rc 0) 00000100:00100000:1.0:1788843925.304184:0:25511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141ae8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1bbae83-8212-4d8d-abaf-75a84733a0c2+7:18710:x1875738116648192:12345-192.168.203.33@tcp:101:lfs.0 Request processed in 717us (4686us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843925.304192:0:25511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 31 00000100:00100000:0.0:1788843925.305203:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1788843925.305636:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116648320 00000100:00100000:1.0:1788843925.305645:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116648320 00000100:00100000:1.0:1788843925.305684:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 156 00000100:00100000:1.0:1788843925.305692:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0018b3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efb31ab2-ab0a-4b00-9471-3fc304e37c6a+12:18076:x1875738116648320:12345-192.168.203.33@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788843925.305707:0:22705:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788843925.305723:0:22705:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd13fbeba00/0xa762dfcbd58d3050 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xaf24d95f22490f6a expref: -99 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843925.305767:0:22705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd13fbeba00/0xa762dfcbd58d3050 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490f6a expref: 13 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843925.305778:0:22705:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd13fbeba00/0xa762dfcbd58d3050 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490f6a expref: 13 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843925.305787:0:22705:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd13fbeba00, rc 0) 00000040:00080000:2.0:1788843925.305839:0:25759:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000100:00100000:1.0:1788843925.305839:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0018b3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efb31ab2-ab0a-4b00-9471-3fc304e37c6a+13:18076:x1875738116648320:12345-192.168.203.33@tcp:101:ll_cfg_requeue.0 Request processed in 148us (645us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843925.305845:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 156 00000020:01000000:3.0:1788843925.307669:0:22708:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1788843925.307710:0:22708:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.133@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788843925.307723:0:22708:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd1153e7a00/0xa762dfcbd58d3026 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d302d expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843925.307736:0:22708:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.133@tcp lock: ffff9bd1153e7a00/0xa762dfcbd58d3026 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d302d expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788843925.307750:0:22708:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788843925.307754:0:22708:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9bd007394000 from 13 10000000:01000000:3.0:1788843925.307757:0:22708:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788843925.307796:0:22708:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd007be2600/0xa762dfcbd58d3057 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843925.307804:0:22708:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.133@tcp lock: ffff9bd007be2600/0xa762dfcbd58d3057 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843925.307813:0:22708:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.133@tcp lock: ffff9bd007be2600/0xa762dfcbd58d3057 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843925.307838:0:22708:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f984e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ce589ba-8334-438e-8f48-13932fcba8b1:22708:1875738134594176:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788843925.307906:0:22708:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843925.307962:0:22708:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd140b6ecc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788843925.308000:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134594176 00000100:00100000:3.0:1788843925.308007:0:22704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134594176 00000100:00100000:3.0:1788843925.308057:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1788843925.308066:0:22704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0018b2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ce589ba-8334-438e-8f48-13932fcba8b1+22:22708:x1875738134594176:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788843925.308079:0:22704:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788843925.308109:0:22704:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd007be2800/0xa762dfcbd58d305e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xa762dfcbd58d3057 expref: -99 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843925.308132:0:22704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd007be2800/0xa762dfcbd58d305e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa762dfcbd58d3057 expref: 23 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843925.308184:0:22704:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd007be2800/0xa762dfcbd58d305e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa762dfcbd58d3057 expref: 23 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843925.308192:0:22704:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd007be2800, rc 0) 00000100:00100000:3.0:1788843925.308236:0:22704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0018b2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ce589ba-8334-438e-8f48-13932fcba8b1+23:22708:x1875738134594176:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 171us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843925.308243:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1788843925.309671:0:22708:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f984e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ce589ba-8334-438e-8f48-13932fcba8b1:22708:1875738134594176:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788843925.309715:0:22708:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.133@tcp lock: ffff9bd007be2600/0xa762dfcbd58d3057 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d305e expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843925.309728:0:22708:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.133@tcp lock: ffff9bd007be2600/0xa762dfcbd58d3057 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa762dfcbd58d305e expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843925.309813:0:22708:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10fe22d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ce589ba-8334-438e-8f48-13932fcba8b1:22708:1875738134594304:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788843925.309867:0:22708:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843925.309900:0:22708:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd111687780 going to sleep for 11 seconds 00000100:00100000:0.0:1788843925.310168:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134594304 00000100:00100000:0.0:1788843925.310175:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134594304 00000100:00100000:0.0:1788843925.310221:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1788843925.310229:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0018b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ce589ba-8334-438e-8f48-13932fcba8b1+23:22708:x1875738134594304:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788843925.310377:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0018b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ce589ba-8334-438e-8f48-13932fcba8b1+23:22708:x1875738134594304:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 148us (509us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843925.310384:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1788843925.310533:0:22708:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10fe22d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ce589ba-8334-438e-8f48-13932fcba8b1:22708:1875738134594304:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788843925.310573:0:22708:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd1054e3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ce589ba-8334-438e-8f48-13932fcba8b1:22708:1875738134594432:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788843925.310621:0:22708:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843925.310653:0:22708:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd140dc8780 going to sleep for 11 seconds 00000100:00100000:0.0:1788843925.310741:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134594432 00000100:00100000:0.0:1788843925.310746:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134594432 00000100:00100000:0.0:1788843925.310776:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1788843925.310782:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0018b3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ce589ba-8334-438e-8f48-13932fcba8b1+23:22708:x1875738134594432:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788843925.310883:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0018b3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ce589ba-8334-438e-8f48-13932fcba8b1+23:22708:x1875738134594432:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 100us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843925.310889:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1788843925.310954:0:22708:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd1054e3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ce589ba-8334-438e-8f48-13932fcba8b1:22708:1875738134594432:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788843925.315721:0:25760:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1788843925.316135:0:22708:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1788843925.316211:0:22708:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.133@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788843925.316224:0:22708:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd007be2600/0xa762dfcbd58d3057 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d305e expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843925.316236:0:22708:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.133@tcp lock: ffff9bd007be2600/0xa762dfcbd58d3057 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d305e expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788843925.316248:0:22708:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788843925.316251:0:22708:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9bd127b94800 from 13 10000000:01000000:2.0:1788843925.316254:0:22708:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788843925.316297:0:22708:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd1153e7800/0xa762dfcbd58d3065 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843925.316306:0:22708:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.133@tcp lock: ffff9bd1153e7800/0xa762dfcbd58d3065 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843925.316317:0:22708:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.133@tcp lock: ffff9bd1153e7800/0xa762dfcbd58d3065 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843925.316344:0:22708:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10fe23b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ce589ba-8334-438e-8f48-13932fcba8b1:22708:1875738134594560:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788843925.316382:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843925.316419:0:22708:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843925.316468:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134594560 00000100:00100000:2.0:1788843925.316471:0:22708:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd111687780 going to sleep for 11 seconds 00000100:00100000:3.0:1788843925.316477:0:22704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134594560 00000100:00100000:3.0:1788843925.316543:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1788843925.316554:0:22704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0018b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ce589ba-8334-438e-8f48-13932fcba8b1+23:22708:x1875738134594560:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788843925.316567:0:22704:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788843925.316583:0:22704:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd007be3000/0xa762dfcbd58d306c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xa762dfcbd58d3065 expref: -99 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843925.316609:0:22704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd007be3000/0xa762dfcbd58d306c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa762dfcbd58d3065 expref: 24 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843925.316621:0:22704:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd007be3000/0xa762dfcbd58d306c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa762dfcbd58d3065 expref: 24 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843925.316630:0:22704:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd007be3000, rc 0) 00000100:00100000:3.0:1788843925.316680:0:22704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0018b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ce589ba-8334-438e-8f48-13932fcba8b1+24:22708:x1875738134594560:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 128us (260us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843925.316696:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1788843925.316791:0:22708:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10fe23b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ce589ba-8334-438e-8f48-13932fcba8b1:22708:1875738134594560:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788843925.316807:0:22708:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.133@tcp lock: ffff9bd1153e7800/0xa762dfcbd58d3065 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d306c expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843925.316817:0:22708:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.133@tcp lock: ffff9bd1153e7800/0xa762dfcbd58d3065 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xa762dfcbd58d306c expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843925.316875:0:22708:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10fe23b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ce589ba-8334-438e-8f48-13932fcba8b1:22708:1875738134594688:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788843925.316879:0:22723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116648448 00000100:00100000:1.0:1788843925.316884:0:22723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116648448 00000100:00100000:2.0:1788843925.316904:0:22708:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843925.316923:0:22708:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd111687780 going to sleep for 11 seconds 00000100:00100000:1.0:1788843925.316938:0:22723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 6 00000100:00100000:1.0:1788843925.316946:0:22723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141ae9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:d1bbae83-8212-4d8d-abaf-75a84733a0c2+5:18710:x1875738116648448:12345-192.168.203.33@tcp:900:lfs.0 00000100:00100000:1.0:1788843925.317021:0:22723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141ae9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:d1bbae83-8212-4d8d-abaf-75a84733a0c2+5:18710:x1875738116648448:12345-192.168.203.33@tcp:900:lfs.0 Request processed in 75us (641us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843925.317029:0:22723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 6 00000100:00080000:0.0:1788843925.317084:0:22707:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788843925.317133:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134594688 00000100:00100000:3.0:1788843925.317138:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134594688 00000100:00100000:3.0:1788843925.317199:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1788843925.317206:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0018b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ce589ba-8334-438e-8f48-13932fcba8b1+24:22708:x1875738134594688:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788843925.317380:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0018b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ce589ba-8334-438e-8f48-13932fcba8b1+24:22708:x1875738134594688:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 174us (474us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843925.317387:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1788843925.318662:0:22708:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10fe23b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ce589ba-8334-438e-8f48-13932fcba8b1:22708:1875738134594688:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788843925.318745:0:22708:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd1054e3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ce589ba-8334-438e-8f48-13932fcba8b1:22708:1875738134594816:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788843925.318813:0:22708:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843925.318847:0:22708:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd140dc8540 going to sleep for 11 seconds 00000100:00100000:0.0:1788843925.318914:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134594816 00000100:00100000:0.0:1788843925.318921:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134594816 00000100:00100000:0.0:1788843925.318980:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1788843925.318990:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0018b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ce589ba-8334-438e-8f48-13932fcba8b1+24:22708:x1875738134594816:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788843925.319108:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0018b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ce589ba-8334-438e-8f48-13932fcba8b1+24:22708:x1875738134594816:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 119us (294us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843925.319115:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1788843925.319227:0:22708:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd1054e3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ce589ba-8334-438e-8f48-13932fcba8b1:22708:1875738134594816:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788843925.320421:0:25761:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000100:00100000:0.0:1788843925.321175:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843925.321317:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116648576 00000100:00100000:3.0:1788843925.321329:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116648576 00000100:00100000:3.0:1788843925.321384:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 163 00000100:00100000:3.0:1788843925.321394:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd00702f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efb31ab2-ab0a-4b00-9471-3fc304e37c6a+13:18076:x1875738116648576:12345-192.168.203.33@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788843925.322420:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd00702f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efb31ab2-ab0a-4b00-9471-3fc304e37c6a+13:18076:x1875738116648576:12345-192.168.203.33@tcp:501:ll_cfg_requeue.0 Request processed in 1019us (1245us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843925.322434:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 163 00000020:01000000:2.0:1788843925.331888:0:22708:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1788843925.331938:0:22708:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.133@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788843925.331952:0:22708:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd1153e7800/0xa762dfcbd58d3065 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d306c expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843925.331966:0:22708:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.133@tcp lock: ffff9bd1153e7800/0xa762dfcbd58d3065 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d306c expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843925.333681:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843925.333733:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843925.334085:0:22713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116648832 00000100:00100000:3.0:1788843925.334096:0:22713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116648832 00000100:00100000:3.0:1788843925.334286:0:22713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 32 00000100:00100000:3.0:1788843925.334299:0:22713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10fe22a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1bbae83-8212-4d8d-abaf-75a84733a0c2+7:18710:x1875738116648832:12345-192.168.203.33@tcp:101:lfs.0 00010000:00010000:3.0:1788843925.334323:0:22713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788843925.334347:0:22713:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be3800/0xa762dfcbd58d3073 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf24d95f22490f71 expref: -99 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788843925.334542:0:22713:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1788843925.334736:0:22713:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be3800/0xa762dfcbd58d3073 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490f71 expref: 9 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843925.334771:0:22713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bd00746cc00) 00010000:00010000:3.0:1788843925.334775:0:22713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788843925.334781:0:22713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be3800/0xa762dfcbd58d3073 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490f71 expref: 9 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843925.334799:0:22713:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd007be3800, rc 0) 00000100:00100000:3.0:1788843925.334961:0:22713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10fe22a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d1bbae83-8212-4d8d-abaf-75a84733a0c2+8:18710:x1875738116648832:12345-192.168.203.33@tcp:101:lfs.0 Request processed in 665us (1292us total) trans 12884901891 rc 301/301 00000100:00100000:3.0:1788843925.334970:0:22713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 32 00000100:00100000:0.0:1788843925.335133:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116648960 00000100:00100000:0.0:1788843925.335161:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116648960 00000100:00100000:1.0:1788843925.335267:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 164 00000100:00100000:1.0:1788843925.335275:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd00702c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efb31ab2-ab0a-4b00-9471-3fc304e37c6a+13:18076:x1875738116648960:12345-192.168.203.33@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788843925.335458:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd00702c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efb31ab2-ab0a-4b00-9471-3fc304e37c6a+13:18076:x1875738116648960:12345-192.168.203.33@tcp:503:ll_cfg_requeue.0 Request processed in 184us (1724us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843925.335467:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 164 00000100:00100000:2.0:1788843925.342661:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843925.342754:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116649216 00000100:00100000:3.0:1788843925.342765:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116649216 00000100:00100000:3.0:1788843925.342823:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 33 00000100:00100000:3.0:1788843925.342835:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10fe20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1bbae83-8212-4d8d-abaf-75a84733a0c2+8:18710:x1875738116649216:12345-192.168.203.33@tcp:36:lfs.0 00010000:00010000:3.0:1788843925.342897:0:22712:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788843925.342925:0:22712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbea000/0xa762dfcbd58d3049 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490f63 expref: 8 pid: 25511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843925.342942:0:22712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9bd00746cd00) 00010000:00010000:3.0:1788843925.342945:0:22712:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788843925.342967:0:22712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2a00/0xa762dfcbd58d3081 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843925.342991:0:22712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2a00/0xa762dfcbd58d3081 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843925.343006:0:22712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2a00/0xa762dfcbd58d3081 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788843925.343348:0:22712:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003dd7224c reply state 00000000f35159a3 transno 12884901892 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2a00/0xa762dfcbd58d3081 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843925.343362:0:22712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2a00/0xa762dfcbd58d3081 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843925.343369:0:22712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9bd00746cd00) 00010000:00010000:3.0:1788843925.343372:0:22712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:3.0:1788843925.343375:0:22712:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1788843925.343383:0:22712:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1788843925.343607:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10fe20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d1bbae83-8212-4d8d-abaf-75a84733a0c2+9:18710:x1875738116649216:12345-192.168.203.33@tcp:36:lfs.0 Request processed in 773us (959us total) trans 12884901892 rc 0/0 00000100:00100000:3.0:1788843925.343616:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 33 00000100:00100000:2.0:1788843925.346572:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1788843925.346730:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116649472 00000100:00100000:1.0:1788843925.346742:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116649472 00000100:00100000:1.0:1788843925.346809:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 2 00000100:00100000:1.0:1788843925.346821:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10fe20700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d1bbae83-8212-4d8d-abaf-75a84733a0c2+9:18710:x1875738116649472:12345-192.168.203.33@tcp:35:lfs.0 00000100:00100000:1.0:1788843925.347120:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10fe20700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d1bbae83-8212-4d8d-abaf-75a84733a0c2+10:18710:x1875738116649472:12345-192.168.203.33@tcp:35:lfs.0 Request processed in 300us (630us total) trans 12884901893 rc 0/0 00000100:00100000:1.0:1788843925.347129:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 2 00000100:00100000:1.0:1788843925.350706:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843925.350758:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116649728 00000100:00100000:3.0:1788843925.350770:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116649728 00000100:00100000:3.0:1788843925.350846:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 34 00000100:00100000:3.0:1788843925.350857:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1054e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1bbae83-8212-4d8d-abaf-75a84733a0c2+10:18710:x1875738116649728:12345-192.168.203.33@tcp:101:lfs.0 00010000:00010000:3.0:1788843925.350882:0:22711:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788843925.350905:0:22711:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be3600/0xa762dfcbd58d3088 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf24d95f22490f78 expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843925.351210:0:22711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2000/0xa762dfcbd58d308f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843925.351227:0:22711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2000/0xa762dfcbd58d308f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843925.351240:0:22711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2000/0xa762dfcbd58d308f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843925.351269:0:22711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2200/0xa762dfcbd58d3096 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843925.351278:0:22711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2200/0xa762dfcbd58d3096 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843925.351285:0:22711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2200/0xa762dfcbd58d3096 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788843925.351417:0:22711:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1788843925.351793:0:22711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2000/0xa762dfcbd58d308f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843925.351802:0:22711:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2000/0xa762dfcbd58d308f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843925.351809:0:22711:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2000/0xa762dfcbd58d308f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843925.351816:0:22711:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd007be2000 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1788843925.351821:0:22711:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2000/0xa762dfcbd58d308f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843925.351830:0:22711:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2000/0xa762dfcbd58d308f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843925.351846:0:22711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bd00746cc00) 00010000:00010000:3.0:1788843925.351849:0:22711:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788843925.351854:0:22711:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2000/0xa762dfcbd58d308f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843925.351873:0:22711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2000/0xa762dfcbd58d308f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843925.351889:0:22711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2200/0xa762dfcbd58d3096 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843925.351895:0:22711:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2200/0xa762dfcbd58d3096 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843925.351900:0:22711:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2200/0xa762dfcbd58d3096 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843925.351905:0:22711:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd007be2200 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1788843925.351909:0:22711:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2200/0xa762dfcbd58d3096 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843925.351915:0:22711:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2200/0xa762dfcbd58d3096 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843925.351924:0:22711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9bd00746bf00) 00010000:00010000:3.0:1788843925.351927:0:22711:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788843925.351930:0:22711:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2200/0xa762dfcbd58d3096 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843925.351935:0:22711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2200/0xa762dfcbd58d3096 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843925.351994:0:22711:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be3600/0xa762dfcbd58d3088 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490f78 expref: 12 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843925.352017:0:22711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bd00746cc00) 00010000:00010000:3.0:1788843925.352019:0:22711:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788843925.352023:0:22711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be3600/0xa762dfcbd58d3088 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490f78 expref: 12 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843925.352032:0:22711:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd007be3600, rc 0) 00000100:00100000:3.0:1788843925.352101:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1054e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d1bbae83-8212-4d8d-abaf-75a84733a0c2+11:18710:x1875738116649728:12345-192.168.203.33@tcp:101:lfs.0 Request processed in 1246us (1410us total) trans 12884901894 rc 301/301 00000100:00100000:3.0:1788843925.352562:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 34 00000100:00100000:0.0:1788843925.354581:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1788843925.354701:0:25511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116649856 00000100:00100000:1.0:1788843925.354713:0:25511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116649856 00000100:00100000:1.0:1788843925.354779:0:25511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 35 00000100:00100000:1.0:1788843925.354789:0:25511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141aeb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1bbae83-8212-4d8d-abaf-75a84733a0c2+11:18710:x1875738116649856:12345-192.168.203.33@tcp:101:lfs.0 00010000:00010000:1.0:1788843925.354816:0:25511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788843925.354837:0:25511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbeb400/0xa762dfcbd58d30a4 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf24d95f22490f7f expref: -99 pid: 25511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843925.354961:0:25511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbea400/0xa762dfcbd58d30ab lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843925.354989:0:25511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbea400/0xa762dfcbd58d30ab lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843925.355008:0:25511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbea400/0xa762dfcbd58d30ab lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788843925.355038:0:25511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788843925.355043:0:25511:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788843925.355064:0:25511:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbea400/0xa762dfcbd58d30ab lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843925.355089:0:25511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbeb400/0xa762dfcbd58d30a4 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490f7f expref: 13 pid: 25511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843925.355105:0:25511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbea400/0xa762dfcbd58d30ab lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490f7f expref: 12 pid: 25511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843925.355121:0:25511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9bd00746cd00) 00010000:00010000:1.0:1788843925.355123:0:25511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788843925.355126:0:25511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd13fbea400, rc 0) 00000100:00100000:1.0:1788843925.355985:0:25511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141aeb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d1bbae83-8212-4d8d-abaf-75a84733a0c2+12:18710:x1875738116649856:12345-192.168.203.33@tcp:101:lfs.0 Request processed in 1180us (1398us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843925.355997:0:25511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 35 00000100:00100000:2.0:1788843925.360109:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1788843925.360363:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116649984 00000100:00100000:1.0:1788843925.360375:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116649984 00000100:00100000:1.0:1788843925.360946:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 3 00000100:00100000:1.0:1788843925.360960:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10fe21880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d1bbae83-8212-4d8d-abaf-75a84733a0c2+12:18710:x1875738116649984:12345-192.168.203.33@tcp:37:lfs.0 00000100:00100000:1.0:1788843925.366310:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10fe21880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d1bbae83-8212-4d8d-abaf-75a84733a0c2+12:18710:x1875738116649984:12345-192.168.203.33@tcp:37:lfs.0 Request processed in 5338us (6199us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843925.366325:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 3 00000100:00100000:0.0:1788843925.370602:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843925.370734:0:22715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116650240 00000100:00100000:2.0:1788843925.370745:0:22715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116650240 00000100:00100000:2.0:1788843925.370806:0:22715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 4 00000100:00100000:2.0:1788843925.370832:0:22715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0018b6c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d1bbae83-8212-4d8d-abaf-75a84733a0c2+12:18710:x1875738116650240:12345-192.168.203.33@tcp:35:lfs.0 00000100:00100000:2.0:1788843925.371133:0:22715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0018b6c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d1bbae83-8212-4d8d-abaf-75a84733a0c2+13:18710:x1875738116650240:12345-192.168.203.33@tcp:35:lfs.0 Request processed in 301us (544us total) trans 12884901895 rc 0/0 00000100:00100000:2.0:1788843925.371296:0:22715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 4 00000100:00100000:2.0:1788843925.421691:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843925.421864:0:22713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116650368 00000100:00100000:3.0:1788843925.421876:0:22713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116650368 00000100:00100000:3.0:1788843925.421950:0:22713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 36 00000100:00100000:3.0:1788843925.421962:0:22713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10fe20700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a6e673fb-9566-47bf-b86a-d710f4950716+11:18718:x1875738116650368:12345-192.168.203.33@tcp:101:bash.0 00010000:00010000:3.0:1788843925.421996:0:22713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788843925.422021:0:22713:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be3600/0xa762dfcbd58d30b2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf24d95f22490f86 expref: -99 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843925.422099:0:22713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2200/0xa762dfcbd58d30b9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843925.422116:0:22713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2200/0xa762dfcbd58d30b9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843925.422128:0:22713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2200/0xa762dfcbd58d30b9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843925.422311:0:22713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2000/0xa762dfcbd58d30c0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843925.422339:0:22713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2000/0xa762dfcbd58d30c0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843925.422347:0:22713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2000/0xa762dfcbd58d30c0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843925.422811:0:22713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd1153e7c00/0xa762dfcbd58d30c7 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843925.422824:0:22713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd1153e7c00/0xa762dfcbd58d30c7 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843925.422833:0:22713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd1153e7c00/0xa762dfcbd58d30c7 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788843925.422874:0:22713:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788843925.422877:0:22713:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788843925.422918:0:22713:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bd1153e7c00/0xa762dfcbd58d30c7 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843925.422933:0:22713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2200/0xa762dfcbd58d30b9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843925.422941:0:22713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2200/0xa762dfcbd58d30b9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843925.422948:0:22713:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2200/0xa762dfcbd58d30b9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843925.422955:0:22713:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd007be2200 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1788843925.422960:0:22713:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2200/0xa762dfcbd58d30b9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843925.422995:0:22713:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2200/0xa762dfcbd58d30b9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843925.423009:0:22713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bd00746cc00) 00010000:00010000:2.0:1788843925.423012:0:22713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788843925.423018:0:22713:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2200/0xa762dfcbd58d30b9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843925.423025:0:22713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2200/0xa762dfcbd58d30b9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843925.423042:0:22713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2000/0xa762dfcbd58d30c0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843925.423048:0:22713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2000/0xa762dfcbd58d30c0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843925.423054:0:22713:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2000/0xa762dfcbd58d30c0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843925.423060:0:22713:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd007be2000 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1788843925.423063:0:22713:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2000/0xa762dfcbd58d30c0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843925.423070:0:22713:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2000/0xa762dfcbd58d30c0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843925.423078:0:22713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9bd00746bf00) 00010000:00010000:2.0:1788843925.423081:0:22713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788843925.423084:0:22713:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2000/0xa762dfcbd58d30c0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843925.423101:0:22713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2000/0xa762dfcbd58d30c0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843925.423138:0:22713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be3600/0xa762dfcbd58d30b2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490f86 expref: 13 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843925.423244:0:22713:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd1153e7c00/0xa762dfcbd58d30c7 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490f86 expref: 12 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843925.423252:0:22713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9bd00746cd00) 00010000:00010000:2.0:1788843925.423254:0:22713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788843925.423257:0:22713:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd1153e7c00, rc 0) 00000100:00100000:2.0:1788843925.423339:0:22713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10fe20700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a6e673fb-9566-47bf-b86a-d710f4950716+12:18718:x1875738116650368:12345-192.168.203.33@tcp:101:bash.0 Request processed in 1378us (1661us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843925.423347:0:22713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 36 00000100:00100000:3.0:1788843925.426386:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1788843925.426644:0:22723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116650496 00000100:00100000:1.0:1788843925.426666:0:22723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116650496 00000100:00100000:1.0:1788843925.426733:0:22723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7 00000100:00100000:1.0:1788843925.426745:0:22723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f987800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:a6e673fb-9566-47bf-b86a-d710f4950716+5:18718:x1875738116650496:12345-192.168.203.33@tcp:900:bash.0 00000100:00100000:1.0:1788843925.426843:0:22723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f987800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:a6e673fb-9566-47bf-b86a-d710f4950716+5:18718:x1875738116650496:12345-192.168.203.33@tcp:900:bash.0 Request processed in 100us (470us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843925.426851:0:22723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7 00000100:00100000:1.0:1788843925.429326:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843925.429712:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116650752 00000100:00100000:3.0:1788843925.429725:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116650752 00000100:00100000:3.0:1788843925.430001:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 37 00000100:00100000:3.0:1788843925.430014:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1054e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a6e673fb-9566-47bf-b86a-d710f4950716+12:18718:x1875738116650752:12345-192.168.203.33@tcp:101:bash.0 00010000:00010000:3.0:1788843925.430037:0:22712:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788843925.430063:0:22712:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be3800/0xa762dfcbd58d30ce lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf24d95f22490f8d expref: -99 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843925.430229:0:22712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be3a00/0xa762dfcbd58d30d5 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843925.430247:0:22712:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbea400/0xa762dfcbd58d30ab lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490f7f expref: 12 pid: 25511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843925.430256:0:22712:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be3a00/0xa762dfcbd58d30d5 lrc: 4/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843925.430295:0:22712:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbea400/0xa762dfcbd58d30ab lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490f7f expref: 12 pid: 25511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843925.430311:0:22712:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbea400/0xa762dfcbd58d30ab lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490f7f expref: 12 pid: 25511 timeout: 803 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843925.430344:0:22712:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f987480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22712:1875738134594944:192.168.203.33@tcp:104: 00000100:00100000:3.0:1788843925.430442:0:22712:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd140b6e600 going to sleep for 11 seconds 00000100:00100000:3.0:1788843925.433844:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1788843925.434211:0:22696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116650880 00000100:00100000:0.0:1788843925.434224:0:22696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116650880 00010000:00010000:0.0:1788843925.434273:0:22696:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbea400/0xa762dfcbd58d30ab lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490f7f expref: 13 pid: 25511 timeout: 803 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843925.434317:0:22696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 16 00000100:00100000:0.0:1788843925.434329:0:22696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f985880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d1bbae83-8212-4d8d-abaf-75a84733a0c2+13:2390:x1875738116650880:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788843925.434347:0:22696:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788843925.434354:0:22696:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbea400/0xa762dfcbd58d30ab lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490f7f expref: 13 pid: 25511 timeout: 803 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843925.434368:0:22696:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbea400/0xa762dfcbd58d30ab lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490f7f expref: 13 pid: 25511 timeout: 803 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843925.434395:0:22696:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9bd00746cd00) 00010000:00010000:0.0:1788843925.434418:0:22696:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be3a00/0xa762dfcbd58d30d5 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843925.434430:0:22696:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be3a00/0xa762dfcbd58d30d5 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843925.434439:0:22696:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be3a00/0xa762dfcbd58d30d5 lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843925.434474:0:22696:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788843925.434538:0:22696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f985880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d1bbae83-8212-4d8d-abaf-75a84733a0c2+13:2390:x1875738116650880:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 210us (706us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843925.434545:0:22696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 16 00010000:00010000:2.0:1788843925.435243:0:22712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbea400/0xa762dfcbd58d30ab lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490f7f expref: 12 pid: 25511 timeout: 803 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843925.435267:0:22712:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f987480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22712:1875738134594944:192.168.203.33@tcp:104: 00010000:00010000:2.0:1788843925.435293:0:22712:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be3a00/0xa762dfcbd58d30d5 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843925.435303:0:22712:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be3a00/0xa762dfcbd58d30d5 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843925.435309:0:22712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be3a00/0xa762dfcbd58d30d5 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843925.435539:0:22712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd1153e7000/0xa762dfcbd58d30dc lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843925.435564:0:22712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd1153e7000/0xa762dfcbd58d30dc lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843925.435578:0:22712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd1153e7000/0xa762dfcbd58d30dc lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843925.436114:0:22712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd1153e6800/0xa762dfcbd58d30e3 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843925.436124:0:22712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd1153e6800/0xa762dfcbd58d30e3 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843925.436132:0:22712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd1153e6800/0xa762dfcbd58d30e3 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788843925.436185:0:22712:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788843925.436212:0:22712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be3a00/0xa762dfcbd58d30d5 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843925.436220:0:22712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be3a00/0xa762dfcbd58d30d5 lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843925.436228:0:22712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be3a00/0xa762dfcbd58d30d5 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843925.436233:0:22712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd007be3a00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1788843925.436238:0:22712:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be3a00/0xa762dfcbd58d30d5 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843925.436259:0:22712:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be3a00/0xa762dfcbd58d30d5 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843925.436273:0:22712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9bd00746cd00) 00010000:00010000:2.0:1788843925.436276:0:22712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788843925.436281:0:22712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be3a00/0xa762dfcbd58d30d5 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843925.436287:0:22712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be3a00/0xa762dfcbd58d30d5 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788843925.436301:0:22712:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b8a07590 reply state 00000000aa5189f0 transno 12884901896 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd1153e7000/0xa762dfcbd58d30dc lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843925.436312:0:22712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd1153e7000/0xa762dfcbd58d30dc lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843925.436318:0:22712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff9bd102e00000) 00010000:00010000:2.0:1788843925.436320:0:22712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788843925.436323:0:22712:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788843925.436361:0:22712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be3800/0xa762dfcbd58d30ce lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490f8d expref: 15 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843925.436378:0:22712:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd1153e6800/0xa762dfcbd58d30e3 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490f8d expref: 14 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843925.436385:0:22712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9bd102e00a00) 00010000:00010000:2.0:1788843925.436387:0:22712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:2.0:1788843925.436390:0:22712:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd1153e6800, rc 0) 00000100:00100000:2.0:1788843925.436470:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1054e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a6e673fb-9566-47bf-b86a-d710f4950716+15:18718:x1875738116650752:12345-192.168.203.33@tcp:101:bash.0 Request processed in 6457us (7156us total) trans 12884901896 rc 0/0 00000100:00100000:2.0:1788843925.436478:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 37 00000100:00100000:3.0:1788843925.449958:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1788843925.450136:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116651008 00000100:00100000:1.0:1788843925.450196:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116651008 00000100:00100000:1.0:1788843925.450272:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 38 00000100:00100000:1.0:1788843925.450284:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f984700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a6e673fb-9566-47bf-b86a-d710f4950716+15:18718:x1875738116651008:12345-192.168.203.33@tcp:101:bash.0 00010000:00010000:1.0:1788843925.450312:0:22711:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788843925.450336:0:22711:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbebc00/0xa762dfcbd58d30f1 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf24d95f22490f94 expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843925.450421:0:22711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbeb000/0xa762dfcbd58d30f8 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843925.450439:0:22711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbeb000/0xa762dfcbd58d30f8 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843925.450464:0:22711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbeb000/0xa762dfcbd58d30f8 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788843925.450545:0:22711:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1788843925.450550:0:22711:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788843925.450577:0:22711:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbeb000/0xa762dfcbd58d30f8 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843925.450589:0:22711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbeb000/0xa762dfcbd58d30f8 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843925.450620:0:22711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbebc00/0xa762dfcbd58d30f1 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490f94 expref: 17 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843925.450641:0:22711:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbeb000/0xa762dfcbd58d30f8 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490f94 expref: 16 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843925.450649:0:22711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9bd102e00a00) 00010000:00010000:1.0:1788843925.450652:0:22711:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788843925.450656:0:22711:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd13fbeb000, rc 0) 00000100:00100000:1.0:1788843925.450716:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f984700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a6e673fb-9566-47bf-b86a-d710f4950716+16:18718:x1875738116651008:12345-192.168.203.33@tcp:101:bash.0 Request processed in 435us (773us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843925.450723:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 38 00000100:00100000:3.0:1788843925.454331:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1788843925.454462:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116651264 00000100:00100000:1.0:1788843925.454475:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116651264 00000100:00100000:1.0:1788843925.454547:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 5 00000100:00100000:1.0:1788843925.454559:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f986680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a6e673fb-9566-47bf-b86a-d710f4950716+16:18718:x1875738116651264:12345-192.168.203.33@tcp:35:bash.0 00000100:00100000:1.0:1788843925.456026:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f986680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a6e673fb-9566-47bf-b86a-d710f4950716+17:18718:x1875738116651264:12345-192.168.203.33@tcp:35:bash.0 Request processed in 1457us (1695us total) trans 12884901897 rc 0/0 00000100:00100000:1.0:1788843925.456040:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 5 00000100:00100000:0.0:1788843925.579277:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1788843925.579390:0:25511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116651520 00000100:00100000:1.0:1788843925.579403:0:25511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116651520 00000100:00100000:1.0:1788843925.579487:0:25511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 39 00000100:00100000:1.0:1788843925.579499:0:25511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141ae9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a6e673fb-9566-47bf-b86a-d710f4950716+17:18728:x1875738116651520:12345-192.168.203.33@tcp:101:lfs.0 00010000:00010000:1.0:1788843925.579527:0:25511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788843925.579552:0:25511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbebc00/0xa762dfcbd58d30ff lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf24d95f22490f9b expref: -99 pid: 25511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788843925.579694:0:25511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1788843925.579801:0:25511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbebc00/0xa762dfcbd58d30ff lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490f9b expref: 19 pid: 25511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843925.579816:0:25511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bd00746cc00) 00010000:00010000:1.0:1788843925.579819:0:25511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788843925.579825:0:25511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbebc00/0xa762dfcbd58d30ff lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490f9b expref: 19 pid: 25511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843925.579840:0:25511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd13fbebc00, rc 0) 00000100:00100000:1.0:1788843925.579901:0:25511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141ae9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a6e673fb-9566-47bf-b86a-d710f4950716+18:18728:x1875738116651520:12345-192.168.203.33@tcp:101:lfs.0 Request processed in 405us (638us total) trans 12884901898 rc 301/301 00000100:00100000:1.0:1788843925.579909:0:25511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 39 00000100:00100000:3.0:1788843925.583363:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843925.583482:0:22715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116651776 00000100:00100000:2.0:1788843925.583494:0:22715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116651776 00000100:00100000:2.0:1788843925.583556:0:22715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 6 00000100:00100000:2.0:1788843925.583569:0:22715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f985c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a6e673fb-9566-47bf-b86a-d710f4950716+18:18728:x1875738116651776:12345-192.168.203.33@tcp:35:lfs.0 00000100:00100000:2.0:1788843925.583849:0:22715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f985c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a6e673fb-9566-47bf-b86a-d710f4950716+19:18728:x1875738116651776:12345-192.168.203.33@tcp:35:lfs.0 Request processed in 282us (499us total) trans 12884901899 rc 0/0 00000100:00100000:2.0:1788843925.583858:0:22715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 6 00000100:00100000:3.0:1788843925.648872:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843925.649063:0:22713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116652032 00000100:00100000:2.0:1788843925.649076:0:22713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116652032 00000100:00100000:2.0:1788843925.649186:0:22713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 40 00000100:00100000:2.0:1788843925.649198:0:22713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f987b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a6e673fb-9566-47bf-b86a-d710f4950716+19:18731:x1875738116652032:12345-192.168.203.33@tcp:101:lfs.0 00010000:00010000:2.0:1788843925.649225:0:22713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788843925.649252:0:22713:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd1153e6600/0xa762dfcbd58d310d lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf24d95f22490fa2 expref: -99 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843925.649388:0:22713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd1153e6c00/0xa762dfcbd58d3114 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843925.649405:0:22713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd1153e6c00/0xa762dfcbd58d3114 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843925.649418:0:22713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd1153e6c00/0xa762dfcbd58d3114 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788843925.649430:0:22713:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788843925.649893:0:22713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd1153e6600/0xa762dfcbd58d310d lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490fa2 expref: 22 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843925.649916:0:22713:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd1153e6c00/0xa762dfcbd58d3114 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490fa2 expref: 21 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843925.649925:0:22713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9bd102e00a00) 00010000:00010000:2.0:1788843925.649929:0:22713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788843925.649933:0:22713:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd1153e6c00, rc 0) 00000100:00100000:2.0:1788843925.650012:0:22713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f987b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a6e673fb-9566-47bf-b86a-d710f4950716+21:18731:x1875738116652032:12345-192.168.203.33@tcp:101:lfs.0 Request processed in 817us (1154us total) trans 12884901900 rc 0/0 00000100:00100000:2.0:1788843925.650021:0:22713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 40 00000100:00100000:2.0:1788843925.655451:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843925.655846:0:23870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116652288 00000100:00100000:3.0:1788843925.655858:0:23870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116652288 00000100:00100000:3.0:1788843925.655944:0:23870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 0 00000100:00100000:3.0:1788843925.655957:0:23870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10fe21880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a6e673fb-9566-47bf-b86a-d710f4950716+21:2388:x1875738116652288:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788843925.655986:0:23870:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788843925.656019:0:23870:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd1153e6c00/0xa762dfcbd58d3114 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490fa2 expref: 21 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843925.656042:0:23870:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9bd102e00a00) 00010000:00010000:3.0:1788843925.656047:0:23870:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788843925.656117:0:23870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10fe21880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a6e673fb-9566-47bf-b86a-d710f4950716+20:2388:x1875738116652288:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 163us (678us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843925.656125:0:23870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 0 00000040:00080000:0.0:1788843925.658994:0:22748:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788843925.660762:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1788843925.660860:0:25511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116652160 00000100:00100000:1.0:1788843925.660871:0:25511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116652160 00000100:00100000:1.0:1788843925.660940:0:25511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 41 00000100:00100000:1.0:1788843925.660951:0:25511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f985180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a6e673fb-9566-47bf-b86a-d710f4950716+20:18731:x1875738116652160:12345-192.168.203.33@tcp:54:lfs.0 00010000:00010000:1.0:1788843925.661055:0:25511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbebc00/0xa762dfcbd58d3122 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 25511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843925.661096:0:25511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbebc00/0xa762dfcbd58d3122 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843925.661109:0:25511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbebc00/0xa762dfcbd58d3122 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843925.661202:0:25511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbebc00/0xa762dfcbd58d3122 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843925.661210:0:25511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbebc00/0xa762dfcbd58d3122 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 25511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843925.661217:0:25511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbebc00/0xa762dfcbd58d3122 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843925.661224:0:25511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd13fbebc00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1788843925.661229:0:25511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbebc00/0xa762dfcbd58d3122 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843925.661237:0:25511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbebc00/0xa762dfcbd58d3122 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 25511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843925.661251:0:25511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9bd102e00a00) 00010000:00010000:1.0:1788843925.661254:0:25511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788843925.661260:0:25511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbebc00/0xa762dfcbd58d3122 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843925.661267:0:25511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbebc00/0xa762dfcbd58d3122 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25511 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843925.661345:0:25511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f985180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a6e673fb-9566-47bf-b86a-d710f4950716+20:18731:x1875738116652160:12345-192.168.203.33@tcp:54:lfs.0 Request processed in 395us (595us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843925.661359:0:25511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 41 00000100:00100000:2.0:1788843925.665822:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1788843925.666067:0:22715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116652544 00000100:00100000:0.0:1788843925.666080:0:22715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116652544 00000100:00100000:0.0:1788843925.667204:0:22715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7 00000100:00100000:0.0:1788843925.667224:0:22715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10fe20e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a6e673fb-9566-47bf-b86a-d710f4950716+20:18731:x1875738116652544:12345-192.168.203.33@tcp:35:lfs.0 00000100:00100000:0.0:1788843925.667510:0:22715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10fe20e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a6e673fb-9566-47bf-b86a-d710f4950716+21:18731:x1875738116652544:12345-192.168.203.33@tcp:35:lfs.0 Request processed in 293us (1701us total) trans 12884901901 rc 0/0 00000100:00100000:0.0:1788843925.667518:0:22715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7 00000040:00080000:2.0:1788843925.852781:0:23469:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788843925.939371:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1788843925.939436:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1788843925.939474:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1788843925.939510:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1788843925.942650:0:24225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116652800 00000100:00100000:1.0:1788843925.942671:0:24225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116652800 00000100:00100000:2.0:1788843925.942717:0:24224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116653056 00000100:00100000:2.0:1788843925.942724:0:24224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116653056 00000100:00100000:2.0:1788843925.942767:0:24224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116652672 00000100:00100000:1.0:1788843925.942769:0:24225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116652928 00000100:00100000:2.0:1788843925.942771:0:24224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116652672 00000100:00100000:1.0:1788843925.942775:0:24225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116652928 00000100:00100000:2.0:1788843925.942802:0:24224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 19 00000100:00100000:2.0:1788843925.942833:0:24224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd140e0ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d1bbae83-8212-4d8d-abaf-75a84733a0c2+5:2388:x1875738116653056:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:2.0:1788843925.942921:0:24224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd140e0ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d1bbae83-8212-4d8d-abaf-75a84733a0c2+5:2388:x1875738116653056:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 90us (3484us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843925.943936:0:24224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 19 00000100:00100000:2.0:1788843925.943965:0:24224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 20 00000100:00100000:2.0:1788843925.943986:0:24224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141ae8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a6e673fb-9566-47bf-b86a-d710f4950716+5:2388:x1875738116652800:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:2.0:1788843925.944032:0:24224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141ae8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a6e673fb-9566-47bf-b86a-d710f4950716+5:2388:x1875738116652800:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 51us (4675us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843925.944055:0:24224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 20 00000100:00100000:2.0:1788843925.944223:0:24224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 21 00000100:00100000:2.0:1788843925.944230:0:24224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141ae8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a6e673fb-9566-47bf-b86a-d710f4950716+5:2388:x1875738116652672:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:2.0:1788843925.944257:0:24224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141ae8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a6e673fb-9566-47bf-b86a-d710f4950716+5:2388:x1875738116652672:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 28us (4783us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843925.944264:0:24224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 21 00000100:00100000:2.0:1788843925.944276:0:24224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 22 00000100:00100000:2.0:1788843925.944282:0:24224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141ae9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d1bbae83-8212-4d8d-abaf-75a84733a0c2+5:2388:x1875738116652928:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:2.0:1788843925.944315:0:24224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141ae9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d1bbae83-8212-4d8d-abaf-75a84733a0c2+5:2388:x1875738116652928:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 34us (4805us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843925.944322:0:24224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 22 00000100:00080000:0.0:1788843925.946186:0:22707:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788843925.946196:0:22707:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788843926.018950:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843926.020993:0:22713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116653312 00000100:00100000:2.0:1788843926.021012:0:22713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116653312 00000100:00100000:2.0:1788843926.021367:0:22713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 42 00000100:00100000:2.0:1788843926.021381:0:22713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f986d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a6e673fb-9566-47bf-b86a-d710f4950716+21:18762:x1875738116653312:12345-192.168.203.33@tcp:101:cat.0 00010000:00010000:2.0:1788843926.021409:0:22713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788843926.021447:0:22713:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd1153e6600/0xa762dfcbd58d3129 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf24d95f22490fa9 expref: -99 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843926.021780:0:22713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd1153e6c00/0xa762dfcbd58d3130 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843926.021799:0:22713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd1153e6c00/0xa762dfcbd58d3130 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843926.021813:0:22713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd1153e6c00/0xa762dfcbd58d3130 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788843926.021843:0:22713:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788843926.021997:0:22713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd1153e6600/0xa762dfcbd58d3129 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490fa9 expref: 24 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843926.022019:0:22713:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd1153e6c00/0xa762dfcbd58d3130 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490fa9 expref: 23 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843926.022029:0:22713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9bd102e00a00) 00010000:00010000:2.0:1788843926.022031:0:22713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788843926.022036:0:22713:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd1153e6c00, rc 0) 00000100:00100000:2.0:1788843926.023062:0:22713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f986d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a6e673fb-9566-47bf-b86a-d710f4950716+23:18762:x1875738116653312:12345-192.168.203.33@tcp:101:cat.0 Request processed in 1677us (4118us total) trans 12884901902 rc 0/0 00000100:00100000:2.0:1788843926.023072:0:22713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 42 00000100:00100000:2.0:1788843926.027876:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1788843926.028045:0:22696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116653440 00000100:00100000:0.0:1788843926.028101:0:22696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116653440 00000100:00100000:3.0:1788843926.028516:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1788843926.028712:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116653696 00000100:00100000:1.0:1788843926.028718:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116653696 00000100:00100000:1.0:1788843926.028779:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 8 00000100:00100000:1.0:1788843926.028790:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f984380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a6e673fb-9566-47bf-b86a-d710f4950716+24:18762:x1875738116653696:12345-192.168.203.33@tcp:35:cat.0 00000100:00100000:1.0:1788843926.029133:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f984380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a6e673fb-9566-47bf-b86a-d710f4950716+25:18762:x1875738116653696:12345-192.168.203.33@tcp:35:cat.0 Request processed in 344us (617us total) trans 12884901903 rc 0/0 00000100:00100000:1.0:1788843926.029169:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 8 00000100:00100000:0.0:1788843926.029909:0:22696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1 00000100:00100000:0.0:1788843926.029921:0:22696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10fe21f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a6e673fb-9566-47bf-b86a-d710f4950716+24:2388:x1875738116653440:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788843926.029936:0:22696:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788843926.029962:0:22696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd1153e6c00/0xa762dfcbd58d3130 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490fa9 expref: 24 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843926.029994:0:22696:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9bd102e00a00) 00010000:00010000:0.0:1788843926.030000:0:22696:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788843926.030038:0:22696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10fe21f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a6e673fb-9566-47bf-b86a-d710f4950716+23:2388:x1875738116653440:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 120us (2177us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843926.030045:0:22696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1 00010000:00010000:2.0:1788843926.106690:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788843926.116515:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1788843926.116673:0:25511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116653952 00000100:00100000:1.0:1788843926.116685:0:25511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116653952 00000100:00100000:1.0:1788843926.116766:0:25511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 43 00000100:00100000:1.0:1788843926.116778:0:25511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f985f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a6e673fb-9566-47bf-b86a-d710f4950716+23:18768:x1875738116653952:12345-192.168.203.33@tcp:101:dd.0 00010000:00010000:1.0:1788843926.116811:0:25511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788843926.116843:0:25511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbebc00/0xa762dfcbd58d313e lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf24d95f22490fb0 expref: -99 pid: 25511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843926.116994:0:25511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbea400/0xa762dfcbd58d3145 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 25511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843926.117011:0:25511:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd1153e6800/0xa762dfcbd58d30e3 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490f8d expref: 24 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843926.117021:0:25511:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbeb000/0xa762dfcbd58d30f8 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490f94 expref: 24 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843926.117045:0:25511:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbea400/0xa762dfcbd58d3145 lrc: 5/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843926.117086:0:25511:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbeb000/0xa762dfcbd58d30f8 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490f94 expref: 24 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843926.117103:0:25511:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbeb000/0xa762dfcbd58d30f8 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490f94 expref: 24 pid: 22711 timeout: 804 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843926.117118:0:25511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd1054e2680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:25511:1875738134595072:192.168.203.33@tcp:104: 00010000:00010000:1.0:1788843926.117262:0:25511:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bd1153e6800/0xa762dfcbd58d30e3 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490f8d expref: 24 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843926.117272:0:25511:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd1153e6800/0xa762dfcbd58d30e3 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490f8d expref: 24 pid: 22712 timeout: 804 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843926.117281:0:25511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd1054e1500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:25511:1875738134595200:192.168.203.33@tcp:104: 00000100:00100000:1.0:1788843926.117307:0:25511:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd140dc8480 going to sleep for 11 seconds 00000100:00100000:2.0:1788843926.124589:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1788843926.125617:0:25511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd1054e2680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:25511:1875738134595072:192.168.203.33@tcp:104: 00000100:00100000:1.0:1788843926.125633:0:25511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd1054e1500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:25511:1875738134595200:192.168.203.33@tcp:104: 00010000:00010000:1.0:1788843926.125676:0:25511:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbea400/0xa762dfcbd58d3145 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25511 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843926.126288:0:23870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116654080 00000100:00100000:3.0:1788843926.126316:0:23870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116654080 00010000:00010000:3.0:1788843926.126361:0:23870:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbeb000/0xa762dfcbd58d30f8 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490f94 expref: 25 pid: 22711 timeout: 804 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843926.126452:0:23870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 17 00000100:00100000:3.0:1788843926.126464:0:23870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10fe23800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a6e673fb-9566-47bf-b86a-d710f4950716+25:2388:x1875738116654080:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788843926.126482:0:23870:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788843926.126489:0:23870:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbeb000/0xa762dfcbd58d30f8 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490f94 expref: 25 pid: 22711 timeout: 804 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843926.126503:0:23870:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbeb000/0xa762dfcbd58d30f8 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490f94 expref: 25 pid: 22711 timeout: 804 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843926.126528:0:23870:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbeb000/0xa762dfcbd58d30f8 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490f94 expref: 25 pid: 22711 timeout: 804 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843926.126548:0:23870:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9bd102e00a00) 00010000:00010000:3.0:1788843926.126554:0:23870:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbea400/0xa762dfcbd58d3145 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843926.126562:0:23870:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbea400/0xa762dfcbd58d3145 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843926.126570:0:23870:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788843926.126899:0:23870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10fe23800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a6e673fb-9566-47bf-b86a-d710f4950716+24:2388:x1875738116654080:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 436us (2322us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843926.126908:0:23870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 17 00000100:00100000:0.0:1788843926.127039:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1788843926.130461:0:22697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116654208 00000100:00100000:1.0:1788843926.130483:0:22697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116654208 00010000:00010000:1.0:1788843926.130559:0:22697:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd1153e6800/0xa762dfcbd58d30e3 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490f8d expref: 24 pid: 22712 timeout: 804 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843926.130608:0:22697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 18 00000100:00100000:1.0:1788843926.130618:0:22697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd11504e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a6e673fb-9566-47bf-b86a-d710f4950716+24:2387:x1875738116654208:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788843926.130651:0:22697:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788843926.130659:0:22697:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bd1153e6800/0xa762dfcbd58d30e3 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490f8d expref: 24 pid: 22712 timeout: 804 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843926.130685:0:22697:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bd1153e6800/0xa762dfcbd58d30e3 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490f8d expref: 24 pid: 22712 timeout: 804 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843926.130710:0:22697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd1153e6800/0xa762dfcbd58d30e3 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490f8d expref: 24 pid: 22712 timeout: 804 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843926.130730:0:22697:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9bd102e00a00) 00010000:00010000:1.0:1788843926.130736:0:22697:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbea400/0xa762dfcbd58d3145 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843926.130746:0:22697:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbea400/0xa762dfcbd58d3145 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 25511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843926.130754:0:22697:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbea400/0xa762dfcbd58d3145 lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 25511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843926.130792:0:22697:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788843926.130861:0:22697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd11504e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a6e673fb-9566-47bf-b86a-d710f4950716+23:2387:x1875738116654208:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 243us (3822us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843926.130869:0:22697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 18 00010000:00010000:0.0:1788843926.131655:0:25511:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbea400/0xa762dfcbd58d3145 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843926.131676:0:25511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbea400/0xa762dfcbd58d3145 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788843926.131698:0:25511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1788843926.131881:0:25511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbebc00/0xa762dfcbd58d313e lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490fb0 expref: 24 pid: 25511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843926.131903:0:25511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbea400/0xa762dfcbd58d3145 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490fb0 expref: 23 pid: 25511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843926.131911:0:25511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9bd102e00a00) 00010000:00010000:0.0:1788843926.131915:0:25511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788843926.131928:0:25511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd13fbea400, rc 0) 00000100:00100000:0.0:1788843926.131995:0:25511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f985f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a6e673fb-9566-47bf-b86a-d710f4950716+23:18768:x1875738116653952:12345-192.168.203.33@tcp:101:dd.0 Request processed in 15218us (15493us total) trans 12884901904 rc 0/0 00000100:00100000:0.0:1788843926.132004:0:25511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 43 00000100:00100000:0.0:1788843926.134593:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1788843926.134840:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116654336 00000100:00100000:1.0:1788843926.134851:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116654336 00000100:00100000:1.0:1788843926.138370:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 44 00000100:00100000:1.0:1788843926.138406:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141aeb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a6e673fb-9566-47bf-b86a-d710f4950716+23:18768:x1875738116654336:12345-192.168.203.33@tcp:101:dd.0 00010000:00010000:1.0:1788843926.138434:0:22711:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788843926.138474:0:22711:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbea800/0xa762dfcbd58d3153 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf24d95f22490fb7 expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843926.138521:0:22711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbeae00/0xa762dfcbd58d315a lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843926.138538:0:22711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbeae00/0xa762dfcbd58d315a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843926.138550:0:22711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbeae00/0xa762dfcbd58d315a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843926.138720:0:22711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbea800/0xa762dfcbd58d3153 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490fb7 expref: 25 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843926.138742:0:22711:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbeae00/0xa762dfcbd58d315a lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490fb7 expref: 24 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843926.138752:0:22711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9bd102e00a00) 00010000:00010000:1.0:1788843926.138755:0:22711:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788843926.138760:0:22711:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd13fbeae00, rc 0) 00000100:00100000:1.0:1788843926.138849:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141aeb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a6e673fb-9566-47bf-b86a-d710f4950716+24:18768:x1875738116654336:12345-192.168.203.33@tcp:101:dd.0 Request processed in 463us (4269us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843926.138857:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 44 00000100:00100000:3.0:1788843926.142229:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843926.143819:0:22713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116654592 00000100:00100000:2.0:1788843926.143838:0:22713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116654592 00000100:00100000:0.0:1788843926.143929:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 45 00000100:00100000:0.0:1788843926.143944:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f987480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a6e673fb-9566-47bf-b86a-d710f4950716+24:18768:x1875738116654592:12345-192.168.203.33@tcp:36:dd.0 00010000:00010000:0.0:1788843926.144260:0:22712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd00873ac00/0xa762dfcbd58d3161 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843926.144281:0:22712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd00873ac00/0xa762dfcbd58d3161 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843926.144293:0:22712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd00873ac00/0xa762dfcbd58d3161 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788843926.144340:0:22712:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901905 00000004:00010000:0.0:1788843926.144362:0:22712:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000050eb3fe8 reply state 00000000ecfc1229 transno 12884901906 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd00873ac00/0xa762dfcbd58d3161 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843926.144375:0:22712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd00873ac00/0xa762dfcbd58d3161 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843926.144383:0:22712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9bd102e00a00) 00010000:00010000:0.0:1788843926.144386:0:22712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788843926.144390:0:22712:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788843926.144620:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f987480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a6e673fb-9566-47bf-b86a-d710f4950716+27:18768:x1875738116654592:12345-192.168.203.33@tcp:36:dd.0 Request processed in 678us (2402us total) trans 12884901906 rc 0/0 00000100:00100000:0.0:1788843926.144628:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 45 00000020:00080000:0.0:1788843926.144806:0:22712:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1788843926.149594:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843926.149816:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116654720 00000100:00100000:2.0:1788843926.149829:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116654720 00000100:00100000:2.0:1788843926.149938:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 46 00000100:00100000:2.0:1788843926.149950:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141ae8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a6e673fb-9566-47bf-b86a-d710f4950716+27:18768:x1875738116654720:12345-192.168.203.33@tcp:101:dd.0 00010000:00010000:2.0:1788843926.149986:0:22712:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788843926.150012:0:22712:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd1153e6800/0xa762dfcbd58d3168 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf24d95f22490fbe expref: -99 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843926.150186:0:22712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd1153e6800/0xa762dfcbd58d3168 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490fbe expref: 28 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843926.150224:0:22712:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd1153e6800/0xa762dfcbd58d3168 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490fbe expref: 28 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843926.150248:0:22712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9bd102e00a00) 00010000:00010000:2.0:1788843926.150251:0:22712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788843926.150256:0:22712:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd1153e6800, rc 0) 00000100:00100000:2.0:1788843926.150427:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141ae8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a6e673fb-9566-47bf-b86a-d710f4950716+28:18768:x1875738116654720:12345-192.168.203.33@tcp:101:dd.0 Request processed in 478us (846us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843926.150434:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 46 00000100:00100000:3.0:1788843926.164620:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1788843926.167792:0:22698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116654976 00000100:00100000:0.0:1788843926.167812:0:22698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116654976 00000100:00100000:0.0:1788843926.167905:0:22698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 2 00000100:00100000:0.0:1788843926.167915:0:22698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f984e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a6e673fb-9566-47bf-b86a-d710f4950716+28:18768:x1875738116654976:12345-192.168.203.33@tcp:103:dd.0 00010000:00010000:0.0:1788843926.167932:0:22698:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788843926.167958:0:22698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd1153e6800/0xa762dfcbd58d3168 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490fbe expref: 28 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843926.167991:0:22698:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9bd102e00a00) 00010000:00010000:0.0:1788843926.167998:0:22698:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788843926.168074:0:22698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f984e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a6e673fb-9566-47bf-b86a-d710f4950716+27:18768:x1875738116654976:12345-192.168.203.33@tcp:103:dd.0 Request processed in 159us (3468us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843926.168083:0:22698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 2 00000100:00100000:2.0:1788843926.178098:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1788843926.178275:0:22713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116655104 00000100:00100000:0.0:1788843926.178287:0:22713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116655104 00000100:00100000:0.0:1788843926.178366:0:22713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 47 00000100:00100000:0.0:1788843926.178378:0:22713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10fe22680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a6e673fb-9566-47bf-b86a-d710f4950716+27:18768:x1875738116655104:12345-192.168.203.33@tcp:58:dd.0 00010000:00010000:0.0:1788843926.178511:0:22713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd00873a800/0xa762dfcbd58d316f lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843926.178532:0:22713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd00873a800/0xa762dfcbd58d316f lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843926.178545:0:22713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd00873a800/0xa762dfcbd58d316f lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788843926.182569:0:22713:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788843926.182611:0:22713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 64 off8384 00000040:00080000:0.0:1788843926.182794:0:22713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x14:0x0].1, 136 off8328 00000100:00100000:0.0:1788843926.182921:0:22713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10fe22680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a6e673fb-9566-47bf-b86a-d710f4950716+27:18768:x1875738116655104:12345-192.168.203.33@tcp:58:dd.0 Request processed in 4539us (4829us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843926.182933:0:22713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 47 00000100:00100000:1.0:1788843926.185416:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843926.185569:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116655232 00000100:00100000:3.0:1788843926.185581:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116655232 00000100:00100000:3.0:1788843926.185660:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 48 00000100:00100000:3.0:1788843926.185681:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1054e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a6e673fb-9566-47bf-b86a-d710f4950716+27:18768:x1875738116655232:12345-192.168.203.33@tcp:101:dd.0 00010000:00010000:3.0:1788843926.185704:0:22711:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788843926.185728:0:22711:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be3400/0xa762dfcbd58d3176 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf24d95f22490fc5 expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843926.185792:0:22711:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd00873a800/0xa762dfcbd58d316f lrc: 2/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843926.185803:0:22711:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be3400/0xa762dfcbd58d3176 lrc: 4/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490fc5 expref: 28 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843926.185824:0:22711:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9bd00873a800/0xa762dfcbd58d316f lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843926.185837:0:22711:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be3400/0xa762dfcbd58d3176 lrc: 3/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490fc5 expref: 28 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843926.185854:0:22711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9bd102e00a00) 00010000:00010000:3.0:1788843926.185858:0:22711:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788843926.185862:0:22711:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be3400/0xa762dfcbd58d3176 lrc: 3/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490fc5 expref: 28 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843926.185869:0:22711:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd007be3400, rc 0) 00000100:00100000:3.0:1788843926.185937:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1054e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a6e673fb-9566-47bf-b86a-d710f4950716+28:18768:x1875738116655232:12345-192.168.203.33@tcp:101:dd.0 Request processed in 258us (534us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843926.185962:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 48 00000040:00080000:0.0:1788843926.682539:0:22748:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:0.0:1788843926.682552:0:22748:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788843926.682583:0:22748:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:0.0:1788843926.682594:0:22748:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:0.0:1788843926.683259:0:22748:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd141aeb100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:22748:1875738134595328:192.168.203.33@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788843926.685177:0:22748:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd10764a900 going to sleep for 11 seconds 00000100:00100000:1.0:1788843926.690079:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843926.690386:0:25511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116655360 00000100:00100000:3.0:1788843926.690397:0:25511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116655360 00000100:00100000:3.0:1788843926.690490:0:25511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 49 00000100:00100000:3.0:1788843926.690503:0:25511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1054e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a6e673fb-9566-47bf-b86a-d710f4950716+29:18770:x1875738116655360:12345-192.168.203.33@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788843926.690538:0:25511:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x2000013a1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788843926.690823:0:25511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1054e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a6e673fb-9566-47bf-b86a-d710f4950716+29:18770:x1875738116655360:12345-192.168.203.33@tcp:53:lhsmtool_posix.0 Request processed in 322us (756us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843926.690831:0:25511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 49 00000100:00100000:0.0:1788843926.692599:0:22748:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd141aeb100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:22748:1875738134595328:192.168.203.33@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788843926.695607:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1788843926.695853:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116655488 00000100:00100000:1.0:1788843926.695865:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116655488 00000100:00100000:1.0:1788843926.696743:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 50 00000100:00100000:1.0:1788843926.696759:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f985880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a6e673fb-9566-47bf-b86a-d710f4950716+28:18770:x1875738116655488:12345-192.168.203.33@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1788843926.696857:0:22711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbeaa00/0xa762dfcbd58d317d lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843926.696879:0:22711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbeaa00/0xa762dfcbd58d317d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843926.697773:0:22711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbeaa00/0xa762dfcbd58d317d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843926.697934:0:22711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbeb600/0xa762dfcbd58d3184 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843926.697958:0:22711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbeb600/0xa762dfcbd58d3184 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843926.697983:0:22711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbeb600/0xa762dfcbd58d3184 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843926.698015:0:22711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbeb800/0xa762dfcbd58d318b lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843926.698024:0:22711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbeb800/0xa762dfcbd58d318b lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843926.698030:0:22711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbeb800/0xa762dfcbd58d318b lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788843926.698100:0:22711:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1788843926.698104:0:22711:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788843926.698118:0:22711:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbeb800/0xa762dfcbd58d318b lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843926.698129:0:22711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbeaa00/0xa762dfcbd58d317d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843926.698136:0:22711:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbeaa00/0xa762dfcbd58d317d lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843926.698193:0:22711:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbeaa00/0xa762dfcbd58d317d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843926.698199:0:22711:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd13fbeaa00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1788843926.698203:0:22711:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbeaa00/0xa762dfcbd58d317d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843926.698210:0:22711:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbeaa00/0xa762dfcbd58d317d lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843926.698223:0:22711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9bd00746c700) 00010000:00010000:1.0:1788843926.698227:0:22711:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788843926.698232:0:22711:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbeaa00/0xa762dfcbd58d317d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843926.698237:0:22711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbeaa00/0xa762dfcbd58d317d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843926.698253:0:22711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbeb600/0xa762dfcbd58d3184 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843926.698267:0:22711:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbeb600/0xa762dfcbd58d3184 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843926.698273:0:22711:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbeb600/0xa762dfcbd58d3184 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843926.698277:0:22711:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd13fbeb600 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1788843926.698280:0:22711:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbeb600/0xa762dfcbd58d3184 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843926.698286:0:22711:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbeb600/0xa762dfcbd58d3184 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843926.698294:0:22711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x925dcd63 (ffff9bd00746b000) 00010000:00010000:1.0:1788843926.698297:0:22711:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788843926.698300:0:22711:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbeb600/0xa762dfcbd58d3184 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843926.698306:0:22711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbeb600/0xa762dfcbd58d3184 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843926.698320:0:22711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbeb800/0xa762dfcbd58d318b lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843926.698325:0:22711:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbeb800/0xa762dfcbd58d318b lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843926.698331:0:22711:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbeb800/0xa762dfcbd58d318b lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843926.698336:0:22711:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd13fbeb800 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1788843926.698343:0:22711:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbeb800/0xa762dfcbd58d318b lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843926.698349:0:22711:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbeb800/0xa762dfcbd58d318b lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843926.698357:0:22711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9bd102e00a00) 00010000:00010000:1.0:1788843926.698360:0:22711:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788843926.698363:0:22711:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbeb800/0xa762dfcbd58d318b lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843926.698369:0:22711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbeb800/0xa762dfcbd58d318b lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843926.698470:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f985880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a6e673fb-9566-47bf-b86a-d710f4950716+28:18770:x1875738116655488:12345-192.168.203.33@tcp:34:lhsmtool_posix.0 Request processed in 1712us (2872us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843926.698481:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 50 00000100:00100000:3.0:1788843926.703222:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1788843926.703590:0:22713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116655744 00000100:00100000:0.0:1788843926.703602:0:22713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116655744 00000100:00100000:0.0:1788843926.703690:0:22713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 51 00000100:00100000:0.0:1788843926.703706:0:22713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1074fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a6e673fb-9566-47bf-b86a-d710f4950716+28:18770:x1875738116655744:12345-192.168.203.33@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788843926.703730:0:22713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788843926.703755:0:22713:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd00873a200/0xa762dfcbd58d3192 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf24d95f22490fcc expref: -99 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843926.703904:0:22713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd00873b200/0xa762dfcbd58d3199 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843926.703923:0:22713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd00873b200/0xa762dfcbd58d3199 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843926.703936:0:22713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd00873b200/0xa762dfcbd58d3199 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788843926.703949:0:22713:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1788843926.704076:0:22713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd00873b200/0xa762dfcbd58d3199 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843926.704086:0:22713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd00873b200/0xa762dfcbd58d3199 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843926.704093:0:22713:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd00873b200/0xa762dfcbd58d3199 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843926.704100:0:22713:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd00873b200 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1788843926.704105:0:22713:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd00873b200/0xa762dfcbd58d3199 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843926.704114:0:22713:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd00873b200/0xa762dfcbd58d3199 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843926.704129:0:22713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9bd102e00a00) 00010000:00010000:0.0:1788843926.704132:0:22713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788843926.704137:0:22713:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd00873b200/0xa762dfcbd58d3199 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843926.704180:0:22713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd00873b200/0xa762dfcbd58d3199 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843926.704229:0:22713:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd00873a200/0xa762dfcbd58d3192 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490fcc expref: 30 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843926.704241:0:22713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9bd00746c700) 00010000:00010000:0.0:1788843926.704243:0:22713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788843926.704247:0:22713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd00873a200/0xa762dfcbd58d3192 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490fcc expref: 30 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843926.704269:0:22713:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd00873a200, rc 0) 00000100:00100000:0.0:1788843926.704334:0:22713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1074fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a6e673fb-9566-47bf-b86a-d710f4950716+29:18770:x1875738116655744:12345-192.168.203.33@tcp:101:lhsmtool_posix.0 Request processed in 633us (1126us total) trans 12884901907 rc 301/301 00000100:00100000:0.0:1788843926.704343:0:22713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 51 00000100:00100000:0.0:1788843926.708136:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843926.708327:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116655872 00000100:00100000:2.0:1788843926.708343:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116655872 00000100:00100000:2.0:1788843926.708409:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 52 00000100:00100000:2.0:1788843926.708422:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141aeb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a6e673fb-9566-47bf-b86a-d710f4950716+29:18770:x1875738116655872:12345-192.168.203.33@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788843926.708474:0:22712:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x2000013a1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788843926.708627:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141aeb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a6e673fb-9566-47bf-b86a-d710f4950716+29:18770:x1875738116655872:12345-192.168.203.33@tcp:53:lhsmtool_posix.0 Request processed in 203us (508us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843926.708635:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 52 00000100:00100000:3.0:1788843926.722757:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1788843926.722932:0:22713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116656128 00000100:00100000:0.0:1788843926.722945:0:22713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116656128 00000100:00100000:0.0:1788843926.723026:0:22713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 53 00000100:00100000:0.0:1788843926.723039:0:22713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1074fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a6e673fb-9566-47bf-b86a-d710f4950716+29:18770:x1875738116656128:12345-192.168.203.33@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788843926.723064:0:22713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788843926.723090:0:22713:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd00873a400/0xa762dfcbd58d31a7 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf24d95f22490fd3 expref: -99 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788843926.723615:0:22713:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x2c0000401:0x7:0x0], count =59 00000004:00080000:0.0:1788843926.723624:0:22713:0:(osp_object.c:1645:osp_create()) Writing gap [0x2c0000401:0x7:0x0]+59 in llog 00000004:00080000:0.0:1788843926.723649:0:22713:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x42:0x0], index 1: 0 00010000:00010000:0.0:1788843926.723835:0:22713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd00873a600/0xa762dfcbd58d31ae lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843926.723853:0:22713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd00873a600/0xa762dfcbd58d31ae lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843926.723866:0:22713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd00873a600/0xa762dfcbd58d31ae lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843926.723932:0:22713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd00873a400/0xa762dfcbd58d31a7 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490fd3 expref: 32 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843926.723989:0:22713:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd00873a600/0xa762dfcbd58d31ae lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490fd3 expref: 31 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843926.724000:0:22713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9bd00746c200) 00010000:00010000:0.0:1788843926.724003:0:22713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788843926.724007:0:22713:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd00873a600, rc 0) 00000100:00100000:0.0:1788843926.724084:0:22713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1074fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a6e673fb-9566-47bf-b86a-d710f4950716+31:18770:x1875738116656128:12345-192.168.203.33@tcp:101:lhsmtool_posix.0 Request processed in 1047us (1340us total) trans 12884901908 rc 0/0 00000100:00100000:0.0:1788843926.724092:0:22713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 53 00000100:00100000:3.0:1788843926.730711:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843926.730918:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116656384 00000100:00100000:2.0:1788843926.730931:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116656384 00000100:00100000:2.0:1788843926.731013:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 54 00000100:00100000:2.0:1788843926.731026:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1074fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a6e673fb-9566-47bf-b86a-d710f4950716+31:18770:x1875738116656384:12345-192.168.203.33@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788843926.731098:0:22712:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788843926.731132:0:22712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd00873a600/0xa762dfcbd58d31ae lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490fd3 expref: 31 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843926.731211:0:22712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9bd00746c200) 00010000:00010000:2.0:1788843926.731224:0:22712:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788843926.731253:0:22712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd1153e7e00/0xa762dfcbd58d31bc lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843926.731268:0:22712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd1153e7e00/0xa762dfcbd58d31bc lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843926.731278:0:22712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd1153e7e00/0xa762dfcbd58d31bc lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843926.731294:0:22712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd1153e6600/0xa762dfcbd58d31c3 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0xaf04f7fa bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843926.731301:0:22712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd1153e6600/0xa762dfcbd58d31c3 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xaf04f7fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843926.731307:0:22712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd1153e6600/0xa762dfcbd58d31c3 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xaf04f7fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843926.731362:0:22712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd1153e7e00/0xa762dfcbd58d31bc lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843926.731369:0:22712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd1153e7e00/0xa762dfcbd58d31bc lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843926.731376:0:22712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd1153e7e00/0xa762dfcbd58d31bc lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843926.731382:0:22712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd1153e7e00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1788843926.731386:0:22712:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd1153e7e00/0xa762dfcbd58d31bc lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843926.731401:0:22712:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd1153e7e00/0xa762dfcbd58d31bc lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843926.731411:0:22712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9bd00746cd00) 00010000:00010000:2.0:1788843926.731413:0:22712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788843926.731417:0:22712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd1153e7e00/0xa762dfcbd58d31bc lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843926.731423:0:22712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd1153e7e00/0xa762dfcbd58d31bc lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843926.731435:0:22712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd1153e6600/0xa762dfcbd58d31c3 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xaf04f7fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843926.731441:0:22712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd1153e6600/0xa762dfcbd58d31c3 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xaf04f7fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843926.731447:0:22712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd1153e6600/0xa762dfcbd58d31c3 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xaf04f7fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843926.731454:0:22712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd1153e6600 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1788843926.731456:0:22712:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd1153e6600/0xa762dfcbd58d31c3 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xaf04f7fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843926.731463:0:22712:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd1153e6600/0xa762dfcbd58d31c3 lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xaf04f7fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843926.731470:0:22712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xaf04f7fa (ffff9bd102e00c00) 00010000:00010000:2.0:1788843926.731472:0:22712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788843926.731475:0:22712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd1153e6600/0xa762dfcbd58d31c3 lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0xaf04f7fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843926.731490:0:22712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd1153e6600/0xa762dfcbd58d31c3 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0xaf04f7fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843926.731594:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1074fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a6e673fb-9566-47bf-b86a-d710f4950716+30:18770:x1875738116656384:12345-192.168.203.33@tcp:36:lhsmtool_posix.0 Request processed in 569us (896us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788843926.731602:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 54 00000100:00100000:1.0:1788843926.735257:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1788843926.735357:0:22713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116656512 00000100:00100000:0.0:1788843926.735369:0:22713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116656512 00000100:00100000:0.0:1788843926.735450:0:22713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 55 00000100:00100000:0.0:1788843926.735464:0:22713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1054e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a6e673fb-9566-47bf-b86a-d710f4950716+30:18770:x1875738116656512:12345-192.168.203.33@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788843926.735484:0:22713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788843926.735513:0:22713:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd00873a400/0xa762dfcbd58d31ca lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf24d95f22490fda expref: -99 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843926.735557:0:22713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd00873a200/0xa762dfcbd58d31d1 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843926.735571:0:22713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd00873a200/0xa762dfcbd58d31d1 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843926.735584:0:22713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd00873a200/0xa762dfcbd58d31d1 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843926.735737:0:22713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd00873a400/0xa762dfcbd58d31ca lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490fda expref: 32 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843926.735769:0:22713:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd00873a200/0xa762dfcbd58d31d1 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490fda expref: 31 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843926.735778:0:22713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9bd00746c900) 00010000:00010000:0.0:1788843926.735780:0:22713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788843926.735784:0:22713:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd00873a200, rc 0) 00000100:00100000:0.0:1788843926.735864:0:22713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1054e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a6e673fb-9566-47bf-b86a-d710f4950716+31:18770:x1875738116656512:12345-192.168.203.33@tcp:101:lhsmtool_posix.0 Request processed in 403us (621us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843926.735875:0:22713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 55 00000100:00100000:3.0:1788843926.745225:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843926.745393:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116656768 00000100:00100000:2.0:1788843926.745407:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116656768 00000100:00100000:2.0:1788843926.745493:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 56 00000100:00100000:2.0:1788843926.745506:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1074ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a6e673fb-9566-47bf-b86a-d710f4950716+31:18770:x1875738116656768:12345-192.168.203.33@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788843926.745623:0:22712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd1153e6600/0xa762dfcbd58d31d8 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843926.745661:0:22712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd1153e6600/0xa762dfcbd58d31d8 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843926.745675:0:22712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd1153e6600/0xa762dfcbd58d31d8 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788843926.745887:0:22712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x12:0x0].2, 88 off8344 00000004:00080000:2.0:1788843926.745911:0:22712:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 704798768547ns, next at 705798754171ns, rc = 0 00000004:00010000:2.0:1788843926.745980:0:22712:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000028fe4b5c reply state 000000007d6e16a3 transno 12884901909 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd1153e6600/0xa762dfcbd58d31d8 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843926.745994:0:22712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd1153e6600/0xa762dfcbd58d31d8 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843926.746002:0:22712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9bd00746c900) 00010000:00010000:2.0:1788843926.746020:0:22712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1788843926.746026:0:22712:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788843926.746185:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1074ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a6e673fb-9566-47bf-b86a-d710f4950716+33:18770:x1875738116656768:12345-192.168.203.33@tcp:36:lhsmtool_posix.0 Request processed in 680us (974us total) trans 12884901909 rc 0/0 00000100:00100000:2.0:1788843926.746193:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 56 00000100:00100000:1.0:1788843926.750294:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1788843926.750403:0:22713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116656896 00000100:00100000:0.0:1788843926.750415:0:22713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116656896 00000100:00100000:0.0:1788843926.750496:0:22713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 57 00000100:00100000:0.0:1788843926.750508:0:22713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1054e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a6e673fb-9566-47bf-b86a-d710f4950716+33:18770:x1875738116656896:12345-192.168.203.33@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788843926.750534:0:22713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788843926.750573:0:22713:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd00873b200/0xa762dfcbd58d31df lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf24d95f22490fe1 expref: -99 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843926.750664:0:22713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd00873b200/0xa762dfcbd58d31df lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490fe1 expref: 34 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843926.750681:0:22713:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd00873b200/0xa762dfcbd58d31df lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490fe1 expref: 34 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843926.750704:0:22713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9bd00746c900) 00010000:00010000:0.0:1788843926.750708:0:22713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788843926.750730:0:22713:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd00873b200, rc 0) 00000100:00100000:0.0:1788843926.750807:0:22713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1054e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a6e673fb-9566-47bf-b86a-d710f4950716+34:18770:x1875738116656896:12345-192.168.203.33@tcp:101:lhsmtool_posix.0 Request processed in 301us (527us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843926.750815:0:22713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 57 00000100:00100000:0.0:1788843926.757757:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843926.758820:0:24224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116657024 00000100:00100000:2.0:1788843926.758836:0:24224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116657024 00000100:00100000:2.0:1788843926.758921:0:24224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 23 00000100:00100000:2.0:1788843926.758937:0:24224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141ae8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a6e673fb-9566-47bf-b86a-d710f4950716+5:2390:x1875738116657024:12345-192.168.203.33@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1788843926.759463:0:24224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141ae8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a6e673fb-9566-47bf-b86a-d710f4950716+6:2390:x1875738116657024:12345-192.168.203.33@tcp:2:lhsmtool_posix.0 Request processed in 530us (1719us total) trans 12884901891 rc 0/0 00000100:00100000:2.0:1788843926.759472:0:24224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 23 00000100:00100000:1.0:1788843926.770307:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843926.770412:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116657280 00000100:00100000:3.0:1788843926.770424:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116657280 00000100:00100000:3.0:1788843926.770504:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 9 00000100:00100000:3.0:1788843926.770517:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1054e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a6e673fb-9566-47bf-b86a-d710f4950716+34:18770:x1875738116657280:12345-192.168.203.33@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788843926.771308:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1054e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a6e673fb-9566-47bf-b86a-d710f4950716+35:18770:x1875738116657280:12345-192.168.203.33@tcp:35:lhsmtool_posix.0 Request processed in 789us (1010us total) trans 12884901910 rc 0/0 00000100:00100000:3.0:1788843926.771320:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 9 00000100:00100000:1.0:1788843926.782490:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843926.783468:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116657536 00000100:00100000:2.0:1788843926.783484:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116657536 00000100:00100000:2.0:1788843926.783577:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 58 00000100:00100000:2.0:1788843926.783589:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1054e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a6e673fb-9566-47bf-b86a-d710f4950716+35:18770:x1875738116657536:12345-192.168.203.33@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788843926.783753:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1054e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a6e673fb-9566-47bf-b86a-d710f4950716+35:18770:x1875738116657536:12345-192.168.203.33@tcp:57:lhsmtool_posix.0 Request processed in 165us (1276us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843926.783762:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 58 00000100:00100000:0.0:1788843926.790853:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843926.791089:0:22713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116657664 00000100:00100000:2.0:1788843926.791102:0:22713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116657664 00000100:00100000:2.0:1788843926.791387:0:22713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 59 00000100:00100000:2.0:1788843926.791400:0:22713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd14165e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a6e673fb-9566-47bf-b86a-d710f4950716+35:18770:x1875738116657664:12345-192.168.203.33@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788843926.791426:0:22713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788843926.791462:0:22713:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd1153e7e00/0xa762dfcbd58d31e6 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf24d95f22490fe8 expref: -99 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843926.791600:0:22713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd1153e6c00/0xa762dfcbd58d31ed lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843926.791619:0:22713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd1153e6c00/0xa762dfcbd58d31ed lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843926.794923:0:22713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd1153e6c00/0xa762dfcbd58d31ed lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788843926.795028:0:22713:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788843926.795058:0:22713:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bd1153e6c00/0xa762dfcbd58d31ed lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843926.795115:0:22713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd1153e7e00/0xa762dfcbd58d31e6 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490fe8 expref: 37 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843926.795196:0:22713:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd1153e6c00/0xa762dfcbd58d31ed lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490fe8 expref: 36 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843926.795208:0:22713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9bd00746c900) 00010000:00010000:2.0:1788843926.795211:0:22713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788843926.795216:0:22713:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd1153e6c00, rc 0) 00000100:00100000:2.0:1788843926.796917:0:22713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd14165e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a6e673fb-9566-47bf-b86a-d710f4950716+36:18770:x1875738116657664:12345-192.168.203.33@tcp:101:lhsmtool_posix.0 Request processed in 5505us (6062us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843926.796931:0:22713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 59 00000100:00100000:3.0:1788843926.804287:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1788843926.804465:0:24222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116657792 00000100:00100000:0.0:1788843926.804478:0:24222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116657792 00000100:00100000:0.0:1788843926.804824:0:24222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 24 00000100:00100000:0.0:1788843926.804840:0:24222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1074ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a6e673fb-9566-47bf-b86a-d710f4950716+6:2390:x1875738116657792:12345-192.168.203.33@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788843926.804863:0:24222:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788843926.804894:0:24222:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b1229ace/0xa762dfcbd58d31f4 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaf24d95f22490fef expref: -99 pid: 24222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788843926.804929:0:24222:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x42:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9f9795, blocks: 0x0 00010000:00010000:0.0:1788843926.804958:0:24222:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=704s v=(0 0) 00010000:00010000:0.0:1788843926.804973:0:24222:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788843926.804986:0:24222:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b1229ace/0xa762dfcbd58d31f4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490fef expref: 7 pid: 24222 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843926.805011:0:24222:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b1229ace/0xa762dfcbd58d31f4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490fef expref: 7 pid: 24222 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843926.805028:0:24222:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd00873a000, rc 0) 00000100:00100000:0.0:1788843926.805114:0:24222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1074ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a6e673fb-9566-47bf-b86a-d710f4950716+7:2390:x1875738116657792:12345-192.168.203.33@tcp:101:lhsmtool_posix.0 Request processed in 277us (839us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843926.805175:0:24222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 24 00000100:00100000:0.0:1788843926.813197:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843926.813330:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116658048 00000100:00100000:2.0:1788843926.813342:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116658048 00000100:00100000:2.0:1788843926.813414:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 60 00000100:00100000:2.0:1788843926.813462:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd14165ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a6e673fb-9566-47bf-b86a-d710f4950716+36:18770:x1875738116658048:12345-192.168.203.33@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788843926.813599:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd14165ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a6e673fb-9566-47bf-b86a-d710f4950716+36:18770:x1875738116658048:12345-192.168.203.33@tcp:57:lhsmtool_posix.0 Request processed in 148us (417us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843926.813608:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 60 00000100:00100000:3.0:1788843926.820354:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1788843926.820496:0:25511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116658176 00000100:00100000:1.0:1788843926.820510:0:25511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116658176 00000100:00100000:1.0:1788843926.820592:0:25511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 61 00000100:00100000:1.0:1788843926.820603:0:25511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1074fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a6e673fb-9566-47bf-b86a-d710f4950716+36:18770:x1875738116658176:12345-192.168.203.33@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1788843926.832846:0:22691:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901910 is committed 00000004:00080000:3.0:1788843926.832870:0:22691:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000001:00080000:3.0:1788843926.832955:0:22691:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901895 is committed 00010000:00010000:0.0:1788843926.833104:0:3616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbea200/0xa762dfcbd58d2fe7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843926.833122:0:3616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbea200/0xa762dfcbd58d2fe7 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843926.833130:0:3616:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbea200/0xa762dfcbd58d2fe7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843926.833137:0:3616:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd13fbea200 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1788843926.833179:0:3616:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbea200/0xa762dfcbd58d2fe7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843926.833190:0:3616:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbea200/0xa762dfcbd58d2fe7 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843926.833212:0:3616:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9bd00746bf00) 00010000:00010000:0.0:1788843926.833216:0:3616:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788843926.833222:0:3616:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbea200/0xa762dfcbd58d2fe7 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843926.833230:0:3616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbea200/0xa762dfcbd58d2fe7 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843926.833255:0:3616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd00873be00/0xa762dfcbd58d2fee lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843926.833261:0:3616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd00873be00/0xa762dfcbd58d2fee lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843926.833276:0:3616:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd00873be00/0xa762dfcbd58d2fee lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843926.833281:0:3616:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd00873be00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1788843926.833284:0:3616:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd00873be00/0xa762dfcbd58d2fee lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843926.833290:0:3616:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd00873be00/0xa762dfcbd58d2fee lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843926.833298:0:3616:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9bd00746cd00) 00010000:00010000:0.0:1788843926.833301:0:3616:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788843926.833304:0:3616:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd00873be00/0xa762dfcbd58d2fee lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843926.833310:0:3616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd00873be00/0xa762dfcbd58d2fee lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843926.833326:0:3616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd1153e7000/0xa762dfcbd58d30dc lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843926.833332:0:3616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd1153e7000/0xa762dfcbd58d30dc lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843926.833338:0:3616:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd1153e7000/0xa762dfcbd58d30dc lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843926.833343:0:3616:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd1153e7000 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1788843926.833346:0:3616:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd1153e7000/0xa762dfcbd58d30dc lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843926.833362:0:3616:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd1153e7000/0xa762dfcbd58d30dc lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843926.833371:0:3616:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff9bd102e00000) 00010000:00010000:0.0:1788843926.833373:0:3616:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788843926.833376:0:3616:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd1153e7000/0xa762dfcbd58d30dc lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843926.833382:0:3616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd1153e7000/0xa762dfcbd58d30dc lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843926.833399:0:3616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd00873ac00/0xa762dfcbd58d3161 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843926.833405:0:3616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd00873ac00/0xa762dfcbd58d3161 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843926.833411:0:3616:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd00873ac00/0xa762dfcbd58d3161 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843926.833415:0:3616:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd00873ac00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1788843926.833418:0:3616:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd00873ac00/0xa762dfcbd58d3161 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843926.833423:0:3616:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd00873ac00/0xa762dfcbd58d3161 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843926.833431:0:3616:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9bd102e00a00) 00010000:00010000:0.0:1788843926.833433:0:3616:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788843926.833445:0:3616:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd00873ac00/0xa762dfcbd58d3161 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843926.833458:0:3616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd00873ac00/0xa762dfcbd58d3161 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843926.833471:0:3616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd1153e6600/0xa762dfcbd58d31d8 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843926.833478:0:3616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd1153e6600/0xa762dfcbd58d31d8 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843926.833484:0:3616:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd1153e6600/0xa762dfcbd58d31d8 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843926.833489:0:3616:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd1153e6600 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1788843926.833492:0:3616:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd1153e6600/0xa762dfcbd58d31d8 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843926.833497:0:3616:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd1153e6600/0xa762dfcbd58d31d8 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843926.833506:0:3616:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9bd00746c900) 00010000:00010000:0.0:1788843926.833508:0:3616:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788843926.833510:0:3616:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd1153e6600/0xa762dfcbd58d31d8 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843926.833516:0:3616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd1153e6600/0xa762dfcbd58d31d8 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843926.834100:0:25511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1074fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a6e673fb-9566-47bf-b86a-d710f4950716+15:18770:x1875738116658176:12345-192.168.203.33@tcp:44:lhsmtool_posix.0 Request processed in 13489us (13752us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843926.834113:0:25511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 61 00010000:00010000:2.0:1788843926.834269:0:3617:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2a00/0xa762dfcbd58d3081 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843926.834277:0:3617:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2a00/0xa762dfcbd58d3081 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843926.834284:0:3617:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2a00/0xa762dfcbd58d3081 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843926.834289:0:3617:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd007be2a00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1788843926.834292:0:3617:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2a00/0xa762dfcbd58d3081 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843926.834298:0:3617:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2a00/0xa762dfcbd58d3081 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843926.834308:0:3617:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9bd00746cd00) 00010000:00010000:2.0:1788843926.834310:0:3617:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:2.0:1788843926.834313:0:3617:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2a00/0xa762dfcbd58d3081 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843926.834318:0:3617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2a00/0xa762dfcbd58d3081 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843926.834406:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd1054e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1875738134595456:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1788843926.834489:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843926.834879:0:24686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134595456 00000100:00100000:2.0:1788843926.834889:0:24686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134595456 00000100:00100000:2.0:1788843926.834952:0:24686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788843926.834986:0:24686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd14165f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3632:x1875738134595456:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1788843926.835163:0:24686:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1788843926.835167:0:24686:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1788843926.835170:0:24686:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1788843926.835172:0:24686:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb ctime from disk: 1788843925 -> 1788843925 00002000:00010000:2.0:1788843926.835175:0:24686:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1788843926.835221:0:24686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd14165f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3632:x1875738134595456:12345-0@lo:2:osp-syn-1-0.0 Request processed in 237us (732us total) trans 12884901892 rc 0/0 00000100:00100000:2.0:1788843926.835227:0:24686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000004:00080000:2.0:1788843926.835275:0:3632:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9bd1054e3b80/2, rc 0, transno 12884901892 00000100:00100000:2.0:1788843926.835282:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd1054e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1875738134595456:0@lo:2:osp-syn-1-0.0 00000100:00080000:1.0:1788843926.837268:0:22707:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788843926.849992:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843926.851798:0:24222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116658304 00000100:00100000:3.0:1788843926.851817:0:24222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116658304 00000100:00100000:3.0:1788843926.851903:0:24222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 26 00000100:00100000:3.0:1788843926.851917:0:24222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1054e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a6e673fb-9566-47bf-b86a-d710f4950716+7:2389:x1875738116658304:12345-192.168.203.33@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1788843926.852075:0:24222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1054e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a6e673fb-9566-47bf-b86a-d710f4950716+7:2389:x1875738116658304:12345-192.168.203.33@tcp:16:lhsmtool_posix.0 Request processed in 160us (2097us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843926.852084:0:24222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 26 00000100:00100000:0.0:1788843926.858388:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843926.858520:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116658560 00000100:00100000:2.0:1788843926.858532:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116658560 00000100:00100000:2.0:1788843926.858613:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 62 00000100:00100000:2.0:1788843926.858642:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd14165d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a6e673fb-9566-47bf-b86a-d710f4950716+15:18770:x1875738116658560:12345-192.168.203.33@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788843926.858715:0:22712:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788843926.858747:0:22712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd1153e6c00/0xa762dfcbd58d31ed lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490fe8 expref: 15 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843926.858771:0:22712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9bd00746c900) 00010000:00010000:2.0:1788843926.858778:0:22712:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788843926.858817:0:22712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd1153e7e00/0xa762dfcbd58d31fb lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843926.858833:0:22712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd1153e7e00/0xa762dfcbd58d31fb lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843926.858844:0:22712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd1153e7e00/0xa762dfcbd58d31fb lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788843926.859020:0:22712:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a2443e28 reply state 000000008f513a3c transno 12884901911 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd1153e7e00/0xa762dfcbd58d31fb lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843926.859035:0:22712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd1153e7e00/0xa762dfcbd58d31fb lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843926.859042:0:22712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9bd00746c900) 00010000:00010000:2.0:1788843926.859045:0:22712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788843926.859047:0:22712:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788843926.859219:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd14165d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a6e673fb-9566-47bf-b86a-d710f4950716+16:18770:x1875738116658560:12345-192.168.203.33@tcp:36:lhsmtool_posix.0 Request processed in 596us (845us total) trans 12884901911 rc 0/0 00000100:00100000:2.0:1788843926.859228:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 62 00000100:00100000:0.0:1788843926.864426:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843926.865529:0:24686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116658688 00000100:00100000:2.0:1788843926.865544:0:24686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116658688 00000100:00100000:2.0:1788843926.865794:0:24686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 27 00000100:00100000:2.0:1788843926.865808:0:24686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd14165dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a6e673fb-9566-47bf-b86a-d710f4950716+7:18770:x1875738116658688:12345-192.168.203.33@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788843926.865829:0:24686:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788843926.865851:0:24686:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000013dee11f/0xa762dfcbd58d3202 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaf24d95f22490ff6 expref: -99 pid: 24686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843926.865892:0:24686:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b1229ace/0xa762dfcbd58d31f4 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490fef expref: 8 pid: 24222 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843926.865902:0:24686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788843926.865907:0:24686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788843926.865912:0:24686:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000013dee11f/0xa762dfcbd58d3202 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490ff6 expref: 8 pid: 24686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843926.865985:0:24686:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b1229ace/0xa762dfcbd58d31f4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490fef expref: 8 pid: 24222 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843926.866001:0:24686:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b1229ace/0xa762dfcbd58d31f4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490fef expref: 8 pid: 24222 timeout: 804 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843926.866018:0:24686:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10fe20a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:24686:1875738134595584:192.168.203.33@tcp:104: 00000100:00100000:2.0:1788843926.866436:0:24686:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd10f9ae6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788843926.884775:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843926.884930:0:24686:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10fe20a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:24686:1875738134595584:192.168.203.33@tcp:104: 00010000:00010000:2.0:1788843926.884979:0:24686:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000013dee11f/0xa762dfcbd58d3202 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490ff6 expref: 8 pid: 24686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843926.885004:0:24686:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd1153e6c00, rc 0) 00000100:00100000:2.0:1788843926.885073:0:24686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd14165dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a6e673fb-9566-47bf-b86a-d710f4950716+8:18770:x1875738116658688:12345-192.168.203.33@tcp:101:lhsmtool_posix.0 Request processed in 19268us (20662us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843926.885082:0:24686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 27 00000100:00100000:3.0:1788843926.886105:0:22697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116658816 00000100:00100000:3.0:1788843926.886119:0:22697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116658816 00010000:00010000:3.0:1788843926.886204:0:22697:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b1229ace/0xa762dfcbd58d31f4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490fef expref: 8 pid: 24222 timeout: 804 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843926.886254:0:22697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 19 00000100:00100000:3.0:1788843926.886265:0:22697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd14165d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a6e673fb-9566-47bf-b86a-d710f4950716+8:2389:x1875738116658816:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788843926.886346:0:22697:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788843926.886374:0:22697:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b1229ace/0xa762dfcbd58d31f4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490fef expref: 8 pid: 24222 timeout: 804 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843926.886390:0:22697:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b1229ace/0xa762dfcbd58d31f4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490fef expref: 8 pid: 24222 timeout: 804 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843926.886415:0:22697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b1229ace/0xa762dfcbd58d31f4 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490fef expref: 8 pid: 24222 timeout: 804 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843926.886434:0:22697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788843926.886473:0:22697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788843926.886482:0:22697:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000013dee11f/0xa762dfcbd58d3202 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490ff6 expref: 7 pid: 24686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843926.886495:0:22697:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000013dee11f/0xa762dfcbd58d3202 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490ff6 expref: 7 pid: 24686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843926.886542:0:22697:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000013dee11f/0xa762dfcbd58d3202 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490ff6 expref: 7 pid: 24686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843926.886558:0:22697:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0079b9880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:22697:1875738134595712:192.168.203.33@tcp:105: 00000100:00100000:3.0:1788843926.888983:0:22697:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd140b6e540 going to sleep for 11 seconds 00000100:00100000:3.0:1788843926.905950:0:22697:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0079b9880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:22697:1875738134595712:192.168.203.33@tcp:105: 00010000:00010000:3.0:1788843926.905994:0:22697:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788843926.906068:0:22697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd14165d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a6e673fb-9566-47bf-b86a-d710f4950716+7:2389:x1875738116658816:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 19804us (21304us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843926.906081:0:22697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 19 00000100:00100000:1.0:1788843926.910438:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843926.910790:0:24222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116658944 00000100:00100000:3.0:1788843926.910803:0:24222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116658944 00000100:00100000:3.0:1788843926.910869:0:24222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 28 00000100:00100000:3.0:1788843926.910881:0:24222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1054e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a6e673fb-9566-47bf-b86a-d710f4950716+7:2387:x1875738116658944:12345-192.168.203.33@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1788843926.911074:0:24222:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1788843926.911078:0:24222:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb mtime from disk: 0 -> 1788843925 00002000:00010000:3.0:1788843926.911081:0:24222:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb atime from disk: 0 -> 1788843924 00002000:00010000:3.0:1788843926.911083:0:24222:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb ctime from disk: 1788843925 -> 1788843925 00002000:00010000:3.0:1788843926.911085:0:24222:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1788843926.911276:0:24222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1054e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a6e673fb-9566-47bf-b86a-d710f4950716+8:2387:x1875738116658944:12345-192.168.203.33@tcp:2:lhsmtool_posix.0 Request processed in 397us (849us total) trans 12884901893 rc 0/0 00000100:00100000:3.0:1788843926.911284:0:24222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 28 00000100:00100000:0.0:1788843926.920613:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843926.920796:0:24224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116659072 00000100:00100000:2.0:1788843926.920809:0:24224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116659072 00000100:00100000:2.0:1788843926.920879:0:24224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 29 00000100:00100000:2.0:1788843926.920891:0:24224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd14165ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a6e673fb-9566-47bf-b86a-d710f4950716+8:2390:x1875738116659072:12345-192.168.203.33@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1788843926.920948:0:24224:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000e28d712a/0xa762dfcbd58d3209 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843926.921005:0:24224:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000013dee11f/0xa762dfcbd58d3202 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490ff6 expref: 8 pid: 24686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843926.921015:0:24224:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788843926.921020:0:24224:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788843926.921024:0:24224:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e28d712a/0xa762dfcbd58d3209 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843926.921066:0:24224:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000013dee11f/0xa762dfcbd58d3202 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490ff6 expref: 8 pid: 24686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843926.921081:0:24224:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000013dee11f/0xa762dfcbd58d3202 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490ff6 expref: 8 pid: 24686 timeout: 804 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843926.921097:0:24224:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10fe20a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:24224:1875738134595840:192.168.203.33@tcp:104: 00000100:00100000:2.0:1788843926.921240:0:24224:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd10f9ae6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788843926.925830:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843926.926033:0:24224:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10fe20a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:24224:1875738134595840:192.168.203.33@tcp:104: 00010000:00010000:2.0:1788843926.926066:0:24224:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000e28d712a/0xa762dfcbd58d3209 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843926.926190:0:22698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116659200 00000100:00100000:3.0:1788843926.926200:0:22698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116659200 00010000:00010000:3.0:1788843926.926245:0:22698:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000013dee11f/0xa762dfcbd58d3202 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490ff6 expref: 9 pid: 24686 timeout: 804 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843926.926290:0:22698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 20 00000100:00100000:3.0:1788843926.926300:0:22698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd14165c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a6e673fb-9566-47bf-b86a-d710f4950716+9:2389:x1875738116659200:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788843926.926323:0:22698:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788843926.926350:0:22698:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000013dee11f/0xa762dfcbd58d3202 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490ff6 expref: 9 pid: 24686 timeout: 804 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843926.926364:0:22698:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000013dee11f/0xa762dfcbd58d3202 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490ff6 expref: 9 pid: 24686 timeout: 804 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843926.926390:0:22698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000013dee11f/0xa762dfcbd58d3202 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490ff6 expref: 9 pid: 24686 timeout: 804 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843926.926410:0:22698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788843926.926415:0:22698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788843926.926421:0:22698:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e28d712a/0xa762dfcbd58d3209 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 24224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843926.926432:0:22698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e28d712a/0xa762dfcbd58d3209 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 24224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843926.926476:0:22698:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788843926.926619:0:24224:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000e28d712a/0xa762dfcbd58d3209 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843926.926629:0:24224:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e28d712a/0xa762dfcbd58d3209 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843926.926661:0:24224:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000e28d712a/0xa762dfcbd58d3209 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843926.926670:0:24224:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e28d712a/0xa762dfcbd58d3209 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 24224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843926.926678:0:24224:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e28d712a/0xa762dfcbd58d3209 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843926.926685:0:24224:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd1153e6600 already unused, calling callback (ffffffffc0cb1420) 00010000:00010000:0.0:1788843926.926690:0:24224:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e28d712a/0xa762dfcbd58d3209 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843926.926700:0:24224:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e28d712a/0xa762dfcbd58d3209 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 24224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843926.926713:0:24224:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e28d712a/0xa762dfcbd58d3209 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843926.926731:0:24224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e28d712a/0xa762dfcbd58d3209 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843926.926885:0:22698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd14165c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a6e673fb-9566-47bf-b86a-d710f4950716+8:2389:x1875738116659200:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 585us (1068us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843926.926894:0:22698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 20 00000100:00100000:0.0:1788843926.928218:0:24224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd14165ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a6e673fb-9566-47bf-b86a-d710f4950716+7:2390:x1875738116659072:12345-192.168.203.33@tcp:1:lhsmtool_posix.0 Request processed in 7318us (7610us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843926.928233:0:24224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 29 00000100:00100000:1.0:1788843926.934721:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843926.934876:0:22713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116659456 00000100:00100000:2.0:1788843926.934888:0:22713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116659456 00000100:00100000:2.0:1788843926.934959:0:22713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 63 00000100:00100000:2.0:1788843926.934980:0:22713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1054e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a6e673fb-9566-47bf-b86a-d710f4950716+16:18770:x1875738116659456:12345-192.168.203.33@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788843926.935102:0:22713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd1153e7000/0xa762dfcbd58d3210 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843926.935123:0:22713:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbeae00/0xa762dfcbd58d315a lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490fb7 expref: 16 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843926.935134:0:22713:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd1153e7000/0xa762dfcbd58d3210 lrc: 4/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843926.935220:0:22713:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbeae00/0xa762dfcbd58d315a lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490fb7 expref: 16 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843926.935234:0:22713:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbeae00/0xa762dfcbd58d315a lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490fb7 expref: 16 pid: 22711 timeout: 804 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843926.935248:0:22713:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10fe20a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22713:1875738134595968:192.168.203.33@tcp:104: 00000100:00100000:2.0:1788843926.935333:0:22713:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd10f9ae6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788843926.938583:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10fe21880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1875738134596096:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788843926.938694:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843926.939057:0:24226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134596096 00000100:00100000:2.0:1788843926.939067:0:24226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134596096 00000100:00100000:2.0:1788843926.939169:0:24226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788843926.939182:0:24226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0079b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3633:x1875738134596096:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788843926.939218:0:24226:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915857920 avail 3684335616 00000100:00100000:2.0:1788843926.939277:0:24226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0079b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3633:x1875738134596096:12345-0@lo:13:osp-pre-0-0.0 Request processed in 99us (583us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843926.939285:0:24226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788843926.939340:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10fe21880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1875738134596096:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788843926.940923:0:22707:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788843926.941190:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd14165fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1875738134596224:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788843926.941283:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843926.943103:0:24226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134596224 00000100:00100000:0.0:1788843926.943120:0:24226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134596224 00000100:00100000:0.0:1788843926.943275:0:24226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788843926.943287:0:24226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10fe21880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3630:x1875738134596224:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788843926.943317:0:24226:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915857920 avail 3684335616 00000100:00100000:0.0:1788843926.943406:0:24226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10fe21880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3630:x1875738134596224:12345-0@lo:13:osp-pre-0-1.0 Request processed in 121us (2124us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843926.943413:0:24226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:3.0:1788843926.944609:0:22707:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788843926.944815:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd14165fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1875738134596224:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788843926.946296:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843926.946400:0:22713:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10fe20a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22713:1875738134595968:192.168.203.33@tcp:104: 00010000:00010000:2.0:1788843926.946430:0:22713:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bd1153e7000/0xa762dfcbd58d3210 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843926.947555:0:23870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116659584 00000100:00100000:3.0:1788843926.947567:0:23870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116659584 00010000:00010000:3.0:1788843926.947615:0:23870:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbeae00/0xa762dfcbd58d315a lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490fb7 expref: 17 pid: 22711 timeout: 804 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843926.947676:0:23870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 21 00000100:00100000:3.0:1788843926.947685:0:23870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd14165f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a6e673fb-9566-47bf-b86a-d710f4950716+17:2390:x1875738116659584:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788843926.947704:0:23870:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788843926.947711:0:23870:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbeae00/0xa762dfcbd58d315a lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490fb7 expref: 17 pid: 22711 timeout: 804 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843926.947724:0:23870:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbeae00/0xa762dfcbd58d315a lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490fb7 expref: 17 pid: 22711 timeout: 804 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843926.947749:0:23870:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbeae00/0xa762dfcbd58d315a lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490fb7 expref: 17 pid: 22711 timeout: 804 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843926.947768:0:23870:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9bd102e00a00) 00010000:00010000:3.0:1788843926.947789:0:23870:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be3400/0xa762dfcbd58d3176 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490fc5 expref: 16 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843926.947800:0:23870:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd1153e7000/0xa762dfcbd58d3210 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843926.947808:0:23870:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd1153e7000/0xa762dfcbd58d3210 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843926.947815:0:23870:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd1153e7000/0xa762dfcbd58d3210 lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843926.947844:0:23870:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788843926.947907:0:23870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd14165f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a6e673fb-9566-47bf-b86a-d710f4950716+16:2390:x1875738116659584:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 223us (1621us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843926.947915:0:23870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 21 00010000:00010000:2.0:1788843926.949022:0:22713:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bd1153e7000/0xa762dfcbd58d3210 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843926.949039:0:22713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd1153e7000/0xa762dfcbd58d3210 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843926.949325:0:22713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd1153e6800/0xa762dfcbd58d3217 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843926.949342:0:22713:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd00873b200/0xa762dfcbd58d31df lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490fe1 expref: 16 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843926.949350:0:22713:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd1153e6800/0xa762dfcbd58d3217 lrc: 4/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843926.949389:0:22713:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bd00873b200/0xa762dfcbd58d31df lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490fe1 expref: 16 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843926.949407:0:22713:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd00873b200/0xa762dfcbd58d31df lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490fe1 expref: 16 pid: 22713 timeout: 805 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843926.949422:0:22713:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10fe20a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22713:1875738134596352:192.168.203.33@tcp:104: 00000100:00100000:2.0:1788843926.949910:0:22713:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd10f9ae180 going to sleep for 11 seconds 00000100:00100000:2.0:1788843926.957280:0:22713:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10fe20a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22713:1875738134596352:192.168.203.33@tcp:104: 00010000:00010000:2.0:1788843926.957343:0:22713:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bd1153e6800/0xa762dfcbd58d3217 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843926.957994:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843926.958208:0:22696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116659712 00000100:00100000:2.0:1788843926.958219:0:22696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116659712 00010000:00010000:2.0:1788843926.958266:0:22696:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd00873b200/0xa762dfcbd58d31df lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490fe1 expref: 17 pid: 22713 timeout: 805 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843926.958310:0:22696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 22 00000100:00100000:2.0:1788843926.958322:0:22696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd14165f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a6e673fb-9566-47bf-b86a-d710f4950716+17:2389:x1875738116659712:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788843926.958341:0:22696:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788843926.958350:0:22696:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bd00873b200/0xa762dfcbd58d31df lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490fe1 expref: 17 pid: 22713 timeout: 805 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843926.958363:0:22696:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bd00873b200/0xa762dfcbd58d31df lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490fe1 expref: 17 pid: 22713 timeout: 805 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843926.958390:0:22696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd00873b200/0xa762dfcbd58d31df lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490fe1 expref: 17 pid: 22713 timeout: 805 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843926.958411:0:22696:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9bd00746c900) 00010000:00010000:2.0:1788843926.958417:0:22696:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd1153e6800/0xa762dfcbd58d3217 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843926.958430:0:22696:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd1153e6800/0xa762dfcbd58d3217 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843926.958451:0:22696:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd1153e6800/0xa762dfcbd58d3217 lrc: 4/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843926.958495:0:22696:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788843926.958574:0:22696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd14165f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a6e673fb-9566-47bf-b86a-d710f4950716+16:2389:x1875738116659712:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 254us (582us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843926.958582:0:22696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 22 00010000:00010000:0.0:1788843926.959041:0:22713:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bd1153e6800/0xa762dfcbd58d3217 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843926.959050:0:22713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd1153e6800/0xa762dfcbd58d3217 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788843926.959229:0:22713:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901912 00000001:00080000:0.0:1788843926.959362:0:22713:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901913 00000001:00080000:0.0:1788843926.959399:0:22713:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901914 00000100:00100000:0.0:1788843926.959500:0:22713:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd14165ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:22713:1875738134596480:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1788843926.959594:0:22713:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843926.959801:0:23743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134596480 00000100:00100000:0.0:1788843926.959808:0:23743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134596480 00000100:00100000:0.0:1788843926.959850:0:23743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788843926.959858:0:23743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd14165c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:22713:x1875738134596480:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1788843926.959936:0:23743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd14165c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:22713:x1875738134596480:12345-0@lo:1000:mdt00_002.0 Request processed in 79us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843926.959944:0:23743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788843926.959981:0:22713:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd103846780 going to sleep for 11 seconds 00000100:00100000:0.0:1788843926.960008:0:22713:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd14165ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:22713:1875738134596480:0@lo:1000:mdt00_002.0 00000001:00080000:0.0:1788843926.960213:0:22713:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901915 00000100:00100000:0.0:1788843926.960256:0:22713:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd14165ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:22713:1875738134596608:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1788843926.960300:0:22713:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843926.960326:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134596608 00000100:00100000:0.0:1788843926.960330:0:22716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134596608 00000100:00100000:0.0:1788843926.960353:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788843926.960360:0:22716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd14165d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:22713:x1875738134596608:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1788843926.960468:0:22716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd14165d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:22713:x1875738134596608:12345-0@lo:1000:mdt00_002.0 Request processed in 108us (166us total) trans 12884901894 rc 0/0 00000100:00100000:0.0:1788843926.960475:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788843926.960493:0:22713:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd10764a900 going to sleep for 11 seconds 00000100:00100000:0.0:1788843926.960513:0:22713:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd14165ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:22713:1875738134596608:0@lo:1000:mdt00_002.0 00010000:00010000:0.0:1788843926.960542:0:22713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd1153e6800/0xa762dfcbd58d3217 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843926.960554:0:22713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd1153e6800/0xa762dfcbd58d3217 lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843926.960572:0:22713:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd1153e6800/0xa762dfcbd58d3217 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843926.960579:0:22713:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd1153e6800 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1788843926.960584:0:22713:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd1153e6800/0xa762dfcbd58d3217 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843926.960593:0:22713:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd1153e6800/0xa762dfcbd58d3217 lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843926.960608:0:22713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9bd00746c900) 00010000:00010000:0.0:1788843926.960611:0:22713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788843926.960616:0:22713:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd1153e6800/0xa762dfcbd58d3217 lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843926.960622:0:22713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd1153e6800/0xa762dfcbd58d3217 lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843926.965192:0:22713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd00873a800/0xa762dfcbd58d316f lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843926.965205:0:22713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd00873a800/0xa762dfcbd58d316f lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843926.965212:0:22713:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd00873a800/0xa762dfcbd58d316f lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843926.965219:0:22713:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd00873a800 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1788843926.965224:0:22713:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd00873a800/0xa762dfcbd58d316f lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843926.965261:0:22713:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd00873a800/0xa762dfcbd58d316f lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843926.965282:0:22713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9bd102e00a00) 00010000:00010000:0.0:1788843926.965285:0:22713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788843926.965296:0:22713:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be3400/0xa762dfcbd58d3176 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490fc5 expref: 19 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843926.965309:0:22713:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be3400/0xa762dfcbd58d3176 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490fc5 expref: 19 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843926.965318:0:22713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be3400/0xa762dfcbd58d3176 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490fc5 expref: 19 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843926.965421:0:22713:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be3400/0xa762dfcbd58d3176 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490fc5 expref: 19 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843926.965451:0:22713:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd14165ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22713:1875738134596736:192.168.203.33@tcp:105: 00000100:00100000:0.0:1788843926.965559:0:22713:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd10764a900 going to sleep for 11 seconds 00000100:00100000:0.0:1788843926.971208:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1788843926.971330:0:22713:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd14165ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22713:1875738134596736:192.168.203.33@tcp:105: 00010000:00010000:1.0:1788843926.971366:0:22713:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd00873a800/0xa762dfcbd58d316f lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843926.971377:0:22713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd00873a800/0xa762dfcbd58d316f lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843926.971419:0:22713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbeb200/0xa762dfcbd58d321e lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843926.971447:0:22713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbeb200/0xa762dfcbd58d321e lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843926.971460:0:22713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbeb200/0xa762dfcbd58d321e lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843926.971472:0:22713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbeb200/0xa762dfcbd58d321e lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843926.971478:0:22713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbeb200/0xa762dfcbd58d321e lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843926.971485:0:22713:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbeb200/0xa762dfcbd58d321e lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843926.971490:0:22713:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd13fbeb200 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1788843926.971495:0:22713:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbeb200/0xa762dfcbd58d321e lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843926.971524:0:22713:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbeb200/0xa762dfcbd58d321e lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843926.971539:0:22713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9bd102e00a00) 00010000:00010000:1.0:1788843926.971543:0:22713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788843926.971829:0:22713:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbeb200/0xa762dfcbd58d321e lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843926.971837:0:22713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbeb200/0xa762dfcbd58d321e lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843926.971849:0:22713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd1153e7000/0xa762dfcbd58d3210 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843926.971854:0:22713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd1153e7000/0xa762dfcbd58d3210 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843926.971860:0:22713:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd1153e7000/0xa762dfcbd58d3210 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843926.971864:0:22713:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd1153e7000 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1788843926.971866:0:22713:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd1153e7000/0xa762dfcbd58d3210 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843926.971872:0:22713:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd1153e7000/0xa762dfcbd58d3210 lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843926.971881:0:22713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9bd102e00a00) 00010000:00010000:1.0:1788843926.971884:0:22713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788843926.971887:0:22713:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd1153e7000/0xa762dfcbd58d3210 lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843926.971904:0:22713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd1153e7000/0xa762dfcbd58d3210 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843926.972127:0:22713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1054e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a6e673fb-9566-47bf-b86a-d710f4950716+19:18770:x1875738116659456:12345-192.168.203.33@tcp:57:lhsmtool_posix.0 Request processed in 37145us (37414us total) trans 12884901916 rc 0/0 00000100:00100000:1.0:1788843926.972138:0:22713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 63 00000020:00080000:1.0:1788843926.972182:0:22713:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:3.0:1788843926.972672:0:22715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116659840 00000100:00100000:3.0:1788843926.972684:0:22715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116659840 00000100:00100000:3.0:1788843926.972744:0:22715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 10 00000100:00100000:3.0:1788843926.972755:0:22715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0018b7050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a6e673fb-9566-47bf-b86a-d710f4950716+19:18768:x1875738116659840:12345-192.168.203.33@tcp:49:dd.0 00000100:00100000:3.0:1788843926.972873:0:22715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0018b7050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a6e673fb-9566-47bf-b86a-d710f4950716+19:18768:x1875738116659840:12345-192.168.203.33@tcp:49:dd.0 Request processed in 120us (1680us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843926.972881:0:22715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 10 00000040:00080000:0.0:1788843926.973313:0:22748:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:0.0:1788843926.973319:0:22748:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788843926.973362:0:22748:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:0.0:1788843926.973369:0:22748:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:1.0:1788843926.978384:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1788843926.979034:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116659968 00000100:00100000:0.0:1788843926.979049:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116659968 00000100:00100000:0.0:1788843926.979170:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 64 00000100:00100000:0.0:1788843926.979183:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1054e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a6e673fb-9566-47bf-b86a-d710f4950716+19:18768:x1875738116659968:12345-192.168.203.33@tcp:101:dd.0 00010000:00010000:0.0:1788843926.979229:0:22712:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788843926.979256:0:22712:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd00873a400/0xa762dfcbd58d3225 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf24d95f22490ffd expref: -99 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843926.979303:0:22712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd00873a000/0xa762dfcbd58d322c lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843926.979321:0:22712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd00873a000/0xa762dfcbd58d322c lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843926.979334:0:22712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd00873a000/0xa762dfcbd58d322c lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843926.979896:0:22712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd00873a400/0xa762dfcbd58d3225 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490ffd expref: 21 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843926.979922:0:22712:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd00873a000/0xa762dfcbd58d322c lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490ffd expref: 20 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843926.979932:0:22712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9bd102e00a00) 00010000:00010000:0.0:1788843926.979935:0:22712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788843926.979940:0:22712:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd00873a000, rc 0) 00000100:00100000:0.0:1788843926.980037:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1054e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a6e673fb-9566-47bf-b86a-d710f4950716+20:18768:x1875738116659968:12345-192.168.203.33@tcp:101:dd.0 Request processed in 856us (1666us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843926.980045:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 64 00000100:00100000:0.0:1788843926.983224:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843926.984674:0:22715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116660224 00000100:00100000:3.0:1788843926.984694:0:22715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116660224 00000100:00100000:3.0:1788843926.984779:0:22715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 11 00000100:00100000:3.0:1788843926.984791:0:22715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd14165ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a6e673fb-9566-47bf-b86a-d710f4950716+20:18770:x1875738116660224:12345-192.168.203.33@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1788843926.985215:0:22715:0:(mdd_object.c:4014:mdd_close()) Object [0x2000013a1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1788843926.985279:0:22715:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901917 00010000:00010000:3.0:1788843926.985321:0:22715:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be3800/0xa762dfcbd58d3233 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843926.985342:0:22715:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be3800/0xa762dfcbd58d3233 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843926.985354:0:22715:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be3800/0xa762dfcbd58d3233 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843926.985362:0:22715:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be3800/0xa762dfcbd58d3233 lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843926.985369:0:22715:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be3800/0xa762dfcbd58d3233 lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843926.985375:0:22715:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be3800/0xa762dfcbd58d3233 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843926.985403:0:22715:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788843926.986864:0:23471:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788843926.986881:0:23471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be3800/0xa762dfcbd58d3233 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843926.986914:0:23471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd007be3800 already unused, calling callback (ffffffffc0cb1420) 00010000:00010000:0.0:1788843926.986919:0:23471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be3800/0xa762dfcbd58d3233 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843926.986929:0:23471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be3800/0xa762dfcbd58d3233 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843926.986949:0:23471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9bd00746c900) 00010000:00010000:0.0:1788843926.986952:0:23471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788843926.986957:0:23471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be3800/0xa762dfcbd58d3233 lrc: 1/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843926.986972:0:23471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be3800/0xa762dfcbd58d3233 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843926.986992:0:23471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843926.986995:0:23471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843926.986997:0:23471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788843926.987351:0:22715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd14165ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a6e673fb-9566-47bf-b86a-d710f4950716+22:18770:x1875738116660224:12345-192.168.203.33@tcp:35:lhsmtool_posix.0 Request processed in 2553us (4130us total) trans 12884901918 rc 0/0 00000100:00100000:3.0:1788843926.987364:0:22715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 11 00000020:00080000:3.0:1788843926.987373:0:22715:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1788843927.006272:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1788843927.006514:0:24228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116660352 00000100:00100000:1.0:1788843927.006526:0:24228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116660352 00000100:00100000:1.0:1788843927.006636:0:24228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 0 00000100:00080000:2.0:1788843927.006647:0:22707:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788843927.006650:0:24228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0079baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a6e673fb-9566-47bf-b86a-d710f4950716+7:2390:x1875738116660352:12345-192.168.203.33@tcp:4:dd.0 00002000:00010000:1.0:1788843927.007382:0:24228:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x42:0x0] initial LVB size: 0, mtime: 0x6a9f9795, atime: 0x6a9f9794, ctime: 0x6a9f9795, blocks: 0x0 00010000:00010000:1.0:1788843927.007394:0:24228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b11d7803/0xa762dfcbd58d323a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843927.007415:0:24228:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=705s v=(0 0) 00010000:00010000:1.0:1788843927.007420:0:24228:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788843927.007427:0:24228:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b11d7803/0xa762dfcbd58d323a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843927.007445:0:24228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b11d7803/0xa762dfcbd58d323a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843927.009860:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843927.012779:0:24230:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:2.0:1788843927.012810:0:24230:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:1.0:1788843927.013255:0:24230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116660480 00000100:00100000:1.0:1788843927.013268:0:24230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116660480 00000100:00100000:2.0:1788843927.014122:0:25762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1 00000100:00100000:2.0:1788843927.014192:0:25762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd14165fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a6e673fb-9566-47bf-b86a-d710f4950716+8:2390:x1875738116660480:12345-192.168.203.33@tcp:4:dd.0 00010000:00010000:2.0:1788843927.014236:0:25762:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ab43c061/0xa762dfcbd58d3241 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843927.014254:0:25762:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788843927.014259:0:25762:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788843927.014266:0:25762:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ab43c061/0xa762dfcbd58d3241 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843927.014282:0:25762:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ab43c061/0xa762dfcbd58d3241 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788843927.125297:0:25039:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901895 is committed 00000001:00080000:0.0:1788843927.125323:0:25039:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901894 is committed 00002000:00010000:1.0:1788843927.125697:0:24228:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb size from disk: 0 -> 4194304 00002000:00010000:1.0:1788843927.125714:0:24228:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb mtime from disk: 1788843925 -> 1788843926 00002000:00010000:1.0:1788843927.125717:0:24228:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb ctime from disk: 1788843925 -> 1788843926 00002000:00010000:1.0:1788843927.125720:0:24228:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb blocks from disk: 0 -> 8192 00010000:00010000:1.0:1788843927.125741:0:24228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b11d7803/0xa762dfcbd58d323a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843927.125756:0:24228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b11d7803/0xa762dfcbd58d323a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843927.125765:0:24228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b11d7803/0xa762dfcbd58d323a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843927.125773:0:24228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd13fbeb200 already unused, calling callback (ffffffffc0cb1420) 00010000:00010000:1.0:1788843927.125779:0:24228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b11d7803/0xa762dfcbd58d323a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843927.125789:0:24228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b11d7803/0xa762dfcbd58d323a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843927.125814:0:24228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b11d7803/0xa762dfcbd58d323a lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843927.125822:0:24228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b11d7803/0xa762dfcbd58d323a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843927.125941:0:24228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0079baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a6e673fb-9566-47bf-b86a-d710f4950716+7:2390:x1875738116660352:12345-192.168.203.33@tcp:4:dd.0 Request processed in 119288us (119677us total) trans 12884901895 rc 0/0 00000100:00100000:1.0:1788843927.125952:0:24228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 0 00010000:00010000:2.0:1788843927.132551:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788843927.158592:0:25039:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901896 is committed 00002000:00010000:2.0:1788843927.163235:0:25762:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb size from disk: 4194304 -> 7654321 00002000:00010000:2.0:1788843927.163249:0:25762:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb blocks from disk: 8192 -> 14952 00010000:00010000:2.0:1788843927.163271:0:25762:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ab43c061/0xa762dfcbd58d3241 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843927.163286:0:25762:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ab43c061/0xa762dfcbd58d3241 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 25762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843927.163319:0:25762:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ab43c061/0xa762dfcbd58d3241 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843927.163327:0:25762:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd1153e6800 already unused, calling callback (ffffffffc0cb1420) 00010000:00010000:2.0:1788843927.163333:0:25762:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ab43c061/0xa762dfcbd58d3241 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843927.163343:0:25762:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ab43c061/0xa762dfcbd58d3241 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 25762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843927.163366:0:25762:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ab43c061/0xa762dfcbd58d3241 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843927.163373:0:25762:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ab43c061/0xa762dfcbd58d3241 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843927.163624:0:25762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd14165fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a6e673fb-9566-47bf-b86a-d710f4950716+5:2390:x1875738116660480:12345-192.168.203.33@tcp:4:dd.0 Request processed in 149483us (153772us total) trans 12884901896 rc 0/0 00000100:00100000:2.0:1788843927.163636:0:25762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1 00000100:00100000:1.0:1788843927.965345:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd1054e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1875738134596864:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788843927.965428:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843927.965517:0:22717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134596864 00000100:00100000:1.0:1788843927.965525:0:22717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134596864 00000100:00100000:1.0:1788843927.965575:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788843927.965585:0:22717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141bf0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3631:x1875738134596864:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788843927.965630:0:22717:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788843927.965679:0:22717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141bf0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3631:x1875738134596864:12345-0@lo:41:osp-pre-1-0.0 Request processed in 94us (249us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843927.965686:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788843927.965737:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd1054e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1875738134596864:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788843927.978287:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0079b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1875738134596992:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788843927.978383:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843927.978514:0:23743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134596992 00000100:00100000:3.0:1788843927.978523:0:23743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134596992 00000100:00100000:3.0:1788843927.978580:0:23743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788843927.978590:0:23743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141bf3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3632:x1875738134596992:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788843927.978626:0:23743:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446289408 avail 1300049920 00000100:00100000:3.0:1788843927.978680:0:23743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141bf3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3632:x1875738134596992:12345-0@lo:41:osp-pre-0-1.0 Request processed in 91us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843927.978695:0:23743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788843927.978745:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0079b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1875738134596992:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788843928.157485:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788843928.791979:0:25800:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1d: @@@@@@ FAIL: expected /mnt/pcc.d1d.sanity-pcc/d1d.sanity-pcc/13a3/0x2000013a1:0x2:0x0 size: 7654321 got: 0 00000040:00080000:0.0:1788843929.051555:0:22748:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:0.0:1788843929.051569:0:22748:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788843929.051617:0:22748:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:0.0:1788843929.051637:0:22748:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00010000:00010000:0.0:1788843929.178384:0:23471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788843929.501595:0:3632:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788843929.501641:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10fe20a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1875738134597120:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788843929.501740:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843929.501805:0:24226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134597120 00000100:00100000:2.0:1788843929.501814:0:24226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134597120 00000100:00100000:2.0:1788843929.501882:0:24226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788843929.501892:0:24226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10fe21f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3632:x1875738134597120:12345-0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1788843929.502220:0:22707:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00000024:2.0:1788843929.502441:0:24226:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 26324672 pending 0 free 3915849728 avail 3684327424 00000100:00100000:2.0:1788843929.502517:0:24226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10fe21f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3632:x1875738134597120:12345-0@lo:13:osp-pre-1-0.0 Request processed in 625us (776us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843929.502525:0:24226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788843929.506984:0:3632:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 12884901894 gen 2 00000004:00080000:3.0:1788843929.507000:0:3632:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9bd1054e3b80, transno 12884901892 00000004:00080000:3.0:1788843929.507020:0:3632:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 12884901894 committed transno 12884901894 00000100:00100000:3.0:1788843929.507063:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10fe20a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1875738134597120:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788843929.513188:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0079b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3633:1875738134597632:0@lo:400:kworker.0 00000100:00100000:3.0:1788843929.513291:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843929.513335:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0079b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3633:1875738134598144:0@lo:400:kworker.0 00000100:00100000:3.0:1788843929.513361:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843929.513379:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0079b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3633:1875738134598656:0@lo:400:kworker.0 00000100:00100000:3.0:1788843929.513400:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843929.513431:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1788843929.513437:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0079bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1875738134597504:0@lo:400:kworker.0 00000100:00100000:3.0:1788843929.513463:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843929.513682:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0079b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0ce589ba-8334-438e-8f48-13932fcba8b1:3630:1875738134597248:0@lo:400:kworker.0 00000100:00100000:1.0:1788843929.513725:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843929.513761:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0079bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1875738134597760:0@lo:400:kworker.0 00000100:00100000:1.0:1788843929.514016:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843929.514045:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0079b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3630:1875738134598272:0@lo:400:kworker.0 00000100:00100000:1.0:1788843929.514069:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843929.514090:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1788843929.514095:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0079bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1875738134597376:0@lo:400:kworker.0 00000100:00100000:1.0:1788843929.514131:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843929.514180:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0079b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1875738134597888:0@lo:400:kworker.0 00000100:00100000:1.0:1788843929.514201:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843929.514218:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0079b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3630:1875738134598400:0@lo:400:kworker.0 00000100:00100000:1.0:1788843929.514262:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843929.514296:0:25511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134597632 00000100:00100000:1.0:1788843929.514305:0:25511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134597632 00000100:00100000:1.0:1788843929.514353:0:25511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134598144 00000100:00100000:1.0:1788843929.514356:0:25511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134598144 00000100:00100000:1.0:1788843929.514369:0:25511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134598656 00000100:00100000:1.0:1788843929.514372:0:25511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134598656 00000100:00100000:1.0:1788843929.514396:0:25511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134598272 00000100:00100000:1.0:1788843929.514398:0:25511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134598272 00000100:00100000:1.0:1788843929.514409:0:25511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134598400 00000100:00100000:1.0:1788843929.514412:0:25511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134598400 00000100:00100000:1.0:1788843929.514429:0:25511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788843929.514438:0:25511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0079b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3633:x1875738134597632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843929.514514:0:25511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0079b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3633:x1875738134597632:12345-0@lo:400:kworker.0 Request processed in 76us (1223us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843929.514523:0:25511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788843929.514541:0:25511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788843929.514547:0:25511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0079bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3633:x1875738134598144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788843929.516041:0:24222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134597504 00000100:00100000:2.0:1788843929.516060:0:24222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134597504 00000100:00100000:2.0:1788843929.516161:0:24222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134597888 00000100:00100000:2.0:1788843929.516165:0:24222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134597888 00000100:00100000:2.0:1788843929.516194:0:24222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788843929.516203:0:24222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0079b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3633:x1875738134597504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788843929.516300:0:24222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0079b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3633:x1875738134597504:12345-0@lo:400:kworker.0 Request processed in 98us (2836us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843929.516307:0:24222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788843929.516322:0:24222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788843929.516328:0:24222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141bf2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3630:x1875738134597888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788843929.516368:0:24222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141bf2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3630:x1875738134597888:12345-0@lo:400:kworker.0 Request processed in 41us (2166us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843929.516374:0:24222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788843929.516414:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134597248 00000100:00100000:2.0:1788843929.516418:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134597248 00000100:00100000:2.0:1788843929.516443:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1788843929.516462:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd00702f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ce589ba-8334-438e-8f48-13932fcba8b1+24:3630:x1875738134597248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788843929.516503:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd00702f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ce589ba-8334-438e-8f48-13932fcba8b1+24:3630:x1875738134597248:12345-0@lo:400:kworker.0 Request processed in 54us (2778us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843929.516509:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00080000:2.0:1788843929.516545:0:22707:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788843929.516579:0:22707:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788843929.516583:0:22707:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788843929.516637:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788843929.516646:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0079ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3633:x1875738134598656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788843929.516680:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0079ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3633:x1875738134598656:12345-0@lo:400:kworker.0 Request processed in 35us (3278us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843929.516687:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788843929.516705:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788843929.516711:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141bf1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3630:x1875738134598272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788843929.516735:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141bf1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3630:x1875738134598272:12345-0@lo:400:kworker.0 Request processed in 25us (2666us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843929.516740:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788843929.516750:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788843929.516755:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141bf3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3630:x1875738134598400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788843929.516779:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141bf3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3630:x1875738134598400:12345-0@lo:400:kworker.0 Request processed in 24us (2517us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843929.516783:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788843929.516800:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134597760 00000100:00100000:2.0:1788843929.516804:0:22716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134597760 00000100:00100000:2.0:1788843929.516828:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134597376 00000100:00100000:2.0:1788843929.516841:0:22716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134597376 00000100:00100000:2.0:1788843929.516856:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788843929.516861:0:22716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141bf1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3630:x1875738134597760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788843929.516894:0:22716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141bf1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3630:x1875738134597760:12345-0@lo:400:kworker.0 Request processed in 34us (2879us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843929.516900:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788843929.516911:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788843929.516923:0:22716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141bf0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3630:x1875738134597376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788843929.516966:0:22716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141bf0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3630:x1875738134597376:12345-0@lo:400:kworker.0 Request processed in 44us (2833us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843929.516971:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788843929.517053:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0079bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1875738134597376:0@lo:400:kworker.0 00000100:00100000:2.0:1788843929.517068:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0079b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1875738134597888:0@lo:400:kworker.0 00010000:00080000:2.0:1788843929.517084:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd0079b8a80 x1875738134598400/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843945 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788843929.517095:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0079b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3630:1875738134598400:0@lo:400:kworker.0 00000100:00100000:2.0:1788843929.517105:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0079b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0ce589ba-8334-438e-8f48-13932fcba8b1:3630:1875738134597248:0@lo:400:kworker.0 00000100:00100000:2.0:1788843929.517115:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0079bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1875738134597760:0@lo:400:kworker.0 00000100:00100000:2.0:1788843929.517125:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0079b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3630:1875738134598272:0@lo:400:kworker.0 00000100:00100000:2.0:1788843929.517242:0:3631:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788843929.517254:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10fe23800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1875738134598784:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788843929.517292:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843929.517337:0:24227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134598784 00000100:00100000:2.0:1788843929.517341:0:24227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134598784 00000100:00100000:2.0:1788843929.517376:0:24227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788843929.517383:0:24227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10fe23b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3631:x1875738134598784:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788843929.517400:0:24227:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 26324672 pending 0 free 3915849728 avail 3684327424 00000100:00100000:2.0:1788843929.517438:0:24227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10fe23b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3631:x1875738134598784:12345-0@lo:13:osp-pre-1-1.0 Request processed in 55us (146us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843929.517445:0:24227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:2.0:1788843929.517472:0:22707:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788843929.517496:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10fe23800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1875738134598784:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788843929.519088:0:25511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0079bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3633:x1875738134598144:12345-0@lo:400:kworker.0 Request processed in 4530us (5715us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843929.519289:0:25511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788843929.522339:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0079bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1875738134597504:0@lo:400:kworker.0 00000100:00100000:2.0:1788843929.522360:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0079bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1875738134598016:0@lo:400:kworker.0 00000100:00100000:2.0:1788843929.522445:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843929.522506:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0079ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3633:1875738134598528:0@lo:400:kworker.0 00000100:00100000:2.0:1788843929.522532:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843929.522675:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0079b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3633:1875738134597632:0@lo:400:kworker.0 00000100:00100000:2.0:1788843929.522690:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0079b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3633:1875738134598144:0@lo:400:kworker.0 00010000:00080000:2.0:1788843929.522705:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd0079b8000 x1875738134598656/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843945 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788843929.522716:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0079b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3633:1875738134598656:0@lo:400:kworker.0 00000100:00100000:3.0:1788843929.524187:0:24222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134598016 00000100:00100000:3.0:1788843929.524204:0:24222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134598016 00000100:00100000:3.0:1788843929.524289:0:24222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788843929.524301:0:24222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10fe23800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3633:x1875738134598016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788843929.524402:0:24222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10fe23800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3633:x1875738134598016:12345-0@lo:400:kworker.0 Request processed in 103us (1957us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843929.524431:0:24222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788843929.524796:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0079bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1875738134598016:0@lo:400:kworker.0 00000100:00100000:1.0:1788843929.532358:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134598528 00000100:00100000:1.0:1788843929.532378:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134598528 00000100:00100000:1.0:1788843929.533500:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788843929.533518:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10fe22d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3633:x1875738134598528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843929.533660:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10fe22d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3633:x1875738134598528:12345-0@lo:400:kworker.0 Request processed in 146us (11125us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843929.533668:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788843929.536644:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0079ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3633:1875738134598528:0@lo:400:kworker.0 00000100:00080000:2.0:1788843929.545583:0:22707:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788843930.204315:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 14055 lines, 14055 kept, 0 dropped, 0 bad.